-- Logs begin at Thu 2022-07-14 09:31:47 UTC, end at Thu 2022-07-14 10:41:27 UTC. -- Jul 14 10:03:27.330534 dv-cinder-849800-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 10:03:27.339304 dv-cinder-849800-1-smb devstack@keystone.service[80491]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 10:03:27.341462 dv-cinder-849800-1-smb devstack@keystone.service[80491]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 10:03:27 2022] *** Jul 14 10:03:27.341462 dv-cinder-849800-1-smb devstack@keystone.service[80491]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 10:03:27.341462 dv-cinder-849800-1-smb devstack@keystone.service[80491]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 10:03:27.341462 dv-cinder-849800-1-smb devstack@keystone.service[80491]: nodename: dv-cinder-849800-1-smb Jul 14 10:03:27.341462 dv-cinder-849800-1-smb devstack@keystone.service[80491]: machine: x86_64 Jul 14 10:03:27.341462 dv-cinder-849800-1-smb devstack@keystone.service[80491]: clock source: unix Jul 14 10:03:27.341462 dv-cinder-849800-1-smb devstack@keystone.service[80491]: pcre jit disabled Jul 14 10:03:27.341462 dv-cinder-849800-1-smb devstack@keystone.service[80491]: detected number of CPU cores: 4 Jul 14 10:03:27.341462 dv-cinder-849800-1-smb devstack@keystone.service[80491]: current working directory: / Jul 14 10:03:27.341462 dv-cinder-849800-1-smb devstack@keystone.service[80491]: detected binary path: /usr/bin/uwsgi-core Jul 14 10:03:27.342021 dv-cinder-849800-1-smb devstack@keystone.service[80491]: your processes number limit is 47680 Jul 14 10:03:27.342021 dv-cinder-849800-1-smb devstack@keystone.service[80491]: your memory page size is 4096 bytes Jul 14 10:03:27.342021 dv-cinder-849800-1-smb devstack@keystone.service[80491]: detected max file descriptor number: 2048 Jul 14 10:03:27.342021 dv-cinder-849800-1-smb devstack@keystone.service[80491]: lock engine: pthread robust mutexes Jul 14 10:03:27.342021 dv-cinder-849800-1-smb devstack@keystone.service[80491]: thunder lock: enabled Jul 14 10:03:27.342021 dv-cinder-849800-1-smb devstack@keystone.service[80491]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 10:03:27.342021 dv-cinder-849800-1-smb devstack@keystone.service[80491]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 10:03:27.387080 dv-cinder-849800-1-smb devstack@keystone.service[80491]: Python main interpreter initialized at 0x55a28e7c89c0 Jul 14 10:03:27.387080 dv-cinder-849800-1-smb devstack@keystone.service[80491]: python threads support enabled Jul 14 10:03:27.387080 dv-cinder-849800-1-smb devstack@keystone.service[80491]: your server socket listen backlog is limited to 100 connections Jul 14 10:03:27.387080 dv-cinder-849800-1-smb devstack@keystone.service[80491]: your mercy for graceful operations on workers is 90 seconds Jul 14 10:03:27.387462 dv-cinder-849800-1-smb devstack@keystone.service[80491]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 10:03:27.387540 dv-cinder-849800-1-smb devstack@keystone.service[80491]: *** Operational MODE: preforking *** Jul 14 10:03:27.387820 dv-cinder-849800-1-smb devstack@keystone.service[80491]: *** uWSGI is running in multiple interpreter mode *** Jul 14 10:03:27.387820 dv-cinder-849800-1-smb devstack@keystone.service[80491]: spawned uWSGI master process (pid: 80491) Jul 14 10:03:27.388035 dv-cinder-849800-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 14 10:03:27.389344 dv-cinder-849800-1-smb devstack@keystone.service[80491]: spawned uWSGI worker 1 (pid: 80502, cores: 1) Jul 14 10:03:27.389344 dv-cinder-849800-1-smb devstack@keystone.service[80491]: spawned uWSGI worker 2 (pid: 80503, cores: 1) Jul 14 10:03:27.389344 dv-cinder-849800-1-smb devstack@keystone.service[80491]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 10:03:32.936591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:03:32.936591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: from cryptography.utils import int_from_bytes Jul 14 10:03:32.937380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:03:32.937380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: from cryptography.utils import int_from_bytes Jul 14 10:03:32.937527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:03:32.937527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: from cryptography.utils import int_from_bytes Jul 14 10:03:32.937962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:03:32.937962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: from cryptography.utils import int_from_bytes Jul 14 10:03:32.986135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:03:32.986327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:03:32.986523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] command line args: [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:03:32.986796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:03:32.986977 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ================================================================================ {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:03:32.987056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:03:32.987241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] admin_token = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.987320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:03:32.987435 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] command line args: [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:03:32.987518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] config_dir = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.987666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.987743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:03:32.987851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] config_source = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.987935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ================================================================================ {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:03:32.988042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] debug = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.988151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] admin_token = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.988251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.988499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] config_dir = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.988619 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.988729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.988826 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] config_source = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.988920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.989029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] debug = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.989134 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.989235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.989366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.989475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.989576 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] list_limit = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.989677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.989778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] log_config_append = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.989890 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.989998 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.989998 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] log_dir = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.990185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.990287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] log_file = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.990387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] list_limit = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.990493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.990616 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] log_config_append = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.990616 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.990807 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.990883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] log_dir = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.991003 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.991088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] log_file = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.991160 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.991277 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.991357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.991431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.991549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.991640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.991800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.991878 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.992050 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.992181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.992307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.992417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.992530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.992641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.992758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.992871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.992992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.993111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.993223 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.993339 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.993451 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.993568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.993693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.993795 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.993918 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.994066 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.994186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.74/identity {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.994344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] publish_errors = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.994460 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.994574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.994801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.994982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.74/identity {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.995105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.995218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] publish_errors = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.995329 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.995448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.995566 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.995685 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.995685 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.995919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] standard_threads = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.996061 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.996183 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.996302 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.996414 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.996414 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.996623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] standard_threads = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.996746 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] use_journal = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.996859 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.996971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] use_json = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.997088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.997206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] use_stderr = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.997318 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.997438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] use_syslog = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.997551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] use_journal = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.997663 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.997774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] use_json = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.997886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:32.997997 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] use_stderr = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.997997 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] use_syslog = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.998290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:32.998403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:03:32.998515 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:32.998625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:32.998737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:32.998856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:32.998974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:32.999097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:32.999210 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:32.999320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:32.999431 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:32.999550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:32.999663 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:32.999775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:32.999892 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.000033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.000152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.000275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.000389 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.000506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.000624 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.000741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.000860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.000980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.001098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.001217 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.001329 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.001444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.001567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.001680 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.001792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.001903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.002021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.002139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.002260 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.002378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.002491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.002608 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.002721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.002837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.002966 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.003079 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.003190 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.003301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.003412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.003528 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.003719 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.003719 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.003940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.004092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.004208 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.004351 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.004517 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.004634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.004745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.004862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.005086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.005205 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.005323 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.005442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.005560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.005678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.005790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.005909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.006021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.006133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.006243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.006354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.006464 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.006583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.006696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.006807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.007422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.007541 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.007653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.007772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.007885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.008034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.008150 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.008297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.008422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.008547 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.008661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.008758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.008853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.008948 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.009050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.009147 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.009242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.009337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.009438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.009535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.009639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.009744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.009856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.009977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.010101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.010215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.010328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.010440 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.010562 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.010682 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.010786 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.010905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.011019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.011131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.011251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.011366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.011477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.011595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.011714 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.011828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.011948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.012084 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.012198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.012310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.012422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.012546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.012661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.012778 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.012892 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.013011 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.013125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.013243 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.013362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.013477 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.013596 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.013709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.013832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.013832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.014052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.014052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.014264 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.014377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.014496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.014609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.014729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.014843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.014954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.015067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.015178 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.015297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.015484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.015484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.015707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.015707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.015918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.016093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.016218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.016332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.016444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.016557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.016675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.016675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.016899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.017025 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.017140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.017252 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.017364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.017476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.017595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.017716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.017831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.017831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.018041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.018153 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.018265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.018384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.018498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.018611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.018724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.018724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.018941 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.019065 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.019186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.019300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.019412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.019524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.019636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.019757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.019871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.020052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.020181 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.020295 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.020408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.020533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.020648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.020762 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.020880 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.020994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.021106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.021226 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.021341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.021453 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.021565 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.021677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.021790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.021790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.022010 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.022122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.022234 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.022346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.023145 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.023317 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.023435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] auth.external = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.023435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.023648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.023648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.023860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.023860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.024115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.024229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] auth.password = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.024373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] auth.external = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.024499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] auth.token = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.024614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.024727 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.024841 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.024966 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.025087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.025452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.025575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] auth.password = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.025689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.025802 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] auth.token = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.025924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.026050 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.026259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.026403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.026519 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.026633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.026760 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] credential.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.026876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.026991 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.027105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.027218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.027333 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.027456 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.027572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.027685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.027799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] credential.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.027912 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.028056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.028182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.028297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.028416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.028530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.028643 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.028764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.028928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.029047 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.029168 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.029282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.029282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.029502 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.029626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.029739 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.029860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.029975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.030088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.030286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.030286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.030503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.030617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.030737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.030852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.030973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.031088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.031201 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.031315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.031428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.031541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.031666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.031781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.031895 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.032033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.032160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.032277 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.032398 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.032513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.032627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.032740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.032853 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.032966 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.033087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.033211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.033327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.033440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.033553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.033666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.033787 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.033902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.034015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.034134 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.034249 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.034362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.034484 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.034599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.034712 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.034825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.034937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.035050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.035171 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.035286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.035399 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.035513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.035626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.035739 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.035859 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.035974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.036106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.036221 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.036333 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.036447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.036577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.036694 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.036807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.036920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.037032 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.037145 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.037266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.037381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.037495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.037609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.037721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.037842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.037957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.038070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.038199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.038375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.038492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.038619 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.038818 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.038940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.039054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.039168 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.039286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.039409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.039524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.039639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.039752 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.039865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.039979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.040158 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.040276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.040390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.040502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.040616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.040729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.040851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.040966 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.041079 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.041192 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.041306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.041419 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.041540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.041655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.041770 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.041883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.041996 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.042110 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.042231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.042347 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.042461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.042574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.042687 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.042801 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.042923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.043038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.043151 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.043271 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.043387 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.043499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.043621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.043736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.043851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.043964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.044112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.044276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.044461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.044640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.044804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.044964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.045119 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.045281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.045917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.046022 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.046120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.046218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.046315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.046411 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.046516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.046615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.046713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.046809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.046913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.047023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.047129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.047129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.047129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.047129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.047129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.047573 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.047678 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.047678 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.047866 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.047963 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.048120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.048220 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.048336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.048435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.048532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.048628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.048723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.048826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.048931 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.049029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.049126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.049228 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.049324 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.049420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.049524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.049628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.049724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.049820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.049915 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.050017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.050127 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.050233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.050328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.050431 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.050527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.050623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.050751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.050866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.050980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.051094 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.051208 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.051348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.051465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.051580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.051693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.051806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.051919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.052057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.052174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.052289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.052402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.052515 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.052627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.052811 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.052928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.053067 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.053184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.053298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.053411 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.053550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.053666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.053780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.053893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.054026 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.054186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.054320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.054436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.054550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.054663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.054776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.054889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.055010 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.055125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.055229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.055325 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.055423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.055519 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.055624 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.055723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.055820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.055916 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.056094 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] role.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.056200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.056310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] role.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.056411 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.056509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.056605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.056701 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.056798 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.056903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.057002 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.057099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.057195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.057291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.057388 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.057498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.057603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.057702 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.057798 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.057895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.057992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] role.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.058097 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.058195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] role.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.058297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.058395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.058492 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.058588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.058693 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.058793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.058890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.058986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.059083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.059180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.059180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.059370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.059978 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.060124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.060241 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.060369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.060486 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.060608 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.060723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.060836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.060957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.061072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.061185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.061299 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.061413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.061526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.061649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.061764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.061764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.061977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.062091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.062203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.062323 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.062438 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.062552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.062664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.062778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.062891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.063011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.063126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.063239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.063353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.063465 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.063578 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.063699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.063815 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.063928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.064085 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.064202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.064315 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.064441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.064557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.064670 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.064784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.064898 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.065010 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.065131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.065246 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.065359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.065473 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.065586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.065698 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.065820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.065936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.066049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.066161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.066280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.066395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.066516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.066631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.066744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.066857 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.066971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.067084 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.067205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.067320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.067434 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.067546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.067659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.067771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.067892 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.068021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.068137 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.068251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.068364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.connection = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.068489 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.068614 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.068740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.068856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.068971 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.069083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.069196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.069309 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.069932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.070054 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.070171 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.070284 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.070398 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.070511 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.070632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.070747 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.070861 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.070974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.071088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.connection = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.071209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.071332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.071523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.071640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.071754 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.071868 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.071981 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.072142 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.072268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.072385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.072499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.072612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.072726 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.072838 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.072960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.073075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.073190 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.073303 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.073416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:03:33.073530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.073530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.073530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.073530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.073952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.073952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.074164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.074385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.074624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:03:33.074796 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:03:33.103889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.104144 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.104374 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.105402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.105642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.105873 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.112769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.114322 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.141113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.141345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.143065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.143302 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.285491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.285693 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.334763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.335000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.336345 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.336587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.401032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.401258 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.401484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.401704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.401789 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.401920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.402021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.402136 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.402220 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.402359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.402580 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.402798 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.427349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.427588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.427818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.428068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.428170 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.428295 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.428413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.428507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.428645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.428738 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.429421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.429647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.429863 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.430084 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.440320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.441268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.453531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.453767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.453996 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.454222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.454323 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.454443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.454527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.454660 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.454744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.454877 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.454963 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.455093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.455310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.455526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:03:33.472164 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.472377 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 10:03:33.472881 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.472966 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.473097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 10:03:33.473181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 10:03:33.473385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.473648 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.473731 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.473851 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 10:03:33.473935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.474124 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.474217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.474391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.474655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.474913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.485056 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.485334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.485603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.485884 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.486136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.486417 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.486689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.487012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.494788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.495901 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.498093 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.498373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.498660 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.498941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.499222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.499304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.499484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.499577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.499754 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.499837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.500046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.500131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.500319 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.500404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.500575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.500658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.500839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.500920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.501115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.501383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.501654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.501921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.527984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.529405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.529619 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.529898 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.531028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.531305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.535153 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.535431 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.535749 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.536627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.536909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.537193 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.543168 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.543450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.544702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.544986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.547911 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.548217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.548499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.548776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.549048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.549321 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.549484 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.549569 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.549769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.549854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.550058 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.550347 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.550619 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.550889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.551156 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.551423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.568946 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.569222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.571266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.571543 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.574381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.576172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.578035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.578331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.579799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.580122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.583495 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.585312 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.587129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.588964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.590812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.591108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.591401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.591701 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.591978 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.592281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.592640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.592940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.593222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.593512 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.593804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.594081 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.611808 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.612115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.612382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.612643 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.613817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.614103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.614368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.614640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.621091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.622797 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.623072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.623157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.624884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.625161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.626275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.626554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.626835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.627115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.627445 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.628382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.628664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.628946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.629225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.629502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.640784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.641062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.641342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.641631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.641921 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.642203 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.642476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.642845 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.643126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.643417 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.643697 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.643978 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.644302 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.644575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.661827 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.664610 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.665665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.667881 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.668980 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.670583 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.671245 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.672372 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.672652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.672903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.672988 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.674681 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.674962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.675252 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.680878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.683756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.684128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.685763 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.687090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.687378 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.687659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.687940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.689018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.689311 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.689597 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.689872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.697728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.698013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.698289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.699665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.699955 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.700261 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.706186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.706468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.706748 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.707023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.707292 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.707569 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.707840 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.708156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.708536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.708621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:03:33.708809 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.708891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.709081 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.709164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.709346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.709430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.709620 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.709703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.709886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.709976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.710199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.711010 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.711385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.711661 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.711934 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.712225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.712513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.712789 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:03:33.748174 dv-cinder-849800-1-smb devstack@keystone.service[80502]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a28e7c89c0 pid: 80502 (default app) Jul 14 10:03:33.750656 dv-cinder-849800-1-smb devstack@keystone.service[80503]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a28e7c89c0 pid: 80503 (default app) Jul 14 10:03:33.751554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809d76e-7db2-4bf0-9e14-1ee2d0f76c0d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:33.751847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809d76e-7db2-4bf0-9e14-1ee2d0f76c0d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:33.752173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809d76e-7db2-4bf0-9e14-1ee2d0f76c0d None None] PATH_INFO: `/v3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:33.756373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1/1] 10.222.0.74 () {50 vars in 791 bytes} [Thu Jul 14 10:03:33 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:03:42.157410 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fa285-f50f-4d87-a9dc-2508f499785c None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:42.157930 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fa285-f50f-4d87-a9dc-2508f499785c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:42.158023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fa285-f50f-4d87-a9dc-2508f499785c None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:42.162292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1/2] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:03:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:03:42.167915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba239-e4ce-44cb-b7e9-aca97dd63b57 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:42.168367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba239-e4ce-44cb-b7e9-aca97dd63b57 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:42.168505 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba239-e4ce-44cb-b7e9-aca97dd63b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:42.237699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: INFO dbcounter [None req-f65ba239-e4ce-44cb-b7e9-aca97dd63b57 None None] Registered counter for database keystone Jul 14 10:03:42.259191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG oslo_db.sqlalchemy.engines [None req-f65ba239-e4ce-44cb-b7e9-aca97dd63b57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:03:42.266283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writer thread running {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:03:42.444585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG passlib.handlers.bcrypt [None req-f65ba239-e4ce-44cb-b7e9-aca97dd63b57 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80502) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 10:03:42.445007 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG passlib.handlers.bcrypt [None req-f65ba239-e4ce-44cb-b7e9-aca97dd63b57 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80502) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 10:03:42.499369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f65ba239-e4ce-44cb-b7e9-aca97dd63b57 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:03:42.501028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f65ba239-e4ce-44cb-b7e9-aca97dd63b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:03:42.623511 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 2/3] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:03:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 10:03:42.790543 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fa285-f50f-4d87-a9dc-2508f499785c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:42.859472 dv-cinder-849800-1-smb devstack@keystone.service[80503]: INFO dbcounter [None req-433fa285-f50f-4d87-a9dc-2508f499785c None None] Registered counter for database keystone Jul 14 10:03:42.878409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG oslo_db.sqlalchemy.engines [None req-433fa285-f50f-4d87-a9dc-2508f499785c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:03:42.884554 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writer thread running {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:03:43.003769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fa285-f50f-4d87-a9dc-2508f499785c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:43.008113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba2891-5546-4226-9af6-359792667ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:43.008775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2891-5546-4226-9af6-359792667ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:43.009062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2891-5546-4226-9af6-359792667ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:43.009338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2891-5546-4226-9af6-359792667ee5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:43.018087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba2891-5546-4226-9af6-359792667ee5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:43.070025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c4ba2891-5546-4226-9af6-359792667ee5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 10:03:43.070376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba2891-5546-4226-9af6-359792667ee5 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:43.081160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 2/4] 10.222.0.74 () {58 vars in 1324 bytes} [Thu Jul 14 10:03:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:03:43.087222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ba239-e4ce-44cb-b7e9-aca97dd63b57 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:43.101671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ba239-e4ce-44cb-b7e9-aca97dd63b57 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:43.106204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f45d8-dbf8-4f8e-80cf-66aedc0b4b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:43.107317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f45d8-dbf8-4f8e-80cf-66aedc0b4b7a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:43.107613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f45d8-dbf8-4f8e-80cf-66aedc0b4b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:43.107891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f45d8-dbf8-4f8e-80cf-66aedc0b4b7a admin admin] PATH_INFO: `/v3/projects/749adf9dd9f744529e5dfac400623e53` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:43.112011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f45d8-dbf8-4f8e-80cf-66aedc0b4b7a admin admin] RBAC: Authorizing `identity:get_project(project_id=749adf9dd9f744529e5dfac400623e53)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:43.164790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: WARNING keystone.common.rbac_enforcer.enforcer [None req-138f45d8-dbf8-4f8e-80cf-66aedc0b4b7a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 10:03:43.165132 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f45d8-dbf8-4f8e-80cf-66aedc0b4b7a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:43.169777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 3/5] 10.222.0.74 () {56 vars in 1207 bytes} [Thu Jul 14 10:03:43 2022] GET /identity/v3/projects/749adf9dd9f744529e5dfac400623e53 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:03:45.158176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109afd2a-1cd4-4e77-954b-d90f3c437d0a None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:45.158693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109afd2a-1cd4-4e77-954b-d90f3c437d0a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:45.158786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109afd2a-1cd4-4e77-954b-d90f3c437d0a None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:45.162841 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 3/6] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:03:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:03:45.168302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c016b6-42d7-493c-a83d-90eae4d0b508 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:45.168682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c016b6-42d7-493c-a83d-90eae4d0b508 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:45.168851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c016b6-42d7-493c-a83d-90eae4d0b508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:45.187434 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-11c016b6-42d7-493c-a83d-90eae4d0b508 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:03:45.188997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-11c016b6-42d7-493c-a83d-90eae4d0b508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:03:45.197173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 4/7] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:03:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 10:03:45.220234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109afd2a-1cd4-4e77-954b-d90f3c437d0a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:45.232379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109afd2a-1cd4-4e77-954b-d90f3c437d0a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:45.236544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd94c4-1547-455d-a569-b556daedbc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:45.237173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd94c4-1547-455d-a569-b556daedbc14 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:45.237459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd94c4-1547-455d-a569-b556daedbc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:45.237743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd94c4-1547-455d-a569-b556daedbc14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:45.246001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd94c4-1547-455d-a569-b556daedbc14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:45.247769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd94c4-1547-455d-a569-b556daedbc14 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:45.256516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 4/8] 10.222.0.74 () {58 vars in 1324 bytes} [Thu Jul 14 10:03:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:03:45.262427 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c016b6-42d7-493c-a83d-90eae4d0b508 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:45.271203 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c016b6-42d7-493c-a83d-90eae4d0b508 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:45.275539 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf73ce9-ef7c-48b9-9caa-7b80871a7e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:45.276436 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf73ce9-ef7c-48b9-9caa-7b80871a7e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:45.276718 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf73ce9-ef7c-48b9-9caa-7b80871a7e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:45.276989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf73ce9-ef7c-48b9-9caa-7b80871a7e5d admin admin] PATH_INFO: `/v3/users/6a85b2f060664557b1c1e38cb4a7b74d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:45.278352 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf73ce9-ef7c-48b9-9caa-7b80871a7e5d admin admin] RBAC: Authorizing `identity:get_user(user_id=6a85b2f060664557b1c1e38cb4a7b74d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:45.280456 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf73ce9-ef7c-48b9-9caa-7b80871a7e5d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:45.281996 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 5/9] 10.222.0.74 () {56 vars in 1198 bytes} [Thu Jul 14 10:03:45 2022] GET /identity/v3/users/6a85b2f060664557b1c1e38cb4a7b74d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:03:47.350566 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ffbc6-d2d8-41ff-9fe1-b7bf190d8779 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:47.351080 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ffbc6-d2d8-41ff-9fe1-b7bf190d8779 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:47.351172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ffbc6-d2d8-41ff-9fe1-b7bf190d8779 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:47.352512 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 5/10] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:03:47.357563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b02d5f-c5fa-41e0-a5fc-fe5725ab6a3f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:47.357970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b02d5f-c5fa-41e0-a5fc-fe5725ab6a3f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:47.358128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b02d5f-c5fa-41e0-a5fc-fe5725ab6a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:47.374501 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-50b02d5f-c5fa-41e0-a5fc-fe5725ab6a3f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:03:47.375680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-50b02d5f-c5fa-41e0-a5fc-fe5725ab6a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:03:47.385068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d848a5c-5e18-435c-bb54-f1e5c88087d9 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:47.385360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d848a5c-5e18-435c-bb54-f1e5c88087d9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:47.385643 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d848a5c-5e18-435c-bb54-f1e5c88087d9 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:47.387511 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 6/11] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:03:47.392454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef35ff-885e-41f4-9e8e-1838e5f2cd5f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:47.392821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef35ff-885e-41f4-9e8e-1838e5f2cd5f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:47.393110 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef35ff-885e-41f4-9e8e-1838e5f2cd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:47.434259 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG passlib.handlers.bcrypt [None req-0bef35ff-885e-41f4-9e8e-1838e5f2cd5f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80503) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 10:03:47.435184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG passlib.handlers.bcrypt [None req-0bef35ff-885e-41f4-9e8e-1838e5f2cd5f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80503) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 10:03:47.472371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 6/12] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:03:47.483428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b02d5f-c5fa-41e0-a5fc-fe5725ab6a3f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:47.486139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0bef35ff-885e-41f4-9e8e-1838e5f2cd5f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:03:47.487768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0bef35ff-885e-41f4-9e8e-1838e5f2cd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:03:47.510420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:47.592661 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 7/13] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:03:47.600349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b02d5f-c5fa-41e0-a5fc-fe5725ab6a3f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:47.614188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef35ff-885e-41f4-9e8e-1838e5f2cd5f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:47.639315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a58fab-d217-4cc7-967f-793c0bf7bcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:47.640166 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a58fab-d217-4cc7-967f-793c0bf7bcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:47.640457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a58fab-d217-4cc7-967f-793c0bf7bcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:47.640737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a58fab-d217-4cc7-967f-793c0bf7bcb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:47.653723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a58fab-d217-4cc7-967f-793c0bf7bcb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-b9a58fab-d217-4cc7-967f-793c0bf7bcb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:03:47.665417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:03:47.666368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:03:47.672412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:03:47.672412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:03:47.672412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:03:47.672412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:03:47.672412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:03:47.672412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:03:47.672412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:03:47.672412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:03:47.672412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:03:47.672412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:03:47.672412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:03:47.672412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:03:47.672412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 7/14] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:03:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:03:47.673513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a58fab-d217-4cc7-967f-793c0bf7bcb7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:47.720165 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef35ff-885e-41f4-9e8e-1838e5f2cd5f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:47.722459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:47.758230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960282a-b494-4217-bae8-839954f67a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:47.759138 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960282a-b494-4217-bae8-839954f67a58 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:47.759434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960282a-b494-4217-bae8-839954f67a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:47.759718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960282a-b494-4217-bae8-839954f67a58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:47.764593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:47.782560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a58fab-d217-4cc7-967f-793c0bf7bcb7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:47.818328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a23932-3724-44cc-8296-f109a83765ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:47.819011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a23932-3724-44cc-8296-f109a83765ba None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:47.819296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a23932-3724-44cc-8296-f109a83765ba None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:47.819575 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a23932-3724-44cc-8296-f109a83765ba None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:47.820357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a23932-3724-44cc-8296-f109a83765ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:03:47.820666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a23932-3724-44cc-8296-f109a83765ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:47.822086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a23932-3724-44cc-8296-f109a83765ba None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:47.829238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960282a-b494-4217-bae8-839954f67a58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:47.830748 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960282a-b494-4217-bae8-839954f67a58 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:47.834594 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 8/15] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:03:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:03:47.840159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a23932-3724-44cc-8296-f109a83765ba None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:47.929854 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 8/16] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:03:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:03:47.935962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960282a-b494-4217-bae8-839954f67a58 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:47.938552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a23932-3724-44cc-8296-f109a83765ba None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:47.938741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:47.973155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4104963-75d6-45f6-ac2b-b2b86f37f621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:47.974034 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4104963-75d6-45f6-ac2b-b2b86f37f621 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:47.974323 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4104963-75d6-45f6-ac2b-b2b86f37f621 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:47.974594 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4104963-75d6-45f6-ac2b-b2b86f37f621 None admin] PATH_INFO: `/v3/users/6a85b2f060664557b1c1e38cb4a7b74d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:47.975800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4104963-75d6-45f6-ac2b-b2b86f37f621 None admin] RBAC: Authorizing `identity:get_user(user_id=6a85b2f060664557b1c1e38cb4a7b74d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:47.977303 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4104963-75d6-45f6-ac2b-b2b86f37f621 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:47.979139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 9/17] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:03:47 2022] GET /identity/v3/users/6a85b2f060664557b1c1e38cb4a7b74d => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:03:47.984801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4104963-75d6-45f6-ac2b-b2b86f37f621 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:47.999281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:48.033751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960282a-b494-4217-bae8-839954f67a58 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:48.072683 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38726a-8edc-41e8-8a4b-b18b85aa2503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:48.073480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38726a-8edc-41e8-8a4b-b18b85aa2503 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:48.073757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38726a-8edc-41e8-8a4b-b18b85aa2503 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:48.074029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38726a-8edc-41e8-8a4b-b18b85aa2503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:48.083863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4104963-75d6-45f6-ac2b-b2b86f37f621 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:48.093385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38726a-8edc-41e8-8a4b-b18b85aa2503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:48.094850 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38726a-8edc-41e8-8a4b-b18b85aa2503 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-5b38726a-8edc-41e8-8a4b-b18b85aa2503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:03:48.115645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:03:48.116679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:03:48.117702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:03:48.117702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:03:48.117702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:03:48.117702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:03:48.117702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 9/18] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:03:48.121125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f94b57-c1ee-4b07-bf5d-185a982b72f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:48.121893 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94b57-c1ee-4b07-bf5d-185a982b72f5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:48.122178 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94b57-c1ee-4b07-bf5d-185a982b72f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:48.122450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94b57-c1ee-4b07-bf5d-185a982b72f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:48.123344 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38726a-8edc-41e8-8a4b-b18b85aa2503 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:48.123630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f94b57-c1ee-4b07-bf5d-185a982b72f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:48.125123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f94b57-c1ee-4b07-bf5d-185a982b72f5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:48.126845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 10/19] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:03:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:03:48.132293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f94b57-c1ee-4b07-bf5d-185a982b72f5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:48.180041 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:48.210352 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:48.224729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38726a-8edc-41e8-8a4b-b18b85aa2503 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:48.230555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f94b57-c1ee-4b07-bf5d-185a982b72f5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:48.258671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdb0c5-3b2a-456f-b80c-a9876b9410a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:48.259338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdb0c5-3b2a-456f-b80c-a9876b9410a0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:48.259624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdb0c5-3b2a-456f-b80c-a9876b9410a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:48.259904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdb0c5-3b2a-456f-b80c-a9876b9410a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:48.260662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdb0c5-3b2a-456f-b80c-a9876b9410a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:03:48.260972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdb0c5-3b2a-456f-b80c-a9876b9410a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:48.262390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdb0c5-3b2a-456f-b80c-a9876b9410a0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:48.263713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829c7b2-f5b1-4566-8562-a5f8ff8dcd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:48.264398 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829c7b2-f5b1-4566-8562-a5f8ff8dcd2a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:48.264679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829c7b2-f5b1-4566-8562-a5f8ff8dcd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:48.264946 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829c7b2-f5b1-4566-8562-a5f8ff8dcd2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:48.265769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829c7b2-f5b1-4566-8562-a5f8ff8dcd2a None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.domain.id=default, user.id=6a85b2f060664557b1c1e38cb4a7b74d) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:03:48.266073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829c7b2-f5b1-4566-8562-a5f8ff8dcd2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:48.267485 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829c7b2-f5b1-4566-8562-a5f8ff8dcd2a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:48.274261 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 11/20] 10.222.0.74 () {56 vars in 1322 bytes} [Thu Jul 14 10:03:48 2022] GET /identity/v3/role_assignments?user.id=6a85b2f060664557b1c1e38cb4a7b74d&scope.domain.id=default&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:03:48.280906 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 10/21] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:03:50.631749 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb8c46-dda9-4428-a8e8-2e848a719ad6 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:50.632292 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb8c46-dda9-4428-a8e8-2e848a719ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:50.632368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb8c46-dda9-4428-a8e8-2e848a719ad6 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:50.633685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 12/22] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:03:50.639771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627fb95-d3af-4235-8803-3af6ea44d3f8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:50.640257 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627fb95-d3af-4235-8803-3af6ea44d3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:50.640438 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627fb95-d3af-4235-8803-3af6ea44d3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:50.661428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a627fb95-d3af-4235-8803-3af6ea44d3f8 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:03:50.662647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a627fb95-d3af-4235-8803-3af6ea44d3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:03:50.747299 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 11/23] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:03:50.785523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb8c46-dda9-4428-a8e8-2e848a719ad6 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:50.834056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca8d55-e044-44ca-8181-73b1692b0317 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:50.834400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca8d55-e044-44ca-8181-73b1692b0317 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:50.834644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca8d55-e044-44ca-8181-73b1692b0317 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:50.836330 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 12/24] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:03:50.841846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d82386-2cbf-4618-8064-3bf56fef6f17 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:50.842139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d82386-2cbf-4618-8064-3bf56fef6f17 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:50.842421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d82386-2cbf-4618-8064-3bf56fef6f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:50.877934 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-13d82386-2cbf-4618-8064-3bf56fef6f17 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:03:50.879148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-13d82386-2cbf-4618-8064-3bf56fef6f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:03:50.966878 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:51.010354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 13/25] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:03:51.014973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0a6c1-5ab8-49f1-84ca-f06a403b44d2 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:51.015266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0a6c1-5ab8-49f1-84ca-f06a403b44d2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:51.015543 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0a6c1-5ab8-49f1-84ca-f06a403b44d2 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:51.017113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 14/26] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:03:51.021863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb8c46-dda9-4428-a8e8-2e848a719ad6 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:51.024600 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a8493-df5f-443f-9629-d3d00464ff93 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:51.024887 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a8493-df5f-443f-9629-d3d00464ff93 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:51.025169 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a8493-df5f-443f-9629-d3d00464ff93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:51.061848 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-224a8493-df5f-443f-9629-d3d00464ff93 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:03:51.063286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-224a8493-df5f-443f-9629-d3d00464ff93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:03:51.077285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9543e5f-343d-46da-8f85-cf2cf6d7a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:51.078089 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9543e5f-343d-46da-8f85-cf2cf6d7a16c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:51.078370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9543e5f-343d-46da-8f85-cf2cf6d7a16c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:51.078641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9543e5f-343d-46da-8f85-cf2cf6d7a16c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:51.102713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9543e5f-343d-46da-8f85-cf2cf6d7a16c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-b9543e5f-343d-46da-8f85-cf2cf6d7a16c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:03:51.114837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:03:51.115699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:03:51.116525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:03:51.116525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:03:51.116525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:03:51.116525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:03:51.116525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:03:51.116525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:03:51.116525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:03:51.116525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:03:51.116525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:03:51.116525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:03:51.116525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:03:51.116525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:03:51.124354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 13/27] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:03:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:03:51.125156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9543e5f-343d-46da-8f85-cf2cf6d7a16c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:51.132306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:51.195125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 15/28] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:03:51.196355 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a8493-df5f-443f-9629-d3d00464ff93 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:51.276531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9543e5f-343d-46da-8f85-cf2cf6d7a16c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:51.316737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e14814-4bf3-4575-85ad-c5fa0518f1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:51.317638 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e14814-4bf3-4575-85ad-c5fa0518f1e6 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:51.318061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e14814-4bf3-4575-85ad-c5fa0518f1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:51.318495 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e14814-4bf3-4575-85ad-c5fa0518f1e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:51.319403 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e14814-4bf3-4575-85ad-c5fa0518f1e6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:51.320960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e14814-4bf3-4575-85ad-c5fa0518f1e6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:51.336485 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a8493-df5f-443f-9629-d3d00464ff93 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:51.345246 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:51.374436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4410071-e2be-4042-88d5-45edaf7d5223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:51.375118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4410071-e2be-4042-88d5-45edaf7d5223 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:51.375403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4410071-e2be-4042-88d5-45edaf7d5223 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:51.375681 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4410071-e2be-4042-88d5-45edaf7d5223 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:51.376584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4410071-e2be-4042-88d5-45edaf7d5223 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:03:51.376893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4410071-e2be-4042-88d5-45edaf7d5223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:51.378293 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4410071-e2be-4042-88d5-45edaf7d5223 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:51.396130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 16/29] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:03:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:03:51.396130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf643e-6af2-461f-881e-d87032d6e40b None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:51.396130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf643e-6af2-461f-881e-d87032d6e40b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:51.396130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf643e-6af2-461f-881e-d87032d6e40b None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:51.396130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 17/30] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:03:51.396538 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf643e-6af2-461f-881e-d87032d6e40b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:51.512241 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf643e-6af2-461f-881e-d87032d6e40b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:51.551630 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aa13e-492a-426f-a959-de2abb67b422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:51.552651 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aa13e-492a-426f-a959-de2abb67b422 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:51.553124 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aa13e-492a-426f-a959-de2abb67b422 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:51.553849 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aa13e-492a-426f-a959-de2abb67b422 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:51.554748 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0aa13e-492a-426f-a959-de2abb67b422 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:51.556290 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0aa13e-492a-426f-a959-de2abb67b422 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:51.565755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 14/31] 10.222.0.74 () {60 vars in 1131 bytes} [Thu Jul 14 10:03:51 2022] POST /identity/v3/roles => generated 219 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:03:51.566501 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e14814-4bf3-4575-85ad-c5fa0518f1e6 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:51.648667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:51.693276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e14814-4bf3-4575-85ad-c5fa0518f1e6 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:51.743269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dab01d-144b-474f-8591-ce88d23f9771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:51.744301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dab01d-144b-474f-8591-ce88d23f9771 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:51.744591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dab01d-144b-474f-8591-ce88d23f9771 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:51.744874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dab01d-144b-474f-8591-ce88d23f9771 None admin] PATH_INFO: `/v3/users/6a85b2f060664557b1c1e38cb4a7b74d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:51.747860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dab01d-144b-474f-8591-ce88d23f9771 None admin] RBAC: Authorizing `identity:get_user(user_id=6a85b2f060664557b1c1e38cb4a7b74d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:51.749525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dab01d-144b-474f-8591-ce88d23f9771 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:51.751216 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 15/32] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:03:51 2022] GET /identity/v3/users/6a85b2f060664557b1c1e38cb4a7b74d => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:03:51.754828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b265c-57a3-4055-9864-08a69f2901bd None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:51.756443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b265c-57a3-4055-9864-08a69f2901bd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:51.756749 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b265c-57a3-4055-9864-08a69f2901bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:51.787251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7e0b265c-57a3-4055-9864-08a69f2901bd None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:03:51.790971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7e0b265c-57a3-4055-9864-08a69f2901bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:03:51.864493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 18/33] 10.222.0.74 () {60 vars in 1131 bytes} [Thu Jul 14 10:03:51 2022] POST /identity/v3/roles => generated 225 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:03:51.865399 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aa13e-492a-426f-a959-de2abb67b422 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:51.893506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 16/34] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:03:51.895290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff506ed-23c6-4ee4-b492-ec8de2c42247 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:51.895808 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff506ed-23c6-4ee4-b492-ec8de2c42247 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:51.896367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff506ed-23c6-4ee4-b492-ec8de2c42247 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:51.898148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 17/35] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:03:51.904324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8f04-4f87-433a-be68-5edaf2d7d677 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:51.904896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8f04-4f87-433a-be68-5edaf2d7d677 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:51.905373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8f04-4f87-433a-be68-5edaf2d7d677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:51.916271 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:51.930657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e79a8f04-4f87-433a-be68-5edaf2d7d677 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:03:51.932216 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e79a8f04-4f87-433a-be68-5edaf2d7d677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:03:52.009705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:52.023478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 18/36] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:03:52.024926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8f04-4f87-433a-be68-5edaf2d7d677 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:52.032183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aa13e-492a-426f-a959-de2abb67b422 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:52.083155 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccee4e-1709-4407-971e-2c22feea1d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:52.083976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccee4e-1709-4407-971e-2c22feea1d54 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:52.084388 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccee4e-1709-4407-971e-2c22feea1d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:52.084661 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccee4e-1709-4407-971e-2c22feea1d54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:52.086221 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccee4e-1709-4407-971e-2c22feea1d54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:52.087879 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccee4e-1709-4407-971e-2c22feea1d54 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:52.089770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 19/37] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:03:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:03:52.090932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccee4e-1709-4407-971e-2c22feea1d54 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:52.158542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8f04-4f87-433a-be68-5edaf2d7d677 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:52.195466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bede5-d7b5-4a39-98a6-588eec5c97b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:52.195659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:52.196442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bede5-d7b5-4a39-98a6-588eec5c97b5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:52.196605 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bede5-d7b5-4a39-98a6-588eec5c97b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:52.196885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bede5-d7b5-4a39-98a6-588eec5c97b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:52.202547 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccee4e-1709-4407-971e-2c22feea1d54 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:52.209807 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bede5-d7b5-4a39-98a6-588eec5c97b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:52.211319 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bede5-d7b5-4a39-98a6-588eec5c97b5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-e57bede5-d7b5-4a39-98a6-588eec5c97b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:03:52.231613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:03:52.232659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:03:52.233462 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:03:52.233462 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:03:52.233462 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:03:52.233462 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:03:52.233462 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 19/38] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:03:52.233721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bede5-d7b5-4a39-98a6-588eec5c97b5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:52.244188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f0c3d-3440-4a8e-96eb-cbeeb39a9ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:52.244876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0c3d-3440-4a8e-96eb-cbeeb39a9ed6 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:52.245222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0c3d-3440-4a8e-96eb-cbeeb39a9ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:52.245512 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0c3d-3440-4a8e-96eb-cbeeb39a9ed6 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:52.246275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f0c3d-3440-4a8e-96eb-cbeeb39a9ed6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:52.247789 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f0c3d-3440-4a8e-96eb-cbeeb39a9ed6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:52.282971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:52.318219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 20/39] 10.222.0.74 () {60 vars in 1131 bytes} [Thu Jul 14 10:03:52 2022] POST /identity/v3/roles => generated 223 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:03:52.325137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f0c3d-3440-4a8e-96eb-cbeeb39a9ed6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:52.344938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bede5-d7b5-4a39-98a6-588eec5c97b5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:52.389388 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434478-aa63-475d-819f-15836559e99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:52.390285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434478-aa63-475d-819f-15836559e99f None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:52.390568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434478-aa63-475d-819f-15836559e99f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:52.390844 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434478-aa63-475d-819f-15836559e99f None admin] PATH_INFO: `/v3/domains/default/users/6a85b2f060664557b1c1e38cb4a7b74d/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:52.393278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95434478-aa63-475d-819f-15836559e99f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6a85b2f060664557b1c1e38cb4a7b74d, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:52.394799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95434478-aa63-475d-819f-15836559e99f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:52.439850 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f0c3d-3440-4a8e-96eb-cbeeb39a9ed6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:52.455235 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 20/40] 10.222.0.74 () {58 vars in 1361 bytes} [Thu Jul 14 10:03:52 2022] PUT /identity/v3/domains/default/users/6a85b2f060664557b1c1e38cb4a7b74d/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:03:52.457079 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c16cf-371b-41e2-b1b8-4a6b30911bd4 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:52.457446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c16cf-371b-41e2-b1b8-4a6b30911bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:52.457793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c16cf-371b-41e2-b1b8-4a6b30911bd4 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:52.459592 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 21/41] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:03:52.467080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e10f2-cfd1-434e-a74a-c6b283d6a4bd None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:52.467373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e10f2-cfd1-434e-a74a-c6b283d6a4bd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:52.467651 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e10f2-cfd1-434e-a74a-c6b283d6a4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:52.486367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-092e10f2-cfd1-434e-a74a-c6b283d6a4bd None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:03:52.487644 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-092e10f2-cfd1-434e-a74a-c6b283d6a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:03:52.489902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab97b73-033f-4b34-b2fd-24c25b3dba2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:52.490597 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab97b73-033f-4b34-b2fd-24c25b3dba2b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:52.490889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab97b73-033f-4b34-b2fd-24c25b3dba2b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:52.491188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab97b73-033f-4b34-b2fd-24c25b3dba2b None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:52.491957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab97b73-033f-4b34-b2fd-24c25b3dba2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:03:52.492313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab97b73-033f-4b34-b2fd-24c25b3dba2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:52.493766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab97b73-033f-4b34-b2fd-24c25b3dba2b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:52.507571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 21/42] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:03:52.514451 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab97b73-033f-4b34-b2fd-24c25b3dba2b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:52.538747 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:52.587420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 22/43] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:03:52.613393 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e10f2-cfd1-434e-a74a-c6b283d6a4bd None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:52.652475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:52.657352 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab97b73-033f-4b34-b2fd-24c25b3dba2b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:52.695335 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9c225-fc21-4963-aba7-c8f8d057b03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:52.695943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9c225-fc21-4963-aba7-c8f8d057b03f None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:52.696291 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9c225-fc21-4963-aba7-c8f8d057b03f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:52.696577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9c225-fc21-4963-aba7-c8f8d057b03f None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:52.697485 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9c225-fc21-4963-aba7-c8f8d057b03f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:52.698997 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9c225-fc21-4963-aba7-c8f8d057b03f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:52.828711 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 22/44] 10.222.0.74 () {60 vars in 1141 bytes} [Thu Jul 14 10:03:52 2022] POST /identity/v3/projects => generated 301 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:03:52.830102 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e10f2-cfd1-434e-a74a-c6b283d6a4bd None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:52.873299 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef2ef7-6359-4845-aaaa-7c0ae19a6060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:52.874121 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2ef7-6359-4845-aaaa-7c0ae19a6060 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:52.874409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2ef7-6359-4845-aaaa-7c0ae19a6060 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:52.874685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2ef7-6359-4845-aaaa-7c0ae19a6060 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:52.875923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef2ef7-6359-4845-aaaa-7c0ae19a6060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:52.877615 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef2ef7-6359-4845-aaaa-7c0ae19a6060 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:52.879543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 23/45] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:03:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:03:52.885355 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9c225-fc21-4963-aba7-c8f8d057b03f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:52.960166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:52.999082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9c225-fc21-4963-aba7-c8f8d057b03f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:53.037021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82461d-fb24-4153-b1a3-c92733014917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:53.037698 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82461d-fb24-4153-b1a3-c92733014917 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:53.038113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82461d-fb24-4153-b1a3-c92733014917 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:53.038284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82461d-fb24-4153-b1a3-c92733014917 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:53.038976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82461d-fb24-4153-b1a3-c92733014917 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:53.040483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82461d-fb24-4153-b1a3-c92733014917 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:53.107750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 23/46] 10.222.0.74 () {60 vars in 1141 bytes} [Thu Jul 14 10:03:52 2022] POST /identity/v3/projects => generated 312 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:03:54.515862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc67604-3ab9-4444-b435-2d29e341d91a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:54.516436 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc67604-3ab9-4444-b435-2d29e341d91a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:54.516436 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc67604-3ab9-4444-b435-2d29e341d91a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:54.517828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 24/47] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:03:54.523266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdee2e-a947-45be-9927-c6c6f83a070f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:54.523649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdee2e-a947-45be-9927-c6c6f83a070f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:54.523942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdee2e-a947-45be-9927-c6c6f83a070f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:54.540813 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-76bdee2e-a947-45be-9927-c6c6f83a070f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:03:54.542311 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-76bdee2e-a947-45be-9927-c6c6f83a070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:03:54.609973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 24/48] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:03:54.633253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc67604-3ab9-4444-b435-2d29e341d91a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:54.732081 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc67604-3ab9-4444-b435-2d29e341d91a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:54.733598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:54.765666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fd2d3-3bf2-47a6-ad37-6098e13127b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:54.766516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fd2d3-3bf2-47a6-ad37-6098e13127b8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:54.766744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fd2d3-3bf2-47a6-ad37-6098e13127b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:54.767017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fd2d3-3bf2-47a6-ad37-6098e13127b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:54.777394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fd2d3-3bf2-47a6-ad37-6098e13127b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-af7fd2d3-3bf2-47a6-ad37-6098e13127b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:03:54.785333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:03:54.786189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:03:54.786964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:03:54.786964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:03:54.786964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:03:54.786964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:03:54.786964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:03:54.786964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:03:54.786964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:03:54.786964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:03:54.786964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:03:54.786964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:03:54.786964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:03:54.786964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:03:54.786964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 25/49] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:03:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:03:54.792529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdee2e-a947-45be-9927-c6c6f83a070f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:54.842474 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:54.891675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdee2e-a947-45be-9927-c6c6f83a070f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:54.926550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df6e2-6a45-4a2b-9173-b74f71a3eff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:54.927221 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df6e2-6a45-4a2b-9173-b74f71a3eff2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:54.927508 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df6e2-6a45-4a2b-9173-b74f71a3eff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:54.927789 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df6e2-6a45-4a2b-9173-b74f71a3eff2 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:54.928571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100df6e2-6a45-4a2b-9173-b74f71a3eff2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:03:54.928885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100df6e2-6a45-4a2b-9173-b74f71a3eff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:54.930271 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100df6e2-6a45-4a2b-9173-b74f71a3eff2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:54.938322 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 25/50] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:03:54.943873 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fd2d3-3bf2-47a6-ad37-6098e13127b8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:55.043448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fd2d3-3bf2-47a6-ad37-6098e13127b8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:55.078379 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1618e7-2aa3-40a8-932d-2dbfc3c294c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:55.079265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1618e7-2aa3-40a8-932d-2dbfc3c294c5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:55.079550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1618e7-2aa3-40a8-932d-2dbfc3c294c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:55.079826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1618e7-2aa3-40a8-932d-2dbfc3c294c5 None admin] PATH_INFO: `/v3/users/6a85b2f060664557b1c1e38cb4a7b74d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:55.081058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1618e7-2aa3-40a8-932d-2dbfc3c294c5 None admin] RBAC: Authorizing `identity:get_user(user_id=6a85b2f060664557b1c1e38cb4a7b74d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:55.082510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1618e7-2aa3-40a8-932d-2dbfc3c294c5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:55.084397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 26/51] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:03:54 2022] GET /identity/v3/users/6a85b2f060664557b1c1e38cb4a7b74d => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:03:55.089601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df6e2-6a45-4a2b-9173-b74f71a3eff2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:55.141878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b210-7866-4b51-9fc6-00cfc1d36a58 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:55.142165 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b210-7866-4b51-9fc6-00cfc1d36a58 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:55.142453 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b210-7866-4b51-9fc6-00cfc1d36a58 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:55.143871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 27/52] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:03:55.149761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09cf9e-7d81-4a90-9b56-26dfcee17f7d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:55.150054 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09cf9e-7d81-4a90-9b56-26dfcee17f7d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:55.150335 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09cf9e-7d81-4a90-9b56-26dfcee17f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:55.168218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2b09cf9e-7d81-4a90-9b56-26dfcee17f7d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:03:55.169470 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2b09cf9e-7d81-4a90-9b56-26dfcee17f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:03:55.195126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:55.239446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 28/53] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:03:55.263472 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09cf9e-7d81-4a90-9b56-26dfcee17f7d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:55.295109 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df6e2-6a45-4a2b-9173-b74f71a3eff2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:55.307360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:55.329601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318f59b-cfc7-4ef8-96d8-93dcd6c5e372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:55.330401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318f59b-cfc7-4ef8-96d8-93dcd6c5e372 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:55.330690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318f59b-cfc7-4ef8-96d8-93dcd6c5e372 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:55.330970 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318f59b-cfc7-4ef8-96d8-93dcd6c5e372 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:55.332304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318f59b-cfc7-4ef8-96d8-93dcd6c5e372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:55.333825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318f59b-cfc7-4ef8-96d8-93dcd6c5e372 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:55.336053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 26/54] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:03:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:03:55.341127 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318f59b-cfc7-4ef8-96d8-93dcd6c5e372 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:55.361935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09cf9e-7d81-4a90-9b56-26dfcee17f7d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:55.394993 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4256ae-a175-41d6-bdd9-6b38c706ccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:55.395785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4256ae-a175-41d6-bdd9-6b38c706ccd4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:55.396097 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4256ae-a175-41d6-bdd9-6b38c706ccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:55.396375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4256ae-a175-41d6-bdd9-6b38c706ccd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:55.397560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4256ae-a175-41d6-bdd9-6b38c706ccd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:55.398995 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4256ae-a175-41d6-bdd9-6b38c706ccd4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:55.400648 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 29/55] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:03:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:03:55.406822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4256ae-a175-41d6-bdd9-6b38c706ccd4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:55.434388 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:55.441418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318f59b-cfc7-4ef8-96d8-93dcd6c5e372 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:55.474251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31facc0-cc05-429b-8557-18421e1a99ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:55.474907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31facc0-cc05-429b-8557-18421e1a99ea None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:55.475196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31facc0-cc05-429b-8557-18421e1a99ea None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:55.475477 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31facc0-cc05-429b-8557-18421e1a99ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:55.476346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31facc0-cc05-429b-8557-18421e1a99ea None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.domain.id=default, user.id=6a85b2f060664557b1c1e38cb4a7b74d) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:03:55.476659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31facc0-cc05-429b-8557-18421e1a99ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:55.478102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31facc0-cc05-429b-8557-18421e1a99ea None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:55.487750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 27/56] 10.222.0.74 () {56 vars in 1322 bytes} [Thu Jul 14 10:03:55 2022] GET /identity/v3/role_assignments?user.id=6a85b2f060664557b1c1e38cb4a7b74d&scope.domain.id=default&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:03:55.507197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4256ae-a175-41d6-bdd9-6b38c706ccd4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:55.545999 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964bfb-deaa-4a44-9c93-b402c32b0d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:55.546642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964bfb-deaa-4a44-9c93-b402c32b0d16 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:55.546872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964bfb-deaa-4a44-9c93-b402c32b0d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:55.547153 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964bfb-deaa-4a44-9c93-b402c32b0d16 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:55.547889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11964bfb-deaa-4a44-9c93-b402c32b0d16 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:55.549388 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11964bfb-deaa-4a44-9c93-b402c32b0d16 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:55.668185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 30/57] 10.222.0.74 () {60 vars in 1140 bytes} [Thu Jul 14 10:03:55 2022] POST /identity/v3/projects => generated 298 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:03:57.661052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccd662-9b25-4de4-8ece-a2fe0910fe8d None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:57.661562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccd662-9b25-4de4-8ece-a2fe0910fe8d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:57.661647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccd662-9b25-4de4-8ece-a2fe0910fe8d None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:57.663000 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 28/58] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:03:57.668175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed869d1-75bb-4dba-9409-4fae0d28f507 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:57.668598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed869d1-75bb-4dba-9409-4fae0d28f507 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:57.668755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed869d1-75bb-4dba-9409-4fae0d28f507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:57.686223 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0ed869d1-75bb-4dba-9409-4fae0d28f507 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:03:57.687405 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0ed869d1-75bb-4dba-9409-4fae0d28f507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:03:57.751236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 31/59] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:03:57.774859 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccd662-9b25-4de4-8ece-a2fe0910fe8d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:57.822888 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:57.876766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccd662-9b25-4de4-8ece-a2fe0910fe8d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:57.909946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906539b4-e011-4ebf-940f-de7be0e46f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:57.910760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906539b4-e011-4ebf-940f-de7be0e46f73 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:57.911051 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906539b4-e011-4ebf-940f-de7be0e46f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:57.911379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906539b4-e011-4ebf-940f-de7be0e46f73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:57.912537 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906539b4-e011-4ebf-940f-de7be0e46f73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:57.913998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906539b4-e011-4ebf-940f-de7be0e46f73 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:57.915605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 29/60] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:03:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:03:57.921249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed869d1-75bb-4dba-9409-4fae0d28f507 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:57.932556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:58.018715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed869d1-75bb-4dba-9409-4fae0d28f507 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:58.051256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5c381-2e23-4dc0-9034-13f7dbe43d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:58.051927 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5c381-2e23-4dc0-9034-13f7dbe43d44 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:58.052241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5c381-2e23-4dc0-9034-13f7dbe43d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:58.052519 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5c381-2e23-4dc0-9034-13f7dbe43d44 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:58.053236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5c381-2e23-4dc0-9034-13f7dbe43d44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:58.054678 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5c381-2e23-4dc0-9034-13f7dbe43d44 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:58.169883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 32/61] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:03:57 2022] POST /identity/v3/users => generated 275 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:04:01.305503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d17390-333b-4371-8e81-f551159ec631 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:01.305503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d17390-333b-4371-8e81-f551159ec631 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:01.305503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d17390-333b-4371-8e81-f551159ec631 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:01.305503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 30/62] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:01.310737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245c4e2-22c0-4781-878b-924968731489 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:01.311560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245c4e2-22c0-4781-878b-924968731489 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:01.312084 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245c4e2-22c0-4781-878b-924968731489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:01.329444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e245c4e2-22c0-4781-878b-924968731489 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:01.336017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e245c4e2-22c0-4781-878b-924968731489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:01.396338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea467795-53e9-489d-b994-f8ed705c0207 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:01.396951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea467795-53e9-489d-b994-f8ed705c0207 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:01.397448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea467795-53e9-489d-b994-f8ed705c0207 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:01.399011 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 31/63] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:01.403784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af62c3-3b72-4a4a-80be-cfd95152a801 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:01.404896 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af62c3-3b72-4a4a-80be-cfd95152a801 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:01.405375 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af62c3-3b72-4a4a-80be-cfd95152a801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:01.412394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:01.418917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 33/64] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:01.437026 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-55af62c3-3b72-4a4a-80be-cfd95152a801 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:01.445197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-55af62c3-3b72-4a4a-80be-cfd95152a801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:01.445315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245c4e2-22c0-4781-878b-924968731489 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:01.560370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245c4e2-22c0-4781-878b-924968731489 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:01.591431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 32/65] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:01.593603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67c72b-0843-46b6-90f1-2e8a006afbac None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:01.600017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67c72b-0843-46b6-90f1-2e8a006afbac None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:01.600017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67c72b-0843-46b6-90f1-2e8a006afbac None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:01.600017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 33/66] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:01.603088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbebdf5-dcb8-42b7-8237-120a43cc9de2 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:01.603383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbebdf5-dcb8-42b7-8237-120a43cc9de2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:01.603670 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbebdf5-dcb8-42b7-8237-120a43cc9de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:01.604996 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac362c-96a5-4198-882f-8e4c5de7ac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:01.605806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac362c-96a5-4198-882f-8e4c5de7ac61 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:01.606093 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac362c-96a5-4198-882f-8e4c5de7ac61 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:01.606369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac362c-96a5-4198-882f-8e4c5de7ac61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:01.617881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac362c-96a5-4198-882f-8e4c5de7ac61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-2eac362c-96a5-4198-882f-8e4c5de7ac61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:01.625781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:01.626639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:01.627411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:01.627411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:01.627411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:01.627411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:01.627411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:01.627411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:01.627411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:01.627411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:01.627411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:01.627411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:01.627411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:01.627411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:01.627411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 34/67] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:01.628829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba745-81aa-4afb-9dd7-51bf43379fcb None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:01.628829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba745-81aa-4afb-9dd7-51bf43379fcb None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:01.628829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba745-81aa-4afb-9dd7-51bf43379fcb None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:01.629136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0cbebdf5-dcb8-42b7-8237-120a43cc9de2 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:01.630274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 35/68] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:01.630846 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ba745-81aa-4afb-9dd7-51bf43379fcb None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:01.634375 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0cbebdf5-dcb8-42b7-8237-120a43cc9de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:01.673100 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:01.694172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:01.709322 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 34/69] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:01.710919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151dbf9-d8c0-42a2-bcae-deb95c033ac9 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:01.711391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151dbf9-d8c0-42a2-bcae-deb95c033ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:01.711847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151dbf9-d8c0-42a2-bcae-deb95c033ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:01.729111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2151dbf9-d8c0-42a2-bcae-deb95c033ac9 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:01.730610 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2151dbf9-d8c0-42a2-bcae-deb95c033ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:01.753092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ba745-81aa-4afb-9dd7-51bf43379fcb None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:01.791344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f92c5-8514-402e-9939-4e3a2b050827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:01.792186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f92c5-8514-402e-9939-4e3a2b050827 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:01.792629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f92c5-8514-402e-9939-4e3a2b050827 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:01.793082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f92c5-8514-402e-9939-4e3a2b050827 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:01.803485 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f92c5-8514-402e-9939-4e3a2b050827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:01.812133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 35/70] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:01.812133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151dbf9-d8c0-42a2-bcae-deb95c033ac9 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-036f92c5-8514-402e-9939-4e3a2b050827 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:01.812338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:01.813274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:01.814113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:01.814113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:01.814113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:01.814113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:01.814113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:01.814113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:01.814113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:01.814113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:01.814113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:01.814113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:01.814113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:01.814113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:01.814113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 36/71] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:04:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:01.814113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f92c5-8514-402e-9939-4e3a2b050827 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:01.916377 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f92c5-8514-402e-9939-4e3a2b050827 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:01.923130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151dbf9-d8c0-42a2-bcae-deb95c033ac9 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:01.924694 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:01.932691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:01.953091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34c6b6-731c-4923-9cda-c9e0d8cfa6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:01.953914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34c6b6-731c-4923-9cda-c9e0d8cfa6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:01.954226 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34c6b6-731c-4923-9cda-c9e0d8cfa6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:01.954471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34c6b6-731c-4923-9cda-c9e0d8cfa6e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:01.964598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953d82f-c0aa-4230-9ad1-3b56953e2dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:01.965302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34c6b6-731c-4923-9cda-c9e0d8cfa6e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:01.965615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953d82f-c0aa-4230-9ad1-3b56953e2dce None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:01.966047 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953d82f-c0aa-4230-9ad1-3b56953e2dce None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:01.966500 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953d82f-c0aa-4230-9ad1-3b56953e2dce None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:01.967446 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953d82f-c0aa-4230-9ad1-3b56953e2dce None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:01.967949 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953d82f-c0aa-4230-9ad1-3b56953e2dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:01.969539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953d82f-c0aa-4230-9ad1-3b56953e2dce None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-df34c6b6-731c-4923-9cda-c9e0d8cfa6e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:01.973327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:01.974397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:01.975409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:01.975409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:01.975409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:01.975409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:01.975409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:01.975409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:01.975409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:01.975409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:01.975409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:01.975409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:01.975409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:01.975409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:01.979440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 37/72] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:04:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:01.980344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34c6b6-731c-4923-9cda-c9e0d8cfa6e4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:01.981642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 36/73] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:01.982635 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953d82f-c0aa-4230-9ad1-3b56953e2dce None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:02.088755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34c6b6-731c-4923-9cda-c9e0d8cfa6e4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:02.103940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953d82f-c0aa-4230-9ad1-3b56953e2dce None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:02.122689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b567af-79ca-4723-8c78-536909885181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:02.124036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b567af-79ca-4723-8c78-536909885181 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:02.124334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b567af-79ca-4723-8c78-536909885181 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:02.124613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b567af-79ca-4723-8c78-536909885181 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:02.125363 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b567af-79ca-4723-8c78-536909885181 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:02.125674 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b567af-79ca-4723-8c78-536909885181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:02.127151 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b567af-79ca-4723-8c78-536909885181 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:02.139629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 38/74] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:02.139629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b567af-79ca-4723-8c78-536909885181 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:02.141474 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4171fe-8360-4d8f-bf30-04a7389ad369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:02.142278 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4171fe-8360-4d8f-bf30-04a7389ad369 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:02.142567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4171fe-8360-4d8f-bf30-04a7389ad369 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:02.142846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4171fe-8360-4d8f-bf30-04a7389ad369 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:02.154740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4171fe-8360-4d8f-bf30-04a7389ad369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-be4171fe-8360-4d8f-bf30-04a7389ad369 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:02.164059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:02.164939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:02.165736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:02.165736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:02.165736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:02.165736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:02.165736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:02.165736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:02.165736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:02.165736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:02.165736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:02.165736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:02.165736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:02.165736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:02.165736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 37/75] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:02.167874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4171fe-8360-4d8f-bf30-04a7389ad369 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:02.175912 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:02.194350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:02.235620 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b567af-79ca-4723-8c78-536909885181 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:02.267138 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4171fe-8360-4d8f-bf30-04a7389ad369 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:02.268735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad27ae3-e18f-4d35-8ef5-a3a567716f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:02.269417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad27ae3-e18f-4d35-8ef5-a3a567716f3d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:02.269708 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad27ae3-e18f-4d35-8ef5-a3a567716f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:02.269990 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad27ae3-e18f-4d35-8ef5-a3a567716f3d None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:02.270740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad27ae3-e18f-4d35-8ef5-a3a567716f3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:02.271056 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad27ae3-e18f-4d35-8ef5-a3a567716f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:02.272483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad27ae3-e18f-4d35-8ef5-a3a567716f3d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:02.280559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 39/76] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:02.281771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bcb47-1197-48b4-94b4-365d7b6cb4d9 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:02.282068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bcb47-1197-48b4-94b4-365d7b6cb4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:02.282627 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bcb47-1197-48b4-94b4-365d7b6cb4d9 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:02.283850 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 40/77] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:02.284587 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bcb47-1197-48b4-94b4-365d7b6cb4d9 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:02.303154 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94173840-88ba-4cde-a692-506bacf5651b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:02.304059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94173840-88ba-4cde-a692-506bacf5651b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:02.304350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94173840-88ba-4cde-a692-506bacf5651b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:02.304630 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94173840-88ba-4cde-a692-506bacf5651b None admin] PATH_INFO: `/v3/users/b11eb85688a44fb992995321f605104f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:02.320356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94173840-88ba-4cde-a692-506bacf5651b None admin] RBAC: Authorizing `identity:get_user(user_id=b11eb85688a44fb992995321f605104f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:02.321828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94173840-88ba-4cde-a692-506bacf5651b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:02.323521 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 38/78] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:02 2022] GET /identity/v3/users/b11eb85688a44fb992995321f605104f => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:02.324338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94173840-88ba-4cde-a692-506bacf5651b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:02.382093 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:02.385802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bcb47-1197-48b4-94b4-365d7b6cb4d9 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:02.409125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:02.418424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f08eb-8ec1-4c43-bd69-eb44ed6d6bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:02.419244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f08eb-8ec1-4c43-bd69-eb44ed6d6bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:02.419542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f08eb-8ec1-4c43-bd69-eb44ed6d6bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:02.419821 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f08eb-8ec1-4c43-bd69-eb44ed6d6bd4 None admin] PATH_INFO: `/v3/users/6a85b2f060664557b1c1e38cb4a7b74d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:02.421580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f08eb-8ec1-4c43-bd69-eb44ed6d6bd4 None admin] RBAC: Authorizing `identity:get_user(user_id=6a85b2f060664557b1c1e38cb4a7b74d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:02.423039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f08eb-8ec1-4c43-bd69-eb44ed6d6bd4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:02.429265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 41/79] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:02 2022] GET /identity/v3/users/6a85b2f060664557b1c1e38cb4a7b74d => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:02.429265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f08eb-8ec1-4c43-bd69-eb44ed6d6bd4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:02.429458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94173840-88ba-4cde-a692-506bacf5651b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:02.463505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9fd38-1d88-497e-b2fe-5afd750447d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:02.464219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9fd38-1d88-497e-b2fe-5afd750447d2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:02.464507 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9fd38-1d88-497e-b2fe-5afd750447d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:02.464785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9fd38-1d88-497e-b2fe-5afd750447d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:02.465540 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9fd38-1d88-497e-b2fe-5afd750447d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:02.465850 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9fd38-1d88-497e-b2fe-5afd750447d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:02.467744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9fd38-1d88-497e-b2fe-5afd750447d2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:02.476394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 39/80] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:02.478015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230ecba-f225-4728-91ff-75e12439fea5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:02.478463 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230ecba-f225-4728-91ff-75e12439fea5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:02.478757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230ecba-f225-4728-91ff-75e12439fea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:02.495958 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7230ecba-f225-4728-91ff-75e12439fea5 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:02.497188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7230ecba-f225-4728-91ff-75e12439fea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:02.523365 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f08eb-8ec1-4c43-bd69-eb44ed6d6bd4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:02.557454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f101c-7cb3-427f-8fb6-9ba9b2da3b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:02.558319 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f101c-7cb3-427f-8fb6-9ba9b2da3b81 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:02.558603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f101c-7cb3-427f-8fb6-9ba9b2da3b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:02.558874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f101c-7cb3-427f-8fb6-9ba9b2da3b81 None admin] PATH_INFO: `/v3/users/b11eb85688a44fb992995321f605104f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:02.560092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f101c-7cb3-427f-8fb6-9ba9b2da3b81 None admin] RBAC: Authorizing `identity:get_user(user_id=b11eb85688a44fb992995321f605104f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:02.561585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f101c-7cb3-427f-8fb6-9ba9b2da3b81 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:02.563222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 42/81] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:02 2022] GET /identity/v3/users/b11eb85688a44fb992995321f605104f => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:02.567936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 40/82] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:02.568053 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f101c-7cb3-427f-8fb6-9ba9b2da3b81 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:02.568128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230ecba-f225-4728-91ff-75e12439fea5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:02.601899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:02.644845 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:02.666440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f101c-7cb3-427f-8fb6-9ba9b2da3b81 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:02.669097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230ecba-f225-4728-91ff-75e12439fea5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:02.699883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc8ebf-9dfd-427d-b831-50e9492930bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:02.700570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc8ebf-9dfd-427d-b831-50e9492930bb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:02.700860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc8ebf-9dfd-427d-b831-50e9492930bb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:02.701143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc8ebf-9dfd-427d-b831-50e9492930bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:02.702873 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a823dc-7b5c-44d5-85ff-df4398ebafa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:02.703531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a823dc-7b5c-44d5-85ff-df4398ebafa1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:02.703823 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a823dc-7b5c-44d5-85ff-df4398ebafa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:02.704135 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a823dc-7b5c-44d5-85ff-df4398ebafa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:02.767012 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc8ebf-9dfd-427d-b831-50e9492930bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:02.768497 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc8ebf-9dfd-427d-b831-50e9492930bb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:02.769625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a823dc-7b5c-44d5-85ff-df4398ebafa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:02.771094 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a823dc-7b5c-44d5-85ff-df4398ebafa1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:02.801484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:02.844307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:02.865494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 43/83] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:02.866333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc8ebf-9dfd-427d-b831-50e9492930bb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:02.869914 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 41/84] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:02.870742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a823dc-7b5c-44d5-85ff-df4398ebafa1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:02.966306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc8ebf-9dfd-427d-b831-50e9492930bb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:02.968027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a823dc-7b5c-44d5-85ff-df4398ebafa1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:03.000933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c9195-360d-4bb3-b8cb-a8270488eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:03.001799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c9195-360d-4bb3-b8cb-a8270488eaef None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:03.002078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c9195-360d-4bb3-b8cb-a8270488eaef None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:03.002230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f245db-8c86-47e8-a075-c2369dbe0253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:03.002352 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c9195-360d-4bb3-b8cb-a8270488eaef None admin] PATH_INFO: `/v3/users/b11eb85688a44fb992995321f605104f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:03.002879 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f245db-8c86-47e8-a075-c2369dbe0253 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:03.003169 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f245db-8c86-47e8-a075-c2369dbe0253 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:03.003450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f245db-8c86-47e8-a075-c2369dbe0253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:03.003543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c9195-360d-4bb3-b8cb-a8270488eaef None admin] RBAC: Authorizing `identity:get_user(user_id=b11eb85688a44fb992995321f605104f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:03.004984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c9195-360d-4bb3-b8cb-a8270488eaef None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:03.006849 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 44/85] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:02 2022] GET /identity/v3/users/b11eb85688a44fb992995321f605104f => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:03.007355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c9195-360d-4bb3-b8cb-a8270488eaef None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:03.010731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:03.046622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:03.073937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f245db-8c86-47e8-a075-c2369dbe0253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:03.075496 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f245db-8c86-47e8-a075-c2369dbe0253 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:03.106217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c9195-360d-4bb3-b8cb-a8270488eaef None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:03.139989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20693b-27d7-4a75-8701-e5ccb39881fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:03.140812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20693b-27d7-4a75-8701-e5ccb39881fb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:03.141094 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20693b-27d7-4a75-8701-e5ccb39881fb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:03.141367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20693b-27d7-4a75-8701-e5ccb39881fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:03.142533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20693b-27d7-4a75-8701-e5ccb39881fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:03.143982 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20693b-27d7-4a75-8701-e5ccb39881fb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:03.145610 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 45/86] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:03.146366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20693b-27d7-4a75-8701-e5ccb39881fb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:03.173929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 42/87] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:03.174946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f245db-8c86-47e8-a075-c2369dbe0253 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:03.218696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:03.247416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20693b-27d7-4a75-8701-e5ccb39881fb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:03.253566 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:03.278025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f245db-8c86-47e8-a075-c2369dbe0253 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:03.281454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05dd0c4-93d9-4041-81f6-647f8607f9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:03.282312 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dd0c4-93d9-4041-81f6-647f8607f9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:03.282858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dd0c4-93d9-4041-81f6-647f8607f9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:03.283138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dd0c4-93d9-4041-81f6-647f8607f9a1 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:03.284540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05dd0c4-93d9-4041-81f6-647f8607f9a1 None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:03.285918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05dd0c4-93d9-4041-81f6-647f8607f9a1 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:03.287621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 46/88] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:03 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:03.291497 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05dd0c4-93d9-4041-81f6-647f8607f9a1 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:03.316120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e407091-8f00-4f84-a5ec-153f34c31980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:03.316976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e407091-8f00-4f84-a5ec-153f34c31980 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:03.317254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e407091-8f00-4f84-a5ec-153f34c31980 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:03.317524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e407091-8f00-4f84-a5ec-153f34c31980 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:03.318711 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e407091-8f00-4f84-a5ec-153f34c31980 None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:03.320169 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e407091-8f00-4f84-a5ec-153f34c31980 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:03.321866 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 43/89] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:03 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:03.322602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e407091-8f00-4f84-a5ec-153f34c31980 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:03.389592 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05dd0c4-93d9-4041-81f6-647f8607f9a1 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:03.419387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e407091-8f00-4f84-a5ec-153f34c31980 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:03.425154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736716e-8188-413a-859a-bacda87a95c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:03.425924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736716e-8188-413a-859a-bacda87a95c1 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:03.426268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736716e-8188-413a-859a-bacda87a95c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:03.426627 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736716e-8188-413a-859a-bacda87a95c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:03.437326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:03.453781 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a5ef2-4b73-41f2-830d-f70373d0c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:03.454458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a5ef2-4b73-41f2-830d-f70373d0c7d5 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:03.454747 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a5ef2-4b73-41f2-830d-f70373d0c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:03.455027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a5ef2-4b73-41f2-830d-f70373d0c7d5 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:03.455749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a5ef2-4b73-41f2-830d-f70373d0c7d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:03.457256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a5ef2-4b73-41f2-830d-f70373d0c7d5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:03.493682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736716e-8188-413a-859a-bacda87a95c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:03.495072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736716e-8188-413a-859a-bacda87a95c1 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:03.531737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:03.537397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 44/90] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:04:03 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:04:03.538281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a5ef2-4b73-41f2-830d-f70373d0c7d5 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:03.607019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 47/91] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:03.607706 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736716e-8188-413a-859a-bacda87a95c1 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:03.653921 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:03.658165 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a5ef2-4b73-41f2-830d-f70373d0c7d5 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:03.698731 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b2c34-a107-46c2-930e-0ee085746289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:03.699704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2c34-a107-46c2-930e-0ee085746289 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:03.699987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2c34-a107-46c2-930e-0ee085746289 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:03.700295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2c34-a107-46c2-930e-0ee085746289 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:03.702161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b2c34-a107-46c2-930e-0ee085746289 None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:03.703648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b2c34-a107-46c2-930e-0ee085746289 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:03.705466 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 45/92] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:03 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:03.706243 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b2c34-a107-46c2-930e-0ee085746289 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:03.722527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736716e-8188-413a-859a-bacda87a95c1 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:03.761935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5321b-a772-4867-867a-c8d1692ddc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:03.762528 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5321b-a772-4867-867a-c8d1692ddc7e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:03.762862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5321b-a772-4867-867a-c8d1692ddc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:03.763305 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5321b-a772-4867-867a-c8d1692ddc7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:03.764708 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5321b-a772-4867-867a-c8d1692ddc7e None admin] RBAC: Adding query filter params (role.id=d47bb3db22444385b7884acbc7e21b0f, scope.project.id=8600563b295742f1a8d5ba26a2a51f14, user.id=b11eb85688a44fb992995321f605104f) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:03.765273 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5321b-a772-4867-867a-c8d1692ddc7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:03.767556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5321b-a772-4867-867a-c8d1692ddc7e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:03.774290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 48/93] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:03 2022] GET /identity/v3/role_assignments?user.id=b11eb85688a44fb992995321f605104f&scope.project.id=8600563b295742f1a8d5ba26a2a51f14&role.id=d47bb3db22444385b7884acbc7e21b0f => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:03.774968 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5321b-a772-4867-867a-c8d1692ddc7e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:03.785944 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:03.831626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b2c34-a107-46c2-930e-0ee085746289 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:03.874759 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64827ad-831f-46fd-b923-acce871957a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:03.875447 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64827ad-831f-46fd-b923-acce871957a6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:03.875737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64827ad-831f-46fd-b923-acce871957a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:03.876060 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64827ad-831f-46fd-b923-acce871957a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:03.876930 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64827ad-831f-46fd-b923-acce871957a6 None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=8600563b295742f1a8d5ba26a2a51f14, user.id=6a85b2f060664557b1c1e38cb4a7b74d) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:03.877299 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64827ad-831f-46fd-b923-acce871957a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:03.878817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64827ad-831f-46fd-b923-acce871957a6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:03.886075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 46/94] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:03 2022] GET /identity/v3/role_assignments?user.id=6a85b2f060664557b1c1e38cb4a7b74d&scope.project.id=8600563b295742f1a8d5ba26a2a51f14&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:03.886932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64827ad-831f-46fd-b923-acce871957a6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:03.920129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5321b-a772-4867-867a-c8d1692ddc7e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:03.923612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:03.963262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8438db-59ce-46fc-bba0-c2cb392d399c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:03.965079 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8438db-59ce-46fc-bba0-c2cb392d399c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:03.966157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8438db-59ce-46fc-bba0-c2cb392d399c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:03.966691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8438db-59ce-46fc-bba0-c2cb392d399c None admin] PATH_INFO: `/v3/projects/53ab73e8b51a4f81990c14b460d8188c` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:03.968986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8438db-59ce-46fc-bba0-c2cb392d399c None admin] RBAC: Authorizing `identity:get_project(project_id=53ab73e8b51a4f81990c14b460d8188c)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:03.970821 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8438db-59ce-46fc-bba0-c2cb392d399c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:03.973028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 49/95] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:03 2022] GET /identity/v3/projects/53ab73e8b51a4f81990c14b460d8188c => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:03.979096 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8438db-59ce-46fc-bba0-c2cb392d399c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:04.005645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64827ad-831f-46fd-b923-acce871957a6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:04.040596 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:04.047734 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc22b5-6193-4f69-956d-e6c8b9c2abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:04.049288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc22b5-6193-4f69-956d-e6c8b9c2abb9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:04.049288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc22b5-6193-4f69-956d-e6c8b9c2abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:04.049575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc22b5-6193-4f69-956d-e6c8b9c2abb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:04.050720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc22b5-6193-4f69-956d-e6c8b9c2abb9 None admin] RBAC: Adding query filter params (role.id=282334a450b54dedb0b42d678d231caf, scope.project.id=8600563b295742f1a8d5ba26a2a51f14, user.id=b11eb85688a44fb992995321f605104f) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:04.051037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc22b5-6193-4f69-956d-e6c8b9c2abb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:04.052575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc22b5-6193-4f69-956d-e6c8b9c2abb9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:04.060327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 47/96] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:03 2022] GET /identity/v3/role_assignments?user.id=b11eb85688a44fb992995321f605104f&scope.project.id=8600563b295742f1a8d5ba26a2a51f14&role.id=282334a450b54dedb0b42d678d231caf => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:04.164236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8438db-59ce-46fc-bba0-c2cb392d399c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:04.219144 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94593d4-a7f4-4311-bbd8-9fd008d3d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:04.219849 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94593d4-a7f4-4311-bbd8-9fd008d3d49e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:04.220175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94593d4-a7f4-4311-bbd8-9fd008d3d49e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:04.220459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94593d4-a7f4-4311-bbd8-9fd008d3d49e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:04.221353 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94593d4-a7f4-4311-bbd8-9fd008d3d49e None admin] RBAC: Adding query filter params (role.id=d47bb3db22444385b7884acbc7e21b0f, scope.project.id=53ab73e8b51a4f81990c14b460d8188c, user.id=b11eb85688a44fb992995321f605104f) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:04.221673 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94593d4-a7f4-4311-bbd8-9fd008d3d49e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:04.223229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94593d4-a7f4-4311-bbd8-9fd008d3d49e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:04.235920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 50/97] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:03 2022] GET /identity/v3/role_assignments?user.id=b11eb85688a44fb992995321f605104f&scope.project.id=53ab73e8b51a4f81990c14b460d8188c&role.id=d47bb3db22444385b7884acbc7e21b0f => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:06.444890 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4c3c-3c2f-4bd1-a2f6-9f3d475d4adc None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:06.445390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4c3c-3c2f-4bd1-a2f6-9f3d475d4adc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:06.445494 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4c3c-3c2f-4bd1-a2f6-9f3d475d4adc None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:06.446974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 48/98] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:06.453121 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48849d-9d4f-4c83-a7a8-0021ff062bcf None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:06.453945 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48849d-9d4f-4c83-a7a8-0021ff062bcf None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:06.454506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48849d-9d4f-4c83-a7a8-0021ff062bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:06.481061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-6b48849d-9d4f-4c83-a7a8-0021ff062bcf None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:06.482616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6b48849d-9d4f-4c83-a7a8-0021ff062bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:06.518737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:06.567292 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 51/99] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:06.581945 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17897f-1291-436f-bf48-fb62c107c344 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:06.582536 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17897f-1291-436f-bf48-fb62c107c344 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:06.583042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17897f-1291-436f-bf48-fb62c107c344 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:06.584874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 49/100] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:06.590675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac701c37-5c92-4b03-987d-76851582b2cd None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:06.597198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac701c37-5c92-4b03-987d-76851582b2cd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:06.597198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac701c37-5c92-4b03-987d-76851582b2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:06.610095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17897f-1291-436f-bf48-fb62c107c344 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:06.612729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ac701c37-5c92-4b03-987d-76851582b2cd None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:06.614152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ac701c37-5c92-4b03-987d-76851582b2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:06.747640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 52/101] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:06.749390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f71114-15d7-4925-b13b-5c4aa9bc2013 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:06.749919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f71114-15d7-4925-b13b-5c4aa9bc2013 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:06.750401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f71114-15d7-4925-b13b-5c4aa9bc2013 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:06.752451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 53/102] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:06.757681 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6979a-d98a-4df0-91b7-1191e861a50c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:06.758603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6979a-d98a-4df0-91b7-1191e861a50c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:06.759117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6979a-d98a-4df0-91b7-1191e861a50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:06.788392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-91c6979a-d98a-4df0-91b7-1191e861a50c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:06.790508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-91c6979a-d98a-4df0-91b7-1191e861a50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:06.809693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17897f-1291-436f-bf48-fb62c107c344 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:06.879605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5efa4-3b93-4806-ae0c-a0c107f491e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:06.880819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5efa4-3b93-4806-ae0c-a0c107f491e7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:06.881312 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5efa4-3b93-4806-ae0c-a0c107f491e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:06.881804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5efa4-3b93-4806-ae0c-a0c107f491e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:06.883917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5efa4-3b93-4806-ae0c-a0c107f491e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:06.888306 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5efa4-3b93-4806-ae0c-a0c107f491e7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:06.890730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 50/103] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:06.891719 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5efa4-3b93-4806-ae0c-a0c107f491e7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:06.918910 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 54/104] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:06.919827 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6979a-d98a-4df0-91b7-1191e861a50c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:06.953775 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:06.973663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:07.022153 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5efa4-3b93-4806-ae0c-a0c107f491e7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:07.056586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6979a-d98a-4df0-91b7-1191e861a50c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:07.066928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed546b-b2ca-45f1-a283-02f750d2cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:07.067815 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed546b-b2ca-45f1-a283-02f750d2cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.068201 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed546b-b2ca-45f1-a283-02f750d2cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.068551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed546b-b2ca-45f1-a283-02f750d2cfd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.083510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed546b-b2ca-45f1-a283-02f750d2cfd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-30ed546b-b2ca-45f1-a283-02f750d2cfd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:07.094673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:07.095728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:07.096741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:07.096741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:07.096741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:07.096741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:07.096741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:07.096741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:07.096741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:07.096741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:07.096741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:07.096741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:07.096741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:07.096741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:07.098991 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 51/105] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:07.100826 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2786b8-8398-4222-abb9-0182d2e6e951 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.101187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2786b8-8398-4222-abb9-0182d2e6e951 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.101539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2786b8-8398-4222-abb9-0182d2e6e951 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.107010 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 52/106] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:07.107010 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2786b8-8398-4222-abb9-0182d2e6e951 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:07.109461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd45f25-c9d4-4ef7-91a1-66ef209945f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:07.110300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd45f25-c9d4-4ef7-91a1-66ef209945f8 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.110721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd45f25-c9d4-4ef7-91a1-66ef209945f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.111348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd45f25-c9d4-4ef7-91a1-66ef209945f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.113125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd45f25-c9d4-4ef7-91a1-66ef209945f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:07.114748 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd45f25-c9d4-4ef7-91a1-66ef209945f8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:07.218724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2786b8-8398-4222-abb9-0182d2e6e951 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:07.231647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 55/107] 10.222.0.74 () {60 vars in 1141 bytes} [Thu Jul 14 10:04:06 2022] POST /identity/v3/projects => generated 302 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:04:07.232888 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd45f25-c9d4-4ef7-91a1-66ef209945f8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:07.246310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:07.282260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38062780-0ff4-4177-af38-f964900f06f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:07.282573 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38062780-0ff4-4177-af38-f964900f06f6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.282758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38062780-0ff4-4177-af38-f964900f06f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.283045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38062780-0ff4-4177-af38-f964900f06f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.313151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38062780-0ff4-4177-af38-f964900f06f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-38062780-0ff4-4177-af38-f964900f06f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:07.322263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:07.323218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:07.324040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:07.324040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:07.324040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:07.324040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:07.324040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:07.324040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:07.324040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:07.324040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:07.324040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:07.324040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:07.324040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:07.324040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:07.324040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 53/108] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:04:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:07.325195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5bcd1-65ef-4485-9fbf-119bfe52ed13 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.325195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5bcd1-65ef-4485-9fbf-119bfe52ed13 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.325359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5bcd1-65ef-4485-9fbf-119bfe52ed13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.345818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:07.356339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ecd5bcd1-65ef-4485-9fbf-119bfe52ed13 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:07.359437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ecd5bcd1-65ef-4485-9fbf-119bfe52ed13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:07.371168 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd45f25-c9d4-4ef7-91a1-66ef209945f8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:07.415496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe485b-7585-46f0-9e52-3f6b4919200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:07.416241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe485b-7585-46f0-9e52-3f6b4919200e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.416534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe485b-7585-46f0-9e52-3f6b4919200e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.417131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe485b-7585-46f0-9e52-3f6b4919200e None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.418219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe485b-7585-46f0-9e52-3f6b4919200e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:07.419203 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe485b-7585-46f0-9e52-3f6b4919200e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:07.420629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe485b-7585-46f0-9e52-3f6b4919200e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:07.435133 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 56/109] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:07.436805 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06c1d9-d466-4d1a-852d-7832dc5d0584 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.437303 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06c1d9-d466-4d1a-852d-7832dc5d0584 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.437761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06c1d9-d466-4d1a-852d-7832dc5d0584 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.439171 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 57/110] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:07.439761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06c1d9-d466-4d1a-852d-7832dc5d0584 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:07.451366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 54/111] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:07.453387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5bcd1-65ef-4485-9fbf-119bfe52ed13 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:07.569807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5bcd1-65ef-4485-9fbf-119bfe52ed13 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:07.583969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06c1d9-d466-4d1a-852d-7832dc5d0584 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:07.589664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:07.612292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2f308-28c5-4f84-87fd-d3120c6dc9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:07.613192 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f308-28c5-4f84-87fd-d3120c6dc9aa None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.613525 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f308-28c5-4f84-87fd-d3120c6dc9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.613767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f308-28c5-4f84-87fd-d3120c6dc9aa None admin] PATH_INFO: `/v3/users/743c68a9a91f43d7807f368ece026412` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.622103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e65e3-9765-4334-9d9a-088b89d2bb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:07.622972 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e65e3-9765-4334-9d9a-088b89d2bb70 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.623426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e65e3-9765-4334-9d9a-088b89d2bb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.623839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e65e3-9765-4334-9d9a-088b89d2bb70 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.624811 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e65e3-9765-4334-9d9a-088b89d2bb70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:07.625135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e65e3-9765-4334-9d9a-088b89d2bb70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:07.626534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e65e3-9765-4334-9d9a-088b89d2bb70 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:07.628271 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2f308-28c5-4f84-87fd-d3120c6dc9aa None admin] RBAC: Authorizing `identity:get_user(user_id=743c68a9a91f43d7807f368ece026412)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:07.629740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2f308-28c5-4f84-87fd-d3120c6dc9aa None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:07.631630 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 55/112] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:07 2022] GET /identity/v3/users/743c68a9a91f43d7807f368ece026412 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:07.633014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9410a-715d-4ca8-94dd-261a9fbe8555 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.633190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9410a-715d-4ca8-94dd-261a9fbe8555 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.633418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9410a-715d-4ca8-94dd-261a9fbe8555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.637025 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 58/113] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:07.638129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e65e3-9765-4334-9d9a-088b89d2bb70 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:07.645266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:07.658759 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-19f9410a-715d-4ca8-94dd-261a9fbe8555 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:07.659954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-19f9410a-715d-4ca8-94dd-261a9fbe8555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:07.730771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 56/114] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:07.732463 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d9641-af8b-47f7-b4d5-d8855ab7f94c None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.732856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d9641-af8b-47f7-b4d5-d8855ab7f94c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.733211 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d9641-af8b-47f7-b4d5-d8855ab7f94c None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.734725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 57/115] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:07.739353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d9641-af8b-47f7-b4d5-d8855ab7f94c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:07.766178 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e65e3-9765-4334-9d9a-088b89d2bb70 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:07.801660 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba24ea-1ec0-4b10-a21e-cf38f70b0cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:07.802455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba24ea-1ec0-4b10-a21e-cf38f70b0cfc None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.802746 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba24ea-1ec0-4b10-a21e-cf38f70b0cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.803027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba24ea-1ec0-4b10-a21e-cf38f70b0cfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.813763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba24ea-1ec0-4b10-a21e-cf38f70b0cfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-69ba24ea-1ec0-4b10-a21e-cf38f70b0cfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:07.821728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:07.822611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:07.823385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:07.823385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:07.823385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:07.823385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:07.823385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:07.823385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:07.823385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:07.823385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:07.823385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:07.823385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:07.823385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:07.823385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:07.823385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 59/116] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:04:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:07.824085 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba24ea-1ec0-4b10-a21e-cf38f70b0cfc None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:07.857549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:07.862226 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d9641-af8b-47f7-b4d5-d8855ab7f94c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:07.898043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d02c5-0d93-4951-b6e1-a3c27ec6ca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:07.898696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d02c5-0d93-4951-b6e1-a3c27ec6ca59 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.898982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d02c5-0d93-4951-b6e1-a3c27ec6ca59 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.899260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d02c5-0d93-4951-b6e1-a3c27ec6ca59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.900363 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:07.942099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba24ea-1ec0-4b10-a21e-cf38f70b0cfc None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:07.971766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d02c5-0d93-4951-b6e1-a3c27ec6ca59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:07.973576 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d02c5-0d93-4951-b6e1-a3c27ec6ca59 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:07.976258 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbb37c-95f2-43f9-aa06-492f67e8541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:07.977145 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbb37c-95f2-43f9-aa06-492f67e8541d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.977435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbb37c-95f2-43f9-aa06-492f67e8541d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.977716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbb37c-95f2-43f9-aa06-492f67e8541d None admin] PATH_INFO: `/v3/users/b11eb85688a44fb992995321f605104f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.978961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbb37c-95f2-43f9-aa06-492f67e8541d None admin] RBAC: Authorizing `identity:get_user(user_id=b11eb85688a44fb992995321f605104f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:07.980452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbb37c-95f2-43f9-aa06-492f67e8541d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:07.982897 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 60/117] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:07 2022] GET /identity/v3/users/b11eb85688a44fb992995321f605104f => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:07.984642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304088e-1400-4ab6-8aba-1aae1a29f39b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.984926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304088e-1400-4ab6-8aba-1aae1a29f39b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.985198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304088e-1400-4ab6-8aba-1aae1a29f39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:08.003410 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9304088e-1400-4ab6-8aba-1aae1a29f39b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:08.004742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9304088e-1400-4ab6-8aba-1aae1a29f39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:08.087937 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 61/118] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:08.088590 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304088e-1400-4ab6-8aba-1aae1a29f39b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:08.102605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:08.109421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 58/119] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:08.110708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d02c5-0d93-4951-b6e1-a3c27ec6ca59 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:08.157289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:08.198067 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304088e-1400-4ab6-8aba-1aae1a29f39b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:08.220307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d02c5-0d93-4951-b6e1-a3c27ec6ca59 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:08.234352 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caf097-1f8f-4c05-917d-27131da9b99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:08.235158 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caf097-1f8f-4c05-917d-27131da9b99f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:08.235446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caf097-1f8f-4c05-917d-27131da9b99f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:08.235724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caf097-1f8f-4c05-917d-27131da9b99f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:08.245903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67caf097-1f8f-4c05-917d-27131da9b99f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-67caf097-1f8f-4c05-917d-27131da9b99f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:08.253779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:08.254653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:08.255475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:08.255475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:08.255475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:08.255475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:08.255475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:08.255475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:08.255475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:08.255475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:08.255475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:08.255475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:08.255475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:08.255475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:08.255475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 62/120] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:08.256157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caf097-1f8f-4c05-917d-27131da9b99f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:08.257093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db510e03-b5e4-4400-a8d8-2c71d5cd419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:08.257770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db510e03-b5e4-4400-a8d8-2c71d5cd419c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:08.258101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db510e03-b5e4-4400-a8d8-2c71d5cd419c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:08.258375 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db510e03-b5e4-4400-a8d8-2c71d5cd419c None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:08.259309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db510e03-b5e4-4400-a8d8-2c71d5cd419c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:08.260400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db510e03-b5e4-4400-a8d8-2c71d5cd419c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:08.261811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db510e03-b5e4-4400-a8d8-2c71d5cd419c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:08.275381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 59/121] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:08.275381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db510e03-b5e4-4400-a8d8-2c71d5cd419c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:08.335622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:08.370136 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caf097-1f8f-4c05-917d-27131da9b99f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:08.376619 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db510e03-b5e4-4400-a8d8-2c71d5cd419c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:08.391546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:08.406635 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4379a8a-f77d-4d72-8442-cc4f088bb68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:08.407790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4379a8a-f77d-4d72-8442-cc4f088bb68b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:08.408103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4379a8a-f77d-4d72-8442-cc4f088bb68b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:08.408631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4379a8a-f77d-4d72-8442-cc4f088bb68b None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:08.409826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4379a8a-f77d-4d72-8442-cc4f088bb68b None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:08.411275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4379a8a-f77d-4d72-8442-cc4f088bb68b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:08.413036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 63/122] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:08 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:08.413799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4379a8a-f77d-4d72-8442-cc4f088bb68b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:08.419930 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e845ff-2f78-4fda-bf5f-e689d623799f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:08.421788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e845ff-2f78-4fda-bf5f-e689d623799f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:08.422087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e845ff-2f78-4fda-bf5f-e689d623799f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:08.422371 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e845ff-2f78-4fda-bf5f-e689d623799f None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:08.423700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e845ff-2f78-4fda-bf5f-e689d623799f None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:08.425290 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e845ff-2f78-4fda-bf5f-e689d623799f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:08.427928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 60/123] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:08 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:08.432348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e845ff-2f78-4fda-bf5f-e689d623799f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:08.529962 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4379a8a-f77d-4d72-8442-cc4f088bb68b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:08.538070 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e845ff-2f78-4fda-bf5f-e689d623799f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:08.569882 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:08.572890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e2351-184b-49c0-844d-ef42dc23ca11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:08.573909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e2351-184b-49c0-844d-ef42dc23ca11 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:08.574344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e2351-184b-49c0-844d-ef42dc23ca11 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:08.574798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e2351-184b-49c0-844d-ef42dc23ca11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:08.576144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dfc37-336a-45ac-82c3-68d17342c9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:08.594557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dfc37-336a-45ac-82c3-68d17342c9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:08.594557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dfc37-336a-45ac-82c3-68d17342c9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:08.594557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dfc37-336a-45ac-82c3-68d17342c9c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:08.594557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dfc37-336a-45ac-82c3-68d17342c9c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:08.594557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dfc37-336a-45ac-82c3-68d17342c9c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:08.594557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dfc37-336a-45ac-82c3-68d17342c9c1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:08.595047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e2351-184b-49c0-844d-ef42dc23ca11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:08.595469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 61/124] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:08.595469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dfc37-336a-45ac-82c3-68d17342c9c1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-e30e2351-184b-49c0-844d-ef42dc23ca11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:08.596068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:08.597117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:08.598086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:08.598086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:08.598086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:08.598086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:08.598086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:08.598086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:08.598086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:08.598086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:08.598086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:08.598086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:08.598086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:08.598086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:08.600202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 64/125] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:08.601095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e2351-184b-49c0-844d-ef42dc23ca11 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:08.657945 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:08.700935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dfc37-336a-45ac-82c3-68d17342c9c1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:08.712722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e2351-184b-49c0-844d-ef42dc23ca11 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:08.737405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d85b5d-d4e9-4006-af66-80f89107b8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:08.738367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d85b5d-d4e9-4006-af66-80f89107b8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:08.738659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d85b5d-d4e9-4006-af66-80f89107b8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:08.738943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d85b5d-d4e9-4006-af66-80f89107b8a9 None admin] PATH_INFO: `/v3/users/6a85b2f060664557b1c1e38cb4a7b74d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:08.740172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d85b5d-d4e9-4006-af66-80f89107b8a9 None admin] RBAC: Authorizing `identity:get_user(user_id=6a85b2f060664557b1c1e38cb4a7b74d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:08.741676 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d85b5d-d4e9-4006-af66-80f89107b8a9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:08.747680 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 62/126] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:08 2022] GET /identity/v3/users/6a85b2f060664557b1c1e38cb4a7b74d => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:08.747680 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d85b5d-d4e9-4006-af66-80f89107b8a9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:08.753642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bce0b5-7c11-44c4-83dc-fa9a2f5fa4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:08.754631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce0b5-7c11-44c4-83dc-fa9a2f5fa4d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:08.754990 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce0b5-7c11-44c4-83dc-fa9a2f5fa4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:08.755345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce0b5-7c11-44c4-83dc-fa9a2f5fa4d7 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14/users/b11eb85688a44fb992995321f605104f/roles/282334a450b54dedb0b42d678d231caf` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:08.757701 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bce0b5-7c11-44c4-83dc-fa9a2f5fa4d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8600563b295742f1a8d5ba26a2a51f14, user_id=b11eb85688a44fb992995321f605104f, role_id=282334a450b54dedb0b42d678d231caf)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:08.759241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bce0b5-7c11-44c4-83dc-fa9a2f5fa4d7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:08.807472 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:08.856032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 65/127] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:04:08 2022] PUT /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14/users/b11eb85688a44fb992995321f605104f/roles/282334a450b54dedb0b42d678d231caf => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:08.856032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bce0b5-7c11-44c4-83dc-fa9a2f5fa4d7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:08.861729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d85b5d-d4e9-4006-af66-80f89107b8a9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:08.905475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aeda1f-bef2-4397-9e80-6ff771ee730a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:08.906432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeda1f-bef2-4397-9e80-6ff771ee730a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:08.906720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeda1f-bef2-4397-9e80-6ff771ee730a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:08.906995 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeda1f-bef2-4397-9e80-6ff771ee730a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:08.908685 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aeda1f-bef2-4397-9e80-6ff771ee730a None admin] RBAC: Adding query filter params (role.id=e3482518249a452d8c02c7d2d16f19dc, scope.project.id=8600563b295742f1a8d5ba26a2a51f14, user.id=743c68a9a91f43d7807f368ece026412) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:08.908947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aeda1f-bef2-4397-9e80-6ff771ee730a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:08.910581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aeda1f-bef2-4397-9e80-6ff771ee730a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:08.919532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 63/128] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:08 2022] GET /identity/v3/role_assignments?user.id=743c68a9a91f43d7807f368ece026412&scope.project.id=8600563b295742f1a8d5ba26a2a51f14&role.id=e3482518249a452d8c02c7d2d16f19dc => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:08.921746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aeda1f-bef2-4397-9e80-6ff771ee730a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:08.972161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bce0b5-7c11-44c4-83dc-fa9a2f5fa4d7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:08.985090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:09.018467 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d68144-206c-4d13-a64c-1acd2f5723ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:09.019658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d68144-206c-4d13-a64c-1acd2f5723ca None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:09.020135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d68144-206c-4d13-a64c-1acd2f5723ca None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:09.020904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d68144-206c-4d13-a64c-1acd2f5723ca None admin] PATH_INFO: `/v3/users/b11eb85688a44fb992995321f605104f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:09.023531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d68144-206c-4d13-a64c-1acd2f5723ca None admin] RBAC: Authorizing `identity:get_user(user_id=b11eb85688a44fb992995321f605104f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:09.026471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d68144-206c-4d13-a64c-1acd2f5723ca None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:09.029426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 66/129] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:08 2022] GET /identity/v3/users/b11eb85688a44fb992995321f605104f => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:09.031612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d68144-206c-4d13-a64c-1acd2f5723ca None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:09.075714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aeda1f-bef2-4397-9e80-6ff771ee730a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:09.103469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:09.115832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53872e69-8465-4d84-88fe-591eeb78d2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:09.120144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53872e69-8465-4d84-88fe-591eeb78d2fa None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:09.120144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53872e69-8465-4d84-88fe-591eeb78d2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:09.120144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53872e69-8465-4d84-88fe-591eeb78d2fa None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:09.120144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53872e69-8465-4d84-88fe-591eeb78d2fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:09.120144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53872e69-8465-4d84-88fe-591eeb78d2fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:09.120144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53872e69-8465-4d84-88fe-591eeb78d2fa None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:09.133963 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 64/130] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:09.135044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53872e69-8465-4d84-88fe-591eeb78d2fa None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:09.178718 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d68144-206c-4d13-a64c-1acd2f5723ca None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:09.219382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14aaeb-6cb2-4d34-b515-13c6e2efa684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:09.220540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14aaeb-6cb2-4d34-b515-13c6e2efa684 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:09.220991 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14aaeb-6cb2-4d34-b515-13c6e2efa684 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:09.221406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14aaeb-6cb2-4d34-b515-13c6e2efa684 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:09.222866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14aaeb-6cb2-4d34-b515-13c6e2efa684 None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:09.224341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14aaeb-6cb2-4d34-b515-13c6e2efa684 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:09.226349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 67/131] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:09 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:09.226942 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14aaeb-6cb2-4d34-b515-13c6e2efa684 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:09.252664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53872e69-8465-4d84-88fe-591eeb78d2fa None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:09.290874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:09.332737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ecea2-6cbb-4931-bcbb-c38d86e7c59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:09.335181 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ecea2-6cbb-4931-bcbb-c38d86e7c59c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:09.335705 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ecea2-6cbb-4931-bcbb-c38d86e7c59c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:09.336230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ecea2-6cbb-4931-bcbb-c38d86e7c59c None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:09.337727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ecea2-6cbb-4931-bcbb-c38d86e7c59c None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:09.339404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ecea2-6cbb-4931-bcbb-c38d86e7c59c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:09.341386 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 65/132] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:09 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:09.342355 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ecea2-6cbb-4931-bcbb-c38d86e7c59c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:09.350207 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14aaeb-6cb2-4d34-b515-13c6e2efa684 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:09.387344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd6369-d88d-47cd-861b-20eb9fbb8dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:09.388320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd6369-d88d-47cd-861b-20eb9fbb8dbb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:09.388652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd6369-d88d-47cd-861b-20eb9fbb8dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:09.388932 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd6369-d88d-47cd-861b-20eb9fbb8dbb None admin] PATH_INFO: `/v3/users/b11eb85688a44fb992995321f605104f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:09.390340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd6369-d88d-47cd-861b-20eb9fbb8dbb None admin] RBAC: Authorizing `identity:get_user(user_id=b11eb85688a44fb992995321f605104f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:09.391958 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd6369-d88d-47cd-861b-20eb9fbb8dbb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:09.393621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 68/133] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:09 2022] GET /identity/v3/users/b11eb85688a44fb992995321f605104f => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:09.394364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd6369-d88d-47cd-861b-20eb9fbb8dbb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:09.447939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:09.501498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ecea2-6cbb-4931-bcbb-c38d86e7c59c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:09.520457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd6369-d88d-47cd-861b-20eb9fbb8dbb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:09.535777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:09.538709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d8a48-e17f-41f5-ae16-1965b7c75f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:09.539737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d8a48-e17f-41f5-ae16-1965b7c75f17 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:09.540044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d8a48-e17f-41f5-ae16-1965b7c75f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:09.540324 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d8a48-e17f-41f5-ae16-1965b7c75f17 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14/users/6a85b2f060664557b1c1e38cb4a7b74d/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:09.542405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d8a48-e17f-41f5-ae16-1965b7c75f17 None admin] RBAC: Authorizing `identity:create_grant(project_id=8600563b295742f1a8d5ba26a2a51f14, user_id=6a85b2f060664557b1c1e38cb4a7b74d, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:09.543930 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d8a48-e17f-41f5-ae16-1965b7c75f17 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:09.559665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438937a-3488-4d44-a3f9-35c2dea6b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:09.560592 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438937a-3488-4d44-a3f9-35c2dea6b868 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:09.560880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438937a-3488-4d44-a3f9-35c2dea6b868 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:09.561169 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438937a-3488-4d44-a3f9-35c2dea6b868 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14/users/b11eb85688a44fb992995321f605104f/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:09.563169 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438937a-3488-4d44-a3f9-35c2dea6b868 None admin] RBAC: Authorizing `identity:create_grant(project_id=8600563b295742f1a8d5ba26a2a51f14, user_id=b11eb85688a44fb992995321f605104f, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:09.564663 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438937a-3488-4d44-a3f9-35c2dea6b868 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:09.652260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 66/134] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:04:09 2022] PUT /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14/users/6a85b2f060664557b1c1e38cb4a7b74d/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:09.661347 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d8a48-e17f-41f5-ae16-1965b7c75f17 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:09.681713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 69/135] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:04:09 2022] PUT /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14/users/b11eb85688a44fb992995321f605104f/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:09.692582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9c1ff-42b4-49a2-b62e-ca2f34d93f76 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:09.694217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9c1ff-42b4-49a2-b62e-ca2f34d93f76 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:09.694831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9c1ff-42b4-49a2-b62e-ca2f34d93f76 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:09.696654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 70/136] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:09.705500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b214-b713-4350-afd4-586feec45a85 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:09.706160 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b214-b713-4350-afd4-586feec45a85 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:09.706996 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b214-b713-4350-afd4-586feec45a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:09.762793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-49f4b214-b713-4350-afd4-586feec45a85 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:09.765733 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-49f4b214-b713-4350-afd4-586feec45a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:09.906166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d8a48-e17f-41f5-ae16-1965b7c75f17 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:09.917881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 71/137] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:09.925850 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:09.948965 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58fb43-834d-44c2-9fdd-6a33b050c2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:09.950238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58fb43-834d-44c2-9fdd-6a33b050c2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:09.950735 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58fb43-834d-44c2-9fdd-6a33b050c2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:09.951319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58fb43-834d-44c2-9fdd-6a33b050c2e9 None admin] PATH_INFO: `/v3/projects/53ab73e8b51a4f81990c14b460d8188c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:09.952302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4b214-b713-4350-afd4-586feec45a85 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:09.953121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58fb43-834d-44c2-9fdd-6a33b050c2e9 None admin] RBAC: Authorizing `identity:get_project(project_id=53ab73e8b51a4f81990c14b460d8188c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:09.955036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58fb43-834d-44c2-9fdd-6a33b050c2e9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:09.957165 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 67/138] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:09 2022] GET /identity/v3/projects/53ab73e8b51a4f81990c14b460d8188c => generated 312 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:09.963391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58fb43-834d-44c2-9fdd-6a33b050c2e9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:10.086467 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4b214-b713-4350-afd4-586feec45a85 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:10.087981 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:10.091606 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58fb43-834d-44c2-9fdd-6a33b050c2e9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:10.131494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c85eaa-1ad3-4b8d-8b01-fe407bd8da90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:10.132347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c85eaa-1ad3-4b8d-8b01-fe407bd8da90 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:10.132626 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c85eaa-1ad3-4b8d-8b01-fe407bd8da90 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:10.132898 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c85eaa-1ad3-4b8d-8b01-fe407bd8da90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:10.134213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c85eaa-1ad3-4b8d-8b01-fe407bd8da90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:10.135686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c85eaa-1ad3-4b8d-8b01-fe407bd8da90 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:10.137370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 72/139] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:10.145351 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c85eaa-1ad3-4b8d-8b01-fe407bd8da90 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:10.160977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab224c2-64a9-46d6-925a-21101638cfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:10.161877 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab224c2-64a9-46d6-925a-21101638cfa5 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:10.162161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab224c2-64a9-46d6-925a-21101638cfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:10.162437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab224c2-64a9-46d6-925a-21101638cfa5 None admin] PATH_INFO: `/v3/projects/53ab73e8b51a4f81990c14b460d8188c/users/b11eb85688a44fb992995321f605104f/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:10.166803 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab224c2-64a9-46d6-925a-21101638cfa5 None admin] RBAC: Authorizing `identity:create_grant(project_id=53ab73e8b51a4f81990c14b460d8188c, user_id=b11eb85688a44fb992995321f605104f, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:10.168830 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab224c2-64a9-46d6-925a-21101638cfa5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:10.231669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 68/140] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:04:09 2022] PUT /identity/v3/projects/53ab73e8b51a4f81990c14b460d8188c/users/b11eb85688a44fb992995321f605104f/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:10.306809 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c85eaa-1ad3-4b8d-8b01-fe407bd8da90 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:10.352510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cc09d-5f10-4a2f-b53c-6c723b677a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:10.353220 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cc09d-5f10-4a2f-b53c-6c723b677a50 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:10.353503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cc09d-5f10-4a2f-b53c-6c723b677a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:10.353778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cc09d-5f10-4a2f-b53c-6c723b677a50 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:10.354535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656cc09d-5f10-4a2f-b53c-6c723b677a50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:10.356168 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656cc09d-5f10-4a2f-b53c-6c723b677a50 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:10.461634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 73/141] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:04:10 2022] POST /identity/v3/users => generated 283 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:04:11.401236 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2e732-f00a-4e24-be62-c2a48f98dce7 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:11.401728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2e732-f00a-4e24-be62-c2a48f98dce7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:11.401801 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2e732-f00a-4e24-be62-c2a48f98dce7 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:11.403549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 69/142] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:11.408513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdb926-6a20-4cdc-ba43-c4a44dee5f77 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:11.409185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdb926-6a20-4cdc-ba43-c4a44dee5f77 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:11.409349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdb926-6a20-4cdc-ba43-c4a44dee5f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:11.409752 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f5a9f-06aa-43f1-af30-879ae45c7d9d None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:11.410051 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f5a9f-06aa-43f1-af30-879ae45c7d9d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:11.410339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f5a9f-06aa-43f1-af30-879ae45c7d9d None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:11.411661 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 70/143] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:11.428909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-73bdb926-6a20-4cdc-ba43-c4a44dee5f77 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:11.429599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1629c7-3055-439c-98a3-2ca471bf30bf None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:11.429894 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1629c7-3055-439c-98a3-2ca471bf30bf None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:11.430112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-73bdb926-6a20-4cdc-ba43-c4a44dee5f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:11.430215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1629c7-3055-439c-98a3-2ca471bf30bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:11.462520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:11.465038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4e1629c7-3055-439c-98a3-2ca471bf30bf None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:11.466279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4e1629c7-3055-439c-98a3-2ca471bf30bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:11.516394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:11.553722 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 71/144] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:11.556820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 74/145] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:11.581551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1629c7-3055-439c-98a3-2ca471bf30bf None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:11.606302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdb926-6a20-4cdc-ba43-c4a44dee5f77 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:11.774001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1629c7-3055-439c-98a3-2ca471bf30bf None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:11.801360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdb926-6a20-4cdc-ba43-c4a44dee5f77 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:11.855517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ca31a-062b-4281-a966-1ed28d3ef685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:11.856367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ca31a-062b-4281-a966-1ed28d3ef685 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:11.856654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ca31a-062b-4281-a966-1ed28d3ef685 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:11.857300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ca31a-062b-4281-a966-1ed28d3ef685 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:11.870494 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9f975-ba12-40f7-ae25-b7ade8e7c8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:11.871320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9f975-ba12-40f7-ae25-b7ade8e7c8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:11.871605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9f975-ba12-40f7-ae25-b7ade8e7c8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:11.871878 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9f975-ba12-40f7-ae25-b7ade8e7c8d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:11.878059 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ca31a-062b-4281-a966-1ed28d3ef685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c35ca31a-062b-4281-a966-1ed28d3ef685 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:11.886449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:11.888679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:11.891124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:11.891124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:11.891124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:11.891124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:11.891124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:11.891124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:11.891124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:11.891124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:11.891124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:11.891124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:11.891124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:11.891124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:11.893460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 75/146] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:11.896153 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ca31a-062b-4281-a966-1ed28d3ef685 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:11.904411 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9f975-ba12-40f7-ae25-b7ade8e7c8d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-7ef9f975-ba12-40f7-ae25-b7ade8e7c8d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:11.913373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:11.915391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:11.917308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:11.917308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:11.917308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:11.917308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:11.917308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:11.917308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:11.917308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:11.917308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:11.917308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:11.917308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:11.917308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:11.917308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:11.921231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:11.921947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 72/147] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:04:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:11.933063 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9f975-ba12-40f7-ae25-b7ade8e7c8d1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:12.016944 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:12.105503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ca31a-062b-4281-a966-1ed28d3ef685 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:12.146096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9f975-ba12-40f7-ae25-b7ade8e7c8d1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:12.185940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285760f-813b-4670-b672-6b275c95e8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:12.186264 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650783b3-fb9b-4d80-9a7f-e69539c54340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:12.186618 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285760f-813b-4670-b672-6b275c95e8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:12.186901 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285760f-813b-4670-b672-6b275c95e8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:12.187236 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285760f-813b-4670-b672-6b275c95e8d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:12.188396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650783b3-fb9b-4d80-9a7f-e69539c54340 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:12.188510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285760f-813b-4670-b672-6b275c95e8d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:12.188813 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285760f-813b-4670-b672-6b275c95e8d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:12.189187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650783b3-fb9b-4d80-9a7f-e69539c54340 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:12.189665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650783b3-fb9b-4d80-9a7f-e69539c54340 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:12.190198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285760f-813b-4670-b672-6b275c95e8d8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:12.190824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650783b3-fb9b-4d80-9a7f-e69539c54340 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:12.191332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650783b3-fb9b-4d80-9a7f-e69539c54340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:12.192956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650783b3-fb9b-4d80-9a7f-e69539c54340 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:12.199046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 73/148] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:12.204518 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285760f-813b-4670-b672-6b275c95e8d8 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:12.208721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 76/149] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:12.223421 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650783b3-fb9b-4d80-9a7f-e69539c54340 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:12.356357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:12.372025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285760f-813b-4670-b672-6b275c95e8d8 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:12.424022 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:12.424522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8368c-51a4-4f6f-be6b-c771de4cec13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:12.424522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8368c-51a4-4f6f-be6b-c771de4cec13 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:12.424522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8368c-51a4-4f6f-be6b-c771de4cec13 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:12.424522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8368c-51a4-4f6f-be6b-c771de4cec13 None admin] PATH_INFO: `/v3/users/b11eb85688a44fb992995321f605104f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:12.426968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8368c-51a4-4f6f-be6b-c771de4cec13 None admin] RBAC: Authorizing `identity:get_user(user_id=b11eb85688a44fb992995321f605104f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:12.428781 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8368c-51a4-4f6f-be6b-c771de4cec13 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:12.430230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 74/150] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:12 2022] GET /identity/v3/users/b11eb85688a44fb992995321f605104f => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:12.435487 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8368c-51a4-4f6f-be6b-c771de4cec13 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:12.441458 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650783b3-fb9b-4d80-9a7f-e69539c54340 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:12.499421 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fe065-4871-46ec-999e-8fa28295c7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:12.501233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe065-4871-46ec-999e-8fa28295c7de None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:12.501694 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe065-4871-46ec-999e-8fa28295c7de None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:12.502171 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe065-4871-46ec-999e-8fa28295c7de None admin] PATH_INFO: `/v3/users/743c68a9a91f43d7807f368ece026412` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:12.503572 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fe065-4871-46ec-999e-8fa28295c7de None admin] RBAC: Authorizing `identity:get_user(user_id=743c68a9a91f43d7807f368ece026412)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:12.505256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fe065-4871-46ec-999e-8fa28295c7de None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:12.508020 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 77/151] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:12 2022] GET /identity/v3/users/743c68a9a91f43d7807f368ece026412 => generated 289 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:12.517126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fe065-4871-46ec-999e-8fa28295c7de None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:12.551428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8368c-51a4-4f6f-be6b-c771de4cec13 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:12.608795 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2fa7c-a4c0-4933-92f4-fca9739bb56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:12.610272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2fa7c-a4c0-4933-92f4-fca9739bb56f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:12.610735 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2fa7c-a4c0-4933-92f4-fca9739bb56f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:12.611191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2fa7c-a4c0-4933-92f4-fca9739bb56f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:12.668041 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:12.668850 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fe065-4871-46ec-999e-8fa28295c7de None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:12.707362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2fa7c-a4c0-4933-92f4-fca9739bb56f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:12.709172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2fa7c-a4c0-4933-92f4-fca9739bb56f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:12.723417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20aba6-fcf4-4ab8-b474-14a58659a05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:12.724687 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20aba6-fcf4-4ab8-b474-14a58659a05d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:12.725169 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20aba6-fcf4-4ab8-b474-14a58659a05d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:12.725621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20aba6-fcf4-4ab8-b474-14a58659a05d None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:12.727014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20aba6-fcf4-4ab8-b474-14a58659a05d None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:12.728772 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20aba6-fcf4-4ab8-b474-14a58659a05d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:12.735197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 78/152] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:12 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:12.736737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70305a-088f-4cef-9438-fe6b89ae4616 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:12.737206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70305a-088f-4cef-9438-fe6b89ae4616 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:12.737660 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70305a-088f-4cef-9438-fe6b89ae4616 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:12.739113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 79/153] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:12.740025 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70305a-088f-4cef-9438-fe6b89ae4616 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:12.764361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:12.863398 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 75/154] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:04:12.865003 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41262939-efa7-44ee-b767-14380707ba1c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:12.865666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41262939-efa7-44ee-b767-14380707ba1c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:12.866136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41262939-efa7-44ee-b767-14380707ba1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:12.898383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-41262939-efa7-44ee-b767-14380707ba1c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:12.899603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70305a-088f-4cef-9438-fe6b89ae4616 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:12.900145 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-41262939-efa7-44ee-b767-14380707ba1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:12.961607 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad1e17-63c2-405a-9295-f9bf4890617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:12.962755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad1e17-63c2-405a-9295-f9bf4890617c None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:12.963238 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad1e17-63c2-405a-9295-f9bf4890617c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:12.963707 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad1e17-63c2-405a-9295-f9bf4890617c None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14/users/743c68a9a91f43d7807f368ece026412/roles/e3482518249a452d8c02c7d2d16f19dc` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:12.965908 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad1e17-63c2-405a-9295-f9bf4890617c None admin] RBAC: Authorizing `identity:create_grant(project_id=8600563b295742f1a8d5ba26a2a51f14, user_id=743c68a9a91f43d7807f368ece026412, role_id=e3482518249a452d8c02c7d2d16f19dc)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:12.967536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad1e17-63c2-405a-9295-f9bf4890617c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:13.016397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:13.027817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 76/155] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:13.028791 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41262939-efa7-44ee-b767-14380707ba1c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:13.052350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 80/156] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:04:12 2022] PUT /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14/users/743c68a9a91f43d7807f368ece026412/roles/e3482518249a452d8c02c7d2d16f19dc => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:13.086562 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad1e17-63c2-405a-9295-f9bf4890617c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:13.173743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41262939-efa7-44ee-b767-14380707ba1c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:13.218324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:13.221780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a1d13-4f6f-47d7-905b-21d5adc8616f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:13.222872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1d13-4f6f-47d7-905b-21d5adc8616f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:13.223304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1d13-4f6f-47d7-905b-21d5adc8616f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:13.223724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1d13-4f6f-47d7-905b-21d5adc8616f None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:13.227424 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a1d13-4f6f-47d7-905b-21d5adc8616f None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:13.229331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a1d13-4f6f-47d7-905b-21d5adc8616f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:13.231613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 77/157] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:13 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:13.238112 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a1d13-4f6f-47d7-905b-21d5adc8616f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:13.249019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad1e17-63c2-405a-9295-f9bf4890617c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:13.305659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a2648-5813-4d2d-b3e5-a4cc10ee270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:13.306713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a2648-5813-4d2d-b3e5-a4cc10ee270f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:13.306946 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a2648-5813-4d2d-b3e5-a4cc10ee270f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:13.307295 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a2648-5813-4d2d-b3e5-a4cc10ee270f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:13.329391 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a2648-5813-4d2d-b3e5-a4cc10ee270f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-932a2648-5813-4d2d-b3e5-a4cc10ee270f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:13.337347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:13.338466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:13.339449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:13.339449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:13.339449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:13.339449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:13.339449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:13.339449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:13.339449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:13.339449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:13.339449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:13.339449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:13.339449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:13.339449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:13.340855 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 81/158] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:04:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:13.352024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a2648-5813-4d2d-b3e5-a4cc10ee270f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:13.396414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:13.424796 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a1d13-4f6f-47d7-905b-21d5adc8616f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:13.468544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b15921-4750-4bfc-8943-6e0114e3b5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:13.469977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b15921-4750-4bfc-8943-6e0114e3b5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:13.470415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b15921-4750-4bfc-8943-6e0114e3b5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:13.471240 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b15921-4750-4bfc-8943-6e0114e3b5f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:13.472336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b15921-4750-4bfc-8943-6e0114e3b5f3 None admin] RBAC: Adding query filter params (role.id=282334a450b54dedb0b42d678d231caf, scope.project.id=8600563b295742f1a8d5ba26a2a51f14, user.id=b11eb85688a44fb992995321f605104f) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:13.472793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b15921-4750-4bfc-8943-6e0114e3b5f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:13.474409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b15921-4750-4bfc-8943-6e0114e3b5f3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:13.485041 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 78/159] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:13 2022] GET /identity/v3/role_assignments?user.id=b11eb85688a44fb992995321f605104f&scope.project.id=8600563b295742f1a8d5ba26a2a51f14&role.id=282334a450b54dedb0b42d678d231caf => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:13.504635 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a2648-5813-4d2d-b3e5-a4cc10ee270f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:13.579058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30649f96-9f8a-4bce-8b4a-cf9d58f3fe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:13.579762 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30649f96-9f8a-4bce-8b4a-cf9d58f3fe50 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:13.580077 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30649f96-9f8a-4bce-8b4a-cf9d58f3fe50 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:13.580361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30649f96-9f8a-4bce-8b4a-cf9d58f3fe50 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:13.581131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30649f96-9f8a-4bce-8b4a-cf9d58f3fe50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:13.581442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30649f96-9f8a-4bce-8b4a-cf9d58f3fe50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:13.582894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30649f96-9f8a-4bce-8b4a-cf9d58f3fe50 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:13.584680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:13.596709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 82/160] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:13.602560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b15921-4750-4bfc-8943-6e0114e3b5f3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:13.746054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b15921-4750-4bfc-8943-6e0114e3b5f3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:13.781869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:13.792877 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b686a11-367b-4198-9944-f14b834e38e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:13.793772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b686a11-367b-4198-9944-f14b834e38e8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:13.794155 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b686a11-367b-4198-9944-f14b834e38e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:13.794350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b686a11-367b-4198-9944-f14b834e38e8 None admin] PATH_INFO: `/v3/users/6a85b2f060664557b1c1e38cb4a7b74d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:13.795572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b686a11-367b-4198-9944-f14b834e38e8 None admin] RBAC: Authorizing `identity:get_user(user_id=6a85b2f060664557b1c1e38cb4a7b74d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:13.797121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b686a11-367b-4198-9944-f14b834e38e8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:13.799176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 79/161] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:13 2022] GET /identity/v3/users/6a85b2f060664557b1c1e38cb4a7b74d => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:13.804342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30649f96-9f8a-4bce-8b4a-cf9d58f3fe50 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:13.962772 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30649f96-9f8a-4bce-8b4a-cf9d58f3fe50 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:14.003076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093571e-3881-4181-ab67-1665e749a707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:14.003650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093571e-3881-4181-ab67-1665e749a707 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:14.003935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093571e-3881-4181-ab67-1665e749a707 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:14.004256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093571e-3881-4181-ab67-1665e749a707 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:14.074796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:14.082420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093571e-3881-4181-ab67-1665e749a707 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:14.084105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093571e-3881-4181-ab67-1665e749a707 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:14.128062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038be60-6131-4b8e-8598-2fcafbbb8eba None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:14.128062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038be60-6131-4b8e-8598-2fcafbbb8eba None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:14.128062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038be60-6131-4b8e-8598-2fcafbbb8eba None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:14.128062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 80/162] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:04:14.137432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825cb2e-b8d6-4c48-af7b-2e0607f7ad6a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:14.137715 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825cb2e-b8d6-4c48-af7b-2e0607f7ad6a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:14.137990 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825cb2e-b8d6-4c48-af7b-2e0607f7ad6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:14.173030 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c825cb2e-b8d6-4c48-af7b-2e0607f7ad6a None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:14.174230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c825cb2e-b8d6-4c48-af7b-2e0607f7ad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:14.225716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 83/163] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:14.232623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093571e-3881-4181-ab67-1665e749a707 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:14.342800 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 81/164] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:14.380811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825cb2e-b8d6-4c48-af7b-2e0607f7ad6a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:14.397730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:14.408818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093571e-3881-4181-ab67-1665e749a707 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:14.464791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef44ed-82d3-47a6-9605-a4d3471b7ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:14.465679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef44ed-82d3-47a6-9605-a4d3471b7ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:14.465951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef44ed-82d3-47a6-9605-a4d3471b7ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:14.466229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef44ed-82d3-47a6-9605-a4d3471b7ce4 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:14.470891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef44ed-82d3-47a6-9605-a4d3471b7ce4 None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:14.472432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef44ed-82d3-47a6-9605-a4d3471b7ce4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:14.474503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 84/165] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:14 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:14.475736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3f89-b1ad-4a28-bf27-e7cd31c51c93 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:14.476038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3f89-b1ad-4a28-bf27-e7cd31c51c93 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:14.476321 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3f89-b1ad-4a28-bf27-e7cd31c51c93 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:14.477700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 85/166] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:14.483418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c39420-453d-4c9c-b570-2dcde3f2603d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:14.483877 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c39420-453d-4c9c-b570-2dcde3f2603d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:14.484407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c39420-453d-4c9c-b570-2dcde3f2603d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:14.513042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d8c39420-453d-4c9c-b570-2dcde3f2603d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:14.514248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d8c39420-453d-4c9c-b570-2dcde3f2603d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:14.642269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825cb2e-b8d6-4c48-af7b-2e0607f7ad6a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:14.669983 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 86/167] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:14.670961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c39420-453d-4c9c-b570-2dcde3f2603d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:14.696393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:14.760719 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bc18c-7c9f-48a2-a715-2facd154c6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:14.761836 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bc18c-7c9f-48a2-a715-2facd154c6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:14.762296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bc18c-7c9f-48a2-a715-2facd154c6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:14.762782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bc18c-7c9f-48a2-a715-2facd154c6c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:14.804908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bc18c-7c9f-48a2-a715-2facd154c6c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-0e0bc18c-7c9f-48a2-a715-2facd154c6c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:14.813527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:14.814524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:14.815376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:14.815376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:14.815376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:14.815376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:14.815376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:14.815376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:14.815376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:14.815376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:14.815376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:14.815376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:14.815376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:14.815376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:14.817841 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 82/168] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:14.819395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:14.819980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bc18c-7c9f-48a2-a715-2facd154c6c7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:14.823499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c39420-453d-4c9c-b570-2dcde3f2603d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:14.865901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfa04c-fb41-4001-996c-5d3e471df6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:14.866578 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfa04c-fb41-4001-996c-5d3e471df6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:14.866861 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfa04c-fb41-4001-996c-5d3e471df6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:14.867135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfa04c-fb41-4001-996c-5d3e471df6a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:14.867988 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfa04c-fb41-4001-996c-5d3e471df6a4 None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=8600563b295742f1a8d5ba26a2a51f14, user.id=6a85b2f060664557b1c1e38cb4a7b74d) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:14.868322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfa04c-fb41-4001-996c-5d3e471df6a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:14.869783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfa04c-fb41-4001-996c-5d3e471df6a4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:14.876589 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 87/169] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:14 2022] GET /identity/v3/role_assignments?user.id=6a85b2f060664557b1c1e38cb4a7b74d&scope.project.id=8600563b295742f1a8d5ba26a2a51f14&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:14.877558 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfa04c-fb41-4001-996c-5d3e471df6a4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:15.074599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bc18c-7c9f-48a2-a715-2facd154c6c7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:15.086070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfa04c-fb41-4001-996c-5d3e471df6a4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:15.142685 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc5741-f03f-47c4-aa4d-a26d3d68675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:15.143509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc5741-f03f-47c4-aa4d-a26d3d68675d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:15.143791 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc5741-f03f-47c4-aa4d-a26d3d68675d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:15.144085 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc5741-f03f-47c4-aa4d-a26d3d68675d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:15.145219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d156a9d-b8de-4a3e-9520-fa2a00f1d099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:15.145895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d156a9d-b8de-4a3e-9520-fa2a00f1d099 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:15.146171 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d156a9d-b8de-4a3e-9520-fa2a00f1d099 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:15.146437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d156a9d-b8de-4a3e-9520-fa2a00f1d099 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:15.147201 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d156a9d-b8de-4a3e-9520-fa2a00f1d099 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:15.147501 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d156a9d-b8de-4a3e-9520-fa2a00f1d099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:15.148920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d156a9d-b8de-4a3e-9520-fa2a00f1d099 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:15.168031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc5741-f03f-47c4-aa4d-a26d3d68675d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:15.172411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 88/170] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:15.173296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d156a9d-b8de-4a3e-9520-fa2a00f1d099 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-13cc5741-f03f-47c4-aa4d-a26d3d68675d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:15.178172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:15.179102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:15.179903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:15.179903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:15.179903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:15.179903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:15.179903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:15.179903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:15.179903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:15.179903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:15.179903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:15.179903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:15.179903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:15.179903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:15.179903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 83/171] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:15.188679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc5741-f03f-47c4-aa4d-a26d3d68675d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:15.216206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:15.281918 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:15.348028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc5741-f03f-47c4-aa4d-a26d3d68675d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:15.348886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d156a9d-b8de-4a3e-9520-fa2a00f1d099 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:15.382265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40d73b-7f19-49ab-afd2-3bd341570578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:15.382944 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40d73b-7f19-49ab-afd2-3bd341570578 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:15.383231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40d73b-7f19-49ab-afd2-3bd341570578 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:15.383507 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40d73b-7f19-49ab-afd2-3bd341570578 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:15.384504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40d73b-7f19-49ab-afd2-3bd341570578 None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:15.384611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40d73b-7f19-49ab-afd2-3bd341570578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:15.386046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40d73b-7f19-49ab-afd2-3bd341570578 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:15.395153 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 84/172] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:15.396470 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d354de4-3fc9-493b-9cb1-8357f282a81a None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:15.396787 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d354de4-3fc9-493b-9cb1-8357f282a81a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:15.397033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d354de4-3fc9-493b-9cb1-8357f282a81a None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:15.398273 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 85/173] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:15.399373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfe986-6163-46ad-9dd7-1011d2689f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:15.400598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfe986-6163-46ad-9dd7-1011d2689f4e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:15.401096 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfe986-6163-46ad-9dd7-1011d2689f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:15.401566 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfe986-6163-46ad-9dd7-1011d2689f4e None admin] PATH_INFO: `/v3/users/b11eb85688a44fb992995321f605104f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:15.403078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfe986-6163-46ad-9dd7-1011d2689f4e None admin] RBAC: Authorizing `identity:get_user(user_id=b11eb85688a44fb992995321f605104f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:15.404521 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8975-6692-4db5-a5fd-783b78e57610 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:15.404862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8975-6692-4db5-a5fd-783b78e57610 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:15.405141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8975-6692-4db5-a5fd-783b78e57610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:15.405508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfe986-6163-46ad-9dd7-1011d2689f4e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:15.412537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 89/174] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:15 2022] GET /identity/v3/users/b11eb85688a44fb992995321f605104f => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:15.413716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfe986-6163-46ad-9dd7-1011d2689f4e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:15.437105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e60b8975-6692-4db5-a5fd-783b78e57610 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:15.438343 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e60b8975-6692-4db5-a5fd-783b78e57610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:15.519536 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 86/175] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:15.524928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b8975-6692-4db5-a5fd-783b78e57610 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:15.536735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfe986-6163-46ad-9dd7-1011d2689f4e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:15.540321 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:15.596467 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:15.603751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a93033-e2d4-4dd6-a003-2169f0964d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:15.604625 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a93033-e2d4-4dd6-a003-2169f0964d69 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:15.604910 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a93033-e2d4-4dd6-a003-2169f0964d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:15.605261 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a93033-e2d4-4dd6-a003-2169f0964d69 None admin] PATH_INFO: `/v3/users/b11eb85688a44fb992995321f605104f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:15.608085 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a93033-e2d4-4dd6-a003-2169f0964d69 None admin] RBAC: Authorizing `identity:get_user(user_id=b11eb85688a44fb992995321f605104f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:15.610121 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a93033-e2d4-4dd6-a003-2169f0964d69 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:15.611949 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 90/176] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:15 2022] GET /identity/v3/users/b11eb85688a44fb992995321f605104f => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:15.613379 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a93033-e2d4-4dd6-a003-2169f0964d69 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:15.708258 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b8975-6692-4db5-a5fd-783b78e57610 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:15.730451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a93033-e2d4-4dd6-a003-2169f0964d69 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:15.751759 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ad10f-ca60-4159-a2ac-232470fe5184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:15.752472 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ad10f-ca60-4159-a2ac-232470fe5184 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:15.753045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ad10f-ca60-4159-a2ac-232470fe5184 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:15.753328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ad10f-ca60-4159-a2ac-232470fe5184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:15.766952 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b72dfe-2d84-4b39-86a5-83b886cfa0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:15.767956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72dfe-2d84-4b39-86a5-83b886cfa0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:15.768337 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72dfe-2d84-4b39-86a5-83b886cfa0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:15.768683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72dfe-2d84-4b39-86a5-83b886cfa0c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:15.779582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b72dfe-2d84-4b39-86a5-83b886cfa0c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c2b72dfe-2d84-4b39-86a5-83b886cfa0c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:15.788542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:15.789493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:15.790290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:15.790290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:15.790290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:15.790290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:15.790290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:15.790290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:15.790290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:15.790290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:15.790290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:15.790290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:15.790290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:15.790290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:15.790290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 91/177] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:04:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:15.795256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b72dfe-2d84-4b39-86a5-83b886cfa0c8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:15.816008 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:15.843113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ad10f-ca60-4159-a2ac-232470fe5184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:15.844827 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ad10f-ca60-4159-a2ac-232470fe5184 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:15.895509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:15.908113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b72dfe-2d84-4b39-86a5-83b886cfa0c8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:15.944450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939ce8a-6b45-4a0f-9ebd-46aef002deb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:15.945110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939ce8a-6b45-4a0f-9ebd-46aef002deb5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:15.945400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939ce8a-6b45-4a0f-9ebd-46aef002deb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:15.945673 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939ce8a-6b45-4a0f-9ebd-46aef002deb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:15.971197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 87/178] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:15.976954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d59d1-fef6-4667-9699-83553edb64cf None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:15.977248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d59d1-fef6-4667-9699-83553edb64cf None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:15.977530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d59d1-fef6-4667-9699-83553edb64cf None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:15.978974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 88/179] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:15.979576 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d59d1-fef6-4667-9699-83553edb64cf None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:16.020497 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939ce8a-6b45-4a0f-9ebd-46aef002deb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:16.021959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939ce8a-6b45-4a0f-9ebd-46aef002deb5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:16.040603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:16.101482 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d59d1-fef6-4667-9699-83553edb64cf None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:16.134655 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 92/180] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:16.135987 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f96eb4-36d5-4b91-97ef-f7718cbb33bb None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:16.136305 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f96eb4-36d5-4b91-97ef-f7718cbb33bb None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:16.136577 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f96eb4-36d5-4b91-97ef-f7718cbb33bb None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:16.137745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15ea7e-24e3-47ca-8972-7ce6e11e9432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:16.138424 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15ea7e-24e3-47ca-8972-7ce6e11e9432 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:16.138706 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15ea7e-24e3-47ca-8972-7ce6e11e9432 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:16.139255 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15ea7e-24e3-47ca-8972-7ce6e11e9432 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:16.139847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15ea7e-24e3-47ca-8972-7ce6e11e9432 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:16.140186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15ea7e-24e3-47ca-8972-7ce6e11e9432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:16.141935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15ea7e-24e3-47ca-8972-7ce6e11e9432 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:16.142052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 93/181] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:16.142729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f96eb4-36d5-4b91-97ef-f7718cbb33bb None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:16.143453 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:16.151182 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 89/182] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:16.153392 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46898060-14a9-43a4-85fb-29641c0f09cb None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:16.163298 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46898060-14a9-43a4-85fb-29641c0f09cb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:16.163298 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46898060-14a9-43a4-85fb-29641c0f09cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:16.173052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-46898060-14a9-43a4-85fb-29641c0f09cb None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:16.174572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-46898060-14a9-43a4-85fb-29641c0f09cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:16.244280 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 90/183] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:16.245403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46898060-14a9-43a4-85fb-29641c0f09cb None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:16.276980 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f96eb4-36d5-4b91-97ef-f7718cbb33bb None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:16.298437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:16.317282 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a565ff-21c6-402f-82de-cf2c22b869c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:16.318139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a565ff-21c6-402f-82de-cf2c22b869c3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:16.318426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a565ff-21c6-402f-82de-cf2c22b869c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:16.318693 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a565ff-21c6-402f-82de-cf2c22b869c3 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:16.320061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a565ff-21c6-402f-82de-cf2c22b869c3 None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:16.321468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a565ff-21c6-402f-82de-cf2c22b869c3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:16.323337 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 94/184] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:16 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:16.324344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76308996-0404-4f44-ab22-9d94e03c4d8b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:16.324627 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76308996-0404-4f44-ab22-9d94e03c4d8b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:16.324903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76308996-0404-4f44-ab22-9d94e03c4d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:16.343086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-76308996-0404-4f44-ab22-9d94e03c4d8b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:16.344848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-76308996-0404-4f44-ab22-9d94e03c4d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:16.362509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46898060-14a9-43a4-85fb-29641c0f09cb None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:16.387687 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:16.396755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17c349-5f5f-4f52-b655-2094c8815047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:16.397615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17c349-5f5f-4f52-b655-2094c8815047 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:16.397905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17c349-5f5f-4f52-b655-2094c8815047 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:16.399530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17c349-5f5f-4f52-b655-2094c8815047 None admin] PATH_INFO: `/v3/projects/53ab73e8b51a4f81990c14b460d8188c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:16.399530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17c349-5f5f-4f52-b655-2094c8815047 None admin] RBAC: Authorizing `identity:get_project(project_id=53ab73e8b51a4f81990c14b460d8188c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:16.400913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17c349-5f5f-4f52-b655-2094c8815047 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:16.402678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 91/185] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:16 2022] GET /identity/v3/projects/53ab73e8b51a4f81990c14b460d8188c => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:16.403379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17c349-5f5f-4f52-b655-2094c8815047 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:16.412430 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 95/186] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:16.415382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76308996-0404-4f44-ab22-9d94e03c4d8b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:16.506515 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17c349-5f5f-4f52-b655-2094c8815047 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:16.529988 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76308996-0404-4f44-ab22-9d94e03c4d8b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:16.544727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f30be7-4236-4892-9049-f8f17a8cd066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:16.545380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:16.545826 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f30be7-4236-4892-9049-f8f17a8cd066 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:16.545916 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f30be7-4236-4892-9049-f8f17a8cd066 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:16.546116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f30be7-4236-4892-9049-f8f17a8cd066 None admin] PATH_INFO: `/v3/users/b424af7d7c54488e93781e65d3b13eaf` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:16.559474 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f30be7-4236-4892-9049-f8f17a8cd066 None admin] RBAC: Authorizing `identity:get_user(user_id=b424af7d7c54488e93781e65d3b13eaf)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:16.561057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f30be7-4236-4892-9049-f8f17a8cd066 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:16.563219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 92/187] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:16 2022] GET /identity/v3/users/b424af7d7c54488e93781e65d3b13eaf => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:16.563741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f30be7-4236-4892-9049-f8f17a8cd066 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:16.565092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc05c8-9dd4-4f6c-a723-8e4d0453e75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:16.565906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc05c8-9dd4-4f6c-a723-8e4d0453e75b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:16.566194 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc05c8-9dd4-4f6c-a723-8e4d0453e75b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:16.566481 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc05c8-9dd4-4f6c-a723-8e4d0453e75b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:16.576842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc05c8-9dd4-4f6c-a723-8e4d0453e75b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-76dc05c8-9dd4-4f6c-a723-8e4d0453e75b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:16.585838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:16.593253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:16.595048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:16.595048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:16.595048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:16.595048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:16.595048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:16.595048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:16.595048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:16.595048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:16.595048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:16.595048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:16.595048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:16.595048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:16.595048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 96/188] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:04:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:16.595048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2bb2-b2f6-4c26-8a95-fb658c47e850 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:16.595952 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2bb2-b2f6-4c26-8a95-fb658c47e850 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:16.595952 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2bb2-b2f6-4c26-8a95-fb658c47e850 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:16.595952 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 97/189] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:16.595952 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e2bb2-b2f6-4c26-8a95-fb658c47e850 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:16.627904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:16.675153 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f30be7-4236-4892-9049-f8f17a8cd066 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:16.693642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e2bb2-b2f6-4c26-8a95-fb658c47e850 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:16.708605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1bbe9-b249-4351-ae75-bcdf3601038a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:16.709267 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1bbe9-b249-4351-ae75-bcdf3601038a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:16.709553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1bbe9-b249-4351-ae75-bcdf3601038a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:16.709831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1bbe9-b249-4351-ae75-bcdf3601038a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:16.710669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1bbe9-b249-4351-ae75-bcdf3601038a None admin] RBAC: Adding query filter params (role.id=d47bb3db22444385b7884acbc7e21b0f, scope.project.id=8600563b295742f1a8d5ba26a2a51f14, user.id=b11eb85688a44fb992995321f605104f) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:16.710982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1bbe9-b249-4351-ae75-bcdf3601038a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:16.712478 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1bbe9-b249-4351-ae75-bcdf3601038a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:16.718324 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 93/190] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:16 2022] GET /identity/v3/role_assignments?user.id=b11eb85688a44fb992995321f605104f&scope.project.id=8600563b295742f1a8d5ba26a2a51f14&role.id=d47bb3db22444385b7884acbc7e21b0f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:16.719166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1bbe9-b249-4351-ae75-bcdf3601038a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:16.728743 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519ddb5-d79e-41c5-95ee-cdbac2c0c75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:16.729420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519ddb5-d79e-41c5-95ee-cdbac2c0c75e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:16.729698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519ddb5-d79e-41c5-95ee-cdbac2c0c75e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:16.729969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519ddb5-d79e-41c5-95ee-cdbac2c0c75e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:16.730828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519ddb5-d79e-41c5-95ee-cdbac2c0c75e None admin] RBAC: Adding query filter params (role.id=d47bb3db22444385b7884acbc7e21b0f, scope.project.id=53ab73e8b51a4f81990c14b460d8188c, user.id=b11eb85688a44fb992995321f605104f) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:16.731140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519ddb5-d79e-41c5-95ee-cdbac2c0c75e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:16.732718 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519ddb5-d79e-41c5-95ee-cdbac2c0c75e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:16.748327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 98/191] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:16 2022] GET /identity/v3/role_assignments?user.id=b11eb85688a44fb992995321f605104f&scope.project.id=53ab73e8b51a4f81990c14b460d8188c&role.id=d47bb3db22444385b7884acbc7e21b0f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:16.748327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519ddb5-d79e-41c5-95ee-cdbac2c0c75e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:16.816226 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:16.859775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1bbe9-b249-4351-ae75-bcdf3601038a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:16.880285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:16.907951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519ddb5-d79e-41c5-95ee-cdbac2c0c75e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:16.909586 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183295b-7e8c-4c9b-b22c-41f42fb9ae68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:16.910411 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183295b-7e8c-4c9b-b22c-41f42fb9ae68 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:16.910692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183295b-7e8c-4c9b-b22c-41f42fb9ae68 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:16.910961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183295b-7e8c-4c9b-b22c-41f42fb9ae68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:16.912650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183295b-7e8c-4c9b-b22c-41f42fb9ae68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:16.915083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183295b-7e8c-4c9b-b22c-41f42fb9ae68 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:16.917632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 94/192] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:16.919394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183295b-7e8c-4c9b-b22c-41f42fb9ae68 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:16.961791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4fd89-8dcf-4f9e-834b-50edec2ecee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:16.962381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4fd89-8dcf-4f9e-834b-50edec2ecee4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:16.962876 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4fd89-8dcf-4f9e-834b-50edec2ecee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:16.962993 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4fd89-8dcf-4f9e-834b-50edec2ecee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:17.038046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183295b-7e8c-4c9b-b22c-41f42fb9ae68 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:17.040661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4fd89-8dcf-4f9e-834b-50edec2ecee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:17.042136 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4fd89-8dcf-4f9e-834b-50edec2ecee4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:17.073543 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde9282-ab0b-4ae3-863e-de305a133a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:17.074298 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde9282-ab0b-4ae3-863e-de305a133a1e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:17.074641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde9282-ab0b-4ae3-863e-de305a133a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:17.074920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde9282-ab0b-4ae3-863e-de305a133a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:17.075750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde9282-ab0b-4ae3-863e-de305a133a1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:17.076084 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde9282-ab0b-4ae3-863e-de305a133a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:17.077451 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde9282-ab0b-4ae3-863e-de305a133a1e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:17.083959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:17.086436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 95/193] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:17.087799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacc251-4468-4314-827a-951de4a7fcbc None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:17.088117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacc251-4468-4314-827a-951de4a7fcbc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:17.088389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacc251-4468-4314-827a-951de4a7fcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:17.104228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4cacc251-4468-4314-827a-951de4a7fcbc None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:17.105416 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4cacc251-4468-4314-827a-951de4a7fcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:17.147157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:17.150630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 99/194] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:17.151437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4fd89-8dcf-4f9e-834b-50edec2ecee4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:17.171458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 96/195] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:17.172828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacc251-4468-4314-827a-951de4a7fcbc None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:17.258481 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4fd89-8dcf-4f9e-834b-50edec2ecee4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:17.270005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacc251-4468-4314-827a-951de4a7fcbc None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:17.292224 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17dafd-63ca-4f6c-b4f4-b80e4f5a13c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:17.292891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17dafd-63ca-4f6c-b4f4-b80e4f5a13c9 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:17.293177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17dafd-63ca-4f6c-b4f4-b80e4f5a13c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:17.293450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17dafd-63ca-4f6c-b4f4-b80e4f5a13c9 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:17.294156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17dafd-63ca-4f6c-b4f4-b80e4f5a13c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:17.295602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17dafd-63ca-4f6c-b4f4-b80e4f5a13c9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:17.303689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513eb84-0bff-4512-a288-0cbf96a86f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:17.304583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513eb84-0bff-4512-a288-0cbf96a86f5f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:17.304864 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513eb84-0bff-4512-a288-0cbf96a86f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:17.305134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513eb84-0bff-4512-a288-0cbf96a86f5f None admin] PATH_INFO: `/v3/users/b424af7d7c54488e93781e65d3b13eaf` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:17.305275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:17.306315 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513eb84-0bff-4512-a288-0cbf96a86f5f None admin] RBAC: Authorizing `identity:get_user(user_id=b424af7d7c54488e93781e65d3b13eaf)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:17.307731 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513eb84-0bff-4512-a288-0cbf96a86f5f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:17.309384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 97/196] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:17 2022] GET /identity/v3/users/b424af7d7c54488e93781e65d3b13eaf => generated 283 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:17.314645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513eb84-0bff-4512-a288-0cbf96a86f5f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:17.353705 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:17.394944 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 100/197] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:04:17 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:04:17.407929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513eb84-0bff-4512-a288-0cbf96a86f5f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:17.409037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17dafd-63ca-4f6c-b4f4-b80e4f5a13c9 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:17.448277 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ed414-bc52-4772-82e8-a240fe341d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:17.449476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ed414-bc52-4772-82e8-a240fe341d7a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:17.449918 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ed414-bc52-4772-82e8-a240fe341d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:17.450200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ed414-bc52-4772-82e8-a240fe341d7a None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:17.451580 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ed414-bc52-4772-82e8-a240fe341d7a None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:17.453144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ed414-bc52-4772-82e8-a240fe341d7a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:17.455057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 98/198] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:17 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:17.455057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ed414-bc52-4772-82e8-a240fe341d7a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:17.536376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17dafd-63ca-4f6c-b4f4-b80e4f5a13c9 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:17.573309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ed414-bc52-4772-82e8-a240fe341d7a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:17.575734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d1785-4ee4-453f-9e57-6c4afebb2919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:17.577397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d1785-4ee4-453f-9e57-6c4afebb2919 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:17.577677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d1785-4ee4-453f-9e57-6c4afebb2919 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:17.577956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d1785-4ee4-453f-9e57-6c4afebb2919 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:17.589320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:17.590353 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d1785-4ee4-453f-9e57-6c4afebb2919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-6d8d1785-4ee4-453f-9e57-6c4afebb2919 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:17.598684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:17.599563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:17.600457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:17.600457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:17.600457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:17.600457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:17.600457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:17.600457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:17.600457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:17.600457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:17.600457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:17.600457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:17.600457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:17.600457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:17.600457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 101/199] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:17.601108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d1785-4ee4-453f-9e57-6c4afebb2919 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:17.615054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913480f3-21e4-40fd-b130-07d7c83721ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:17.616144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913480f3-21e4-40fd-b130-07d7c83721ea None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:17.616434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913480f3-21e4-40fd-b130-07d7c83721ea None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:17.616713 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913480f3-21e4-40fd-b130-07d7c83721ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:17.681777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:17.708112 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913480f3-21e4-40fd-b130-07d7c83721ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:17.709924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913480f3-21e4-40fd-b130-07d7c83721ea None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:17.740789 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d1785-4ee4-453f-9e57-6c4afebb2919 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:17.782761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38969797-4ddf-4136-a52a-a39550e78894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:17.783437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38969797-4ddf-4136-a52a-a39550e78894 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:17.783722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38969797-4ddf-4136-a52a-a39550e78894 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:17.784030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38969797-4ddf-4136-a52a-a39550e78894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:17.785131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38969797-4ddf-4136-a52a-a39550e78894 None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce, user.id=b424af7d7c54488e93781e65d3b13eaf) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:17.785448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38969797-4ddf-4136-a52a-a39550e78894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:17.787169 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38969797-4ddf-4136-a52a-a39550e78894 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:17.795157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 102/200] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:17 2022] GET /identity/v3/role_assignments?user.id=b424af7d7c54488e93781e65d3b13eaf&scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:17.795982 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38969797-4ddf-4136-a52a-a39550e78894 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:17.867161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 99/201] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:17.873807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913480f3-21e4-40fd-b130-07d7c83721ea None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:17.903175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:17.995809 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38969797-4ddf-4136-a52a-a39550e78894 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:18.002001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913480f3-21e4-40fd-b130-07d7c83721ea None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:18.037450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:18.049098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a39d28-e73d-4212-b7c8-10dc24a97bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:18.050497 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a39d28-e73d-4212-b7c8-10dc24a97bed None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:18.050972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a39d28-e73d-4212-b7c8-10dc24a97bed None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:18.051436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a39d28-e73d-4212-b7c8-10dc24a97bed None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:18.056360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a39d28-e73d-4212-b7c8-10dc24a97bed None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:18.060488 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a39d28-e73d-4212-b7c8-10dc24a97bed None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:18.062868 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 100/202] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:17 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:18.068807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a39d28-e73d-4212-b7c8-10dc24a97bed None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:18.089279 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3e99a-ef74-4d18-b116-ab800a3cbb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:18.090029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3e99a-ef74-4d18-b116-ab800a3cbb1a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:18.090314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3e99a-ef74-4d18-b116-ab800a3cbb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:18.090591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3e99a-ef74-4d18-b116-ab800a3cbb1a None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:18.091408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3e99a-ef74-4d18-b116-ab800a3cbb1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:18.091723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3e99a-ef74-4d18-b116-ab800a3cbb1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:18.093164 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3e99a-ef74-4d18-b116-ab800a3cbb1a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:18.113060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 103/203] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:18.117126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3e99a-ef74-4d18-b116-ab800a3cbb1a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:18.233646 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:18.269635 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a39d28-e73d-4212-b7c8-10dc24a97bed None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:18.301851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3e99a-ef74-4d18-b116-ab800a3cbb1a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:18.341387 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505a4d7-4be3-4fb3-a14a-40e2615d898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:18.342277 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505a4d7-4be3-4fb3-a14a-40e2615d898f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:18.342563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505a4d7-4be3-4fb3-a14a-40e2615d898f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:18.342842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505a4d7-4be3-4fb3-a14a-40e2615d898f None admin] PATH_INFO: `/v3/users/743c68a9a91f43d7807f368ece026412` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:18.345951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505a4d7-4be3-4fb3-a14a-40e2615d898f None admin] RBAC: Authorizing `identity:get_user(user_id=743c68a9a91f43d7807f368ece026412)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:18.347422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505a4d7-4be3-4fb3-a14a-40e2615d898f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:18.349278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 104/204] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:18 2022] GET /identity/v3/users/743c68a9a91f43d7807f368ece026412 => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:18.350666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc7c73-f51d-436f-ac75-7f9ca6c1bde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:18.351342 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc7c73-f51d-436f-ac75-7f9ca6c1bde1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:18.351627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc7c73-f51d-436f-ac75-7f9ca6c1bde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:18.351905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc7c73-f51d-436f-ac75-7f9ca6c1bde1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:18.352792 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc7c73-f51d-436f-ac75-7f9ca6c1bde1 None admin] RBAC: Adding query filter params (role.id=282334a450b54dedb0b42d678d231caf, scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce, user.id=b424af7d7c54488e93781e65d3b13eaf) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:18.353106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc7c73-f51d-436f-ac75-7f9ca6c1bde1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:18.354622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc7c73-f51d-436f-ac75-7f9ca6c1bde1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:18.356480 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505a4d7-4be3-4fb3-a14a-40e2615d898f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:18.370213 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 101/205] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:18 2022] GET /identity/v3/role_assignments?user.id=b424af7d7c54488e93781e65d3b13eaf&scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce&role.id=282334a450b54dedb0b42d678d231caf => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:18.430969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:18.515091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505a4d7-4be3-4fb3-a14a-40e2615d898f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:18.558438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06e1e2-2ad5-4c19-b96d-7a665369d648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:18.559035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06e1e2-2ad5-4c19-b96d-7a665369d648 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:18.559322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06e1e2-2ad5-4c19-b96d-7a665369d648 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:18.559598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06e1e2-2ad5-4c19-b96d-7a665369d648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:18.763005 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06e1e2-2ad5-4c19-b96d-7a665369d648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:18.764568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06e1e2-2ad5-4c19-b96d-7a665369d648 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:18.840262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:18.916763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 105/206] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:18.922445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc7c73-f51d-436f-ac75-7f9ca6c1bde1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:19.072743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc7c73-f51d-436f-ac75-7f9ca6c1bde1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:19.123501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725d6d1-b981-464d-a6cd-464ee1992455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:19.124465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725d6d1-b981-464d-a6cd-464ee1992455 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:19.124754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725d6d1-b981-464d-a6cd-464ee1992455 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:19.125028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725d6d1-b981-464d-a6cd-464ee1992455 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:19.126272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725d6d1-b981-464d-a6cd-464ee1992455 None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:19.127728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725d6d1-b981-464d-a6cd-464ee1992455 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:19.129789 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 102/207] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:18 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:19.137154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06e1e2-2ad5-4c19-b96d-7a665369d648 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:19.335012 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06e1e2-2ad5-4c19-b96d-7a665369d648 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:19.371265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7795b67-d84c-4262-9102-60b6da302164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:19.372577 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7795b67-d84c-4262-9102-60b6da302164 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:19.373075 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7795b67-d84c-4262-9102-60b6da302164 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:19.373633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7795b67-d84c-4262-9102-60b6da302164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:19.374664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7795b67-d84c-4262-9102-60b6da302164 None admin] RBAC: Adding query filter params (role.id=e3482518249a452d8c02c7d2d16f19dc, scope.project.id=8600563b295742f1a8d5ba26a2a51f14, user.id=743c68a9a91f43d7807f368ece026412) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:19.375166 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7795b67-d84c-4262-9102-60b6da302164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:19.377416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7795b67-d84c-4262-9102-60b6da302164 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:19.384101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 106/208] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:19 2022] GET /identity/v3/role_assignments?user.id=743c68a9a91f43d7807f368ece026412&scope.project.id=8600563b295742f1a8d5ba26a2a51f14&role.id=e3482518249a452d8c02c7d2d16f19dc => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:19.896201 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b70f4-de01-4124-8b1c-d17a00a96bce None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:19.896576 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b70f4-de01-4124-8b1c-d17a00a96bce None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:19.896754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b70f4-de01-4124-8b1c-d17a00a96bce None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:19.898375 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 103/209] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:19.903709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0926-e50d-47dc-8b13-850cab72b34a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:19.904576 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0926-e50d-47dc-8b13-850cab72b34a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:19.905051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0926-e50d-47dc-8b13-850cab72b34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:19.927375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ebac0926-e50d-47dc-8b13-850cab72b34a None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:19.928964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ebac0926-e50d-47dc-8b13-850cab72b34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:19.937709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:20.001004 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 107/210] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:20.009901 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a21ad5-0295-4f03-9085-4ae98adbcdcb None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:20.010348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a21ad5-0295-4f03-9085-4ae98adbcdcb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:20.010525 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a21ad5-0295-4f03-9085-4ae98adbcdcb None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:20.011829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 104/211] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:20.017152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8994da-1160-4866-87ff-ae4d468fb90c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:20.017440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8994da-1160-4866-87ff-ae4d468fb90c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:20.017718 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8994da-1160-4866-87ff-ae4d468fb90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:20.026389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a21ad5-0295-4f03-9085-4ae98adbcdcb None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:20.035848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-fb8994da-1160-4866-87ff-ae4d468fb90c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:20.037054 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fb8994da-1160-4866-87ff-ae4d468fb90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:20.045319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:20.111920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 108/212] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:20.113287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06f045-4bb4-4184-b88e-f7584e1c8214 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:20.113581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06f045-4bb4-4184-b88e-f7584e1c8214 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:20.113857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06f045-4bb4-4184-b88e-f7584e1c8214 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:20.120185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 109/213] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:20.121342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd56aac-d2c2-498c-bcf9-49c5efb44d5b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:20.121935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd56aac-d2c2-498c-bcf9-49c5efb44d5b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:20.122219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd56aac-d2c2-498c-bcf9-49c5efb44d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:20.142744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4fd56aac-d2c2-498c-bcf9-49c5efb44d5b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:20.143956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4fd56aac-d2c2-498c-bcf9-49c5efb44d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:20.145675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a21ad5-0295-4f03-9085-4ae98adbcdcb None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:20.185952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ff5ec-d8e1-4191-bbc5-145368fdd02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:20.187248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ff5ec-d8e1-4191-bbc5-145368fdd02c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:20.187785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ff5ec-d8e1-4191-bbc5-145368fdd02c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:20.188315 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ff5ec-d8e1-4191-bbc5-145368fdd02c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:20.200735 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ff5ec-d8e1-4191-bbc5-145368fdd02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-9b2ff5ec-d8e1-4191-bbc5-145368fdd02c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:20.208700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:20.209623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:20.210434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:20.210434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:20.210434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:20.210434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:20.210434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:20.210434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:20.210434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:20.210434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:20.210434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:20.210434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:20.210434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:20.210434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:20.210434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 105/214] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:20.211088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ff5ec-d8e1-4191-bbc5-145368fdd02c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:20.222588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 110/215] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:20.223258 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd56aac-d2c2-498c-bcf9-49c5efb44d5b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:20.225606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:20.300038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:20.331531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ff5ec-d8e1-4191-bbc5-145368fdd02c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:20.337155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd56aac-d2c2-498c-bcf9-49c5efb44d5b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:20.365745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903e27b-0fcd-42e7-8211-635ecc6c4652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:20.366545 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e27b-0fcd-42e7-8211-635ecc6c4652 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:20.366831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e27b-0fcd-42e7-8211-635ecc6c4652 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:20.367106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e27b-0fcd-42e7-8211-635ecc6c4652 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:20.368320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903e27b-0fcd-42e7-8211-635ecc6c4652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:20.369826 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903e27b-0fcd-42e7-8211-635ecc6c4652 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:20.375727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 106/216] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:20.375727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903e27b-0fcd-42e7-8211-635ecc6c4652 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:20.381855 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb6a12-d74b-4ca2-bd87-d544bb5dabe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:20.382563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb6a12-d74b-4ca2-bd87-d544bb5dabe4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:20.382847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb6a12-d74b-4ca2-bd87-d544bb5dabe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:20.383121 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb6a12-d74b-4ca2-bd87-d544bb5dabe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:20.383873 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb6a12-d74b-4ca2-bd87-d544bb5dabe4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:20.384208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb6a12-d74b-4ca2-bd87-d544bb5dabe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:20.385592 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb6a12-d74b-4ca2-bd87-d544bb5dabe4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:20.395137 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 111/217] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:20.400448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb6a12-d74b-4ca2-bd87-d544bb5dabe4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:20.467392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:20.475936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903e27b-0fcd-42e7-8211-635ecc6c4652 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:20.509016 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb6a12-d74b-4ca2-bd87-d544bb5dabe4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:20.512749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4250e47-6b35-41e2-b0de-a7831b6c3952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:20.513567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250e47-6b35-41e2-b0de-a7831b6c3952 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:20.513898 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250e47-6b35-41e2-b0de-a7831b6c3952 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:20.514179 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250e47-6b35-41e2-b0de-a7831b6c3952 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:20.524027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:20.527024 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4250e47-6b35-41e2-b0de-a7831b6c3952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-c4250e47-6b35-41e2-b0de-a7831b6c3952 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:20.535288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:20.536492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:20.542591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:20.542591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:20.542591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:20.542591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:20.542591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:20.542591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:20.542591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:20.542591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:20.542591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:20.542591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:20.542591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:20.542591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:20.542591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 107/218] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:04:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:20.542591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4250e47-6b35-41e2-b0de-a7831b6c3952 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:20.554227 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999e16d-9cf4-43e7-a2e1-c415b802365e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:20.555096 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999e16d-9cf4-43e7-a2e1-c415b802365e None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:20.555384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999e16d-9cf4-43e7-a2e1-c415b802365e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:20.555658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999e16d-9cf4-43e7-a2e1-c415b802365e None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:20.556514 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999e16d-9cf4-43e7-a2e1-c415b802365e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:20.558015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999e16d-9cf4-43e7-a2e1-c415b802365e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:20.642167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4250e47-6b35-41e2-b0de-a7831b6c3952 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:20.676541 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf998421-6ebf-422f-8cd2-0c7f64a92f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:20.677417 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998421-6ebf-422f-8cd2-0c7f64a92f01 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:20.677696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998421-6ebf-422f-8cd2-0c7f64a92f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:20.677966 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998421-6ebf-422f-8cd2-0c7f64a92f01 None admin] PATH_INFO: `/v3/users/a737fd42eb7b4ae4a3b1bd7836f0c782` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:20.691049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf998421-6ebf-422f-8cd2-0c7f64a92f01 None admin] RBAC: Authorizing `identity:get_user(user_id=a737fd42eb7b4ae4a3b1bd7836f0c782)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:20.692542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf998421-6ebf-422f-8cd2-0c7f64a92f01 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:20.694199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 108/219] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:20 2022] GET /identity/v3/users/a737fd42eb7b4ae4a3b1bd7836f0c782 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:20.694975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf998421-6ebf-422f-8cd2-0c7f64a92f01 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:20.716190 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 112/220] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:04:20 2022] POST /identity/v3/users => generated 297 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:04:20.717053 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999e16d-9cf4-43e7-a2e1-c415b802365e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:20.777177 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:20.826354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf998421-6ebf-422f-8cd2-0c7f64a92f01 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:20.841021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999e16d-9cf4-43e7-a2e1-c415b802365e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:20.863243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:20.869569 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9197bb9-7b49-4dee-86e6-b726c4c7a30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:20.872782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9197bb9-7b49-4dee-86e6-b726c4c7a30e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:20.872782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9197bb9-7b49-4dee-86e6-b726c4c7a30e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:20.872782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9197bb9-7b49-4dee-86e6-b726c4c7a30e None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:20.872782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9197bb9-7b49-4dee-86e6-b726c4c7a30e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:20.872782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9197bb9-7b49-4dee-86e6-b726c4c7a30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:20.874043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9197bb9-7b49-4dee-86e6-b726c4c7a30e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:20.882327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 109/221] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:20.883947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1eed6-a2af-465a-9368-860773a6a19b None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:20.884280 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1eed6-a2af-465a-9368-860773a6a19b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:20.884564 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1eed6-a2af-465a-9368-860773a6a19b None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:20.885152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84ca50-06ec-496b-9cc4-0fa37f407521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:20.885959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84ca50-06ec-496b-9cc4-0fa37f407521 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:20.891584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84ca50-06ec-496b-9cc4-0fa37f407521 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:20.891740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 110/222] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:20.891821 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84ca50-06ec-496b-9cc4-0fa37f407521 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:20.891891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1eed6-a2af-465a-9368-860773a6a19b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:20.976799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84ca50-06ec-496b-9cc4-0fa37f407521 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:20.978442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84ca50-06ec-496b-9cc4-0fa37f407521 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:21.009681 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1eed6-a2af-465a-9368-860773a6a19b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:21.034458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:21.057640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6caa691-419b-47ac-9f9e-bb0792af3c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:21.058542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6caa691-419b-47ac-9f9e-bb0792af3c26 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:21.060316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6caa691-419b-47ac-9f9e-bb0792af3c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:21.060316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6caa691-419b-47ac-9f9e-bb0792af3c26 None admin] PATH_INFO: `/v3/users/b424af7d7c54488e93781e65d3b13eaf` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:21.060707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6caa691-419b-47ac-9f9e-bb0792af3c26 None admin] RBAC: Authorizing `identity:get_user(user_id=b424af7d7c54488e93781e65d3b13eaf)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:21.063563 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6caa691-419b-47ac-9f9e-bb0792af3c26 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:21.065408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 111/223] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:20 2022] GET /identity/v3/users/b424af7d7c54488e93781e65d3b13eaf => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:21.066618 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d7e56-fdd4-4888-bbdf-cf309d1c830e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:21.066902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d7e56-fdd4-4888-bbdf-cf309d1c830e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:21.067182 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d7e56-fdd4-4888-bbdf-cf309d1c830e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:21.086077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-717d7e56-fdd4-4888-bbdf-cf309d1c830e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:21.087613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-717d7e56-fdd4-4888-bbdf-cf309d1c830e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:21.116791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 113/224] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:21.117759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84ca50-06ec-496b-9cc4-0fa37f407521 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:21.164258 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 112/225] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:21.172015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d7e56-fdd4-4888-bbdf-cf309d1c830e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:21.181045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:21.232903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84ca50-06ec-496b-9cc4-0fa37f407521 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:21.271065 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cef06-ec39-4395-a48d-2c60eb876958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:21.272073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cef06-ec39-4395-a48d-2c60eb876958 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:21.272471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cef06-ec39-4395-a48d-2c60eb876958 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:21.272824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cef06-ec39-4395-a48d-2c60eb876958 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:21.274343 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cef06-ec39-4395-a48d-2c60eb876958 None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:21.275880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cef06-ec39-4395-a48d-2c60eb876958 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:21.278185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 114/226] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:21 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:21.282927 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cef06-ec39-4395-a48d-2c60eb876958 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:21.296955 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d7e56-fdd4-4888-bbdf-cf309d1c830e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:21.315700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:21.333721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0d47c-9513-49d2-a13e-e960f732ec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:21.334924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0d47c-9513-49d2-a13e-e960f732ec04 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:21.335425 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0d47c-9513-49d2-a13e-e960f732ec04 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:21.335897 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0d47c-9513-49d2-a13e-e960f732ec04 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:21.337405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0d47c-9513-49d2-a13e-e960f732ec04 None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:21.339132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0d47c-9513-49d2-a13e-e960f732ec04 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:21.341095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 113/227] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:21 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:21.342039 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0d47c-9513-49d2-a13e-e960f732ec04 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:21.392764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:21.406439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cef06-ec39-4395-a48d-2c60eb876958 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:21.454353 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c44008-deb2-4a43-a82c-38b91e675c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:21.455965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c44008-deb2-4a43-a82c-38b91e675c36 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:21.456575 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c44008-deb2-4a43-a82c-38b91e675c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:21.457033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c44008-deb2-4a43-a82c-38b91e675c36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:21.470138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c44008-deb2-4a43-a82c-38b91e675c36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:21.479699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0d47c-9513-49d2-a13e-e960f732ec04 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-24c44008-deb2-4a43-a82c-38b91e675c36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:21.480904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:21.481791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:21.482597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:21.482597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:21.482597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:21.482597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:21.482597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:21.482597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:21.482597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:21.482597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:21.482597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:21.482597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:21.482597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:21.482597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:21.491019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 115/228] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:04:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:21.492072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c44008-deb2-4a43-a82c-38b91e675c36 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:21.525183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c96c9-191b-4ec7-9e02-81dc95914018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:21.526660 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c96c9-191b-4ec7-9e02-81dc95914018 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:21.527179 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c96c9-191b-4ec7-9e02-81dc95914018 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:21.527696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c96c9-191b-4ec7-9e02-81dc95914018 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce/users/b424af7d7c54488e93781e65d3b13eaf/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:21.530527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c96c9-191b-4ec7-9e02-81dc95914018 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1615dfc209c4ce8a6f76bb6343932ce, user_id=b424af7d7c54488e93781e65d3b13eaf, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:21.532740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c96c9-191b-4ec7-9e02-81dc95914018 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:21.606276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c44008-deb2-4a43-a82c-38b91e675c36 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:21.617030 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 114/229] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:04:21 2022] PUT /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce/users/b424af7d7c54488e93781e65d3b13eaf/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:21.619054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c96c9-191b-4ec7-9e02-81dc95914018 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:21.665207 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff50f1-a4ab-43cc-9c45-a1f48a348e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:21.665585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff50f1-a4ab-43cc-9c45-a1f48a348e7e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:21.665838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff50f1-a4ab-43cc-9c45-a1f48a348e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:21.666118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff50f1-a4ab-43cc-9c45-a1f48a348e7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:21.666984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff50f1-a4ab-43cc-9c45-a1f48a348e7e None admin] RBAC: Adding query filter params (role.id=d47bb3db22444385b7884acbc7e21b0f, scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce, user.id=a737fd42eb7b4ae4a3b1bd7836f0c782) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:21.667278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff50f1-a4ab-43cc-9c45-a1f48a348e7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:21.668803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff50f1-a4ab-43cc-9c45-a1f48a348e7e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:21.689022 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:21.690732 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 116/230] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:21 2022] GET /identity/v3/role_assignments?user.id=a737fd42eb7b4ae4a3b1bd7836f0c782&scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce&role.id=d47bb3db22444385b7884acbc7e21b0f => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:21.793903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c96c9-191b-4ec7-9e02-81dc95914018 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:21.838673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77c78a-e3e7-4c24-ad1d-e83d41b6e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:21.839415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77c78a-e3e7-4c24-ad1d-e83d41b6e576 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:21.839702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77c78a-e3e7-4c24-ad1d-e83d41b6e576 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:21.839979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77c78a-e3e7-4c24-ad1d-e83d41b6e576 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:21.840880 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77c78a-e3e7-4c24-ad1d-e83d41b6e576 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:21.841189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77c78a-e3e7-4c24-ad1d-e83d41b6e576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:21.842612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77c78a-e3e7-4c24-ad1d-e83d41b6e576 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:21.852307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 115/231] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:21.858066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff50f1-a4ab-43cc-9c45-a1f48a348e7e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:21.888907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:21.995822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff50f1-a4ab-43cc-9c45-a1f48a348e7e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:22.032434 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f8b21-9450-441e-9946-1b86649ef41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:22.033552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f8b21-9450-441e-9946-1b86649ef41c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:22.033943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f8b21-9450-441e-9946-1b86649ef41c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:22.034325 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f8b21-9450-441e-9946-1b86649ef41c None admin] PATH_INFO: `/v3/users/b424af7d7c54488e93781e65d3b13eaf` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:22.036108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f8b21-9450-441e-9946-1b86649ef41c None admin] RBAC: Authorizing `identity:get_user(user_id=b424af7d7c54488e93781e65d3b13eaf)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:22.037731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f8b21-9450-441e-9946-1b86649ef41c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:22.039957 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 117/232] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:21 2022] GET /identity/v3/users/b424af7d7c54488e93781e65d3b13eaf => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:22.049138 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77c78a-e3e7-4c24-ad1d-e83d41b6e576 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:22.259157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77c78a-e3e7-4c24-ad1d-e83d41b6e576 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:22.268349 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:22.294262 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cedd7-c810-4e73-a9ca-d29979604333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:22.295129 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cedd7-c810-4e73-a9ca-d29979604333 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:22.295412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cedd7-c810-4e73-a9ca-d29979604333 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:22.295727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cedd7-c810-4e73-a9ca-d29979604333 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:22.296954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cedd7-c810-4e73-a9ca-d29979604333 None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:22.298970 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cedd7-c810-4e73-a9ca-d29979604333 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:22.301012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 116/233] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:22 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:22.306297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f8b21-9450-441e-9946-1b86649ef41c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:22.438324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:22.463518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f8b21-9450-441e-9946-1b86649ef41c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:22.510045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51990f-4a6c-4e22-a325-bb3ad6da46b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:22.510867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51990f-4a6c-4e22-a325-bb3ad6da46b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:22.511156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51990f-4a6c-4e22-a325-bb3ad6da46b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:22.511434 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51990f-4a6c-4e22-a325-bb3ad6da46b2 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce/users/b424af7d7c54488e93781e65d3b13eaf/roles/282334a450b54dedb0b42d678d231caf` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:22.513737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51990f-4a6c-4e22-a325-bb3ad6da46b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1615dfc209c4ce8a6f76bb6343932ce, user_id=b424af7d7c54488e93781e65d3b13eaf, role_id=282334a450b54dedb0b42d678d231caf)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:22.515198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51990f-4a6c-4e22-a325-bb3ad6da46b2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:22.591054 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 118/234] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:04:22 2022] PUT /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce/users/b424af7d7c54488e93781e65d3b13eaf/roles/282334a450b54dedb0b42d678d231caf => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:23.145780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5829e6c-2696-412e-9d51-f517152361bc None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:23.146327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5829e6c-2696-412e-9d51-f517152361bc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:23.146497 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5829e6c-2696-412e-9d51-f517152361bc None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:23.148171 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 117/235] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:23.153066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fad26-4ac8-4913-8b6e-db71d0c30cf7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:23.153874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fad26-4ac8-4913-8b6e-db71d0c30cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:23.154364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fad26-4ac8-4913-8b6e-db71d0c30cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:23.177020 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9d9fad26-4ac8-4913-8b6e-db71d0c30cf7 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:23.178580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9d9fad26-4ac8-4913-8b6e-db71d0c30cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:23.245269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5658d-b6fb-473c-8770-fcf670b1fd30 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:23.245605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5658d-b6fb-473c-8770-fcf670b1fd30 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:23.245829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5658d-b6fb-473c-8770-fcf670b1fd30 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:23.247449 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 118/236] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:23.263236 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362500f-c35f-42cc-8cf2-8e35dee11977 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:23.263531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362500f-c35f-42cc-8cf2-8e35dee11977 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:23.263832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362500f-c35f-42cc-8cf2-8e35dee11977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:23.272721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 119/237] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:23.289383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e362500f-c35f-42cc-8cf2-8e35dee11977 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:23.290569 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e362500f-c35f-42cc-8cf2-8e35dee11977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:23.294804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fad26-4ac8-4913-8b6e-db71d0c30cf7 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:23.411889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:23.413469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 119/238] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:23.444082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fad26-4ac8-4913-8b6e-db71d0c30cf7 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:23.462444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362500f-c35f-42cc-8cf2-8e35dee11977 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:23.508538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78d67e-3549-4b44-8a7f-de49517c4a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:23.509344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78d67e-3549-4b44-8a7f-de49517c4a27 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:23.509624 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78d67e-3549-4b44-8a7f-de49517c4a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:23.509901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78d67e-3549-4b44-8a7f-de49517c4a27 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:23.532074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78d67e-3549-4b44-8a7f-de49517c4a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-be78d67e-3549-4b44-8a7f-de49517c4a27 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:23.541117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:23.542024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:23.542820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:23.542820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:23.542820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:23.542820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:23.542820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:23.542820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:23.542820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:23.542820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:23.542820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:23.542820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:23.542820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:23.542820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:23.542820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 120/239] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:23.559533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78d67e-3549-4b44-8a7f-de49517c4a27 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:23.622034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362500f-c35f-42cc-8cf2-8e35dee11977 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:23.647876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:23.667459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e3817-11c1-4ff5-b567-cab6827c803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:23.668626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e3817-11c1-4ff5-b567-cab6827c803f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:23.669099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e3817-11c1-4ff5-b567-cab6827c803f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:23.673535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e3817-11c1-4ff5-b567-cab6827c803f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:23.673535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e3817-11c1-4ff5-b567-cab6827c803f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:23.673535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e3817-11c1-4ff5-b567-cab6827c803f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:23.674355 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 120/240] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:23.679826 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e3817-11c1-4ff5-b567-cab6827c803f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:23.769953 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78d67e-3549-4b44-8a7f-de49517c4a27 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:23.794137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e3817-11c1-4ff5-b567-cab6827c803f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:23.826082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:23.833058 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024acb5-41b0-4645-88d8-44f4254f858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:23.834013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024acb5-41b0-4645-88d8-44f4254f858d None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:23.843672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024acb5-41b0-4645-88d8-44f4254f858d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:23.843672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024acb5-41b0-4645-88d8-44f4254f858d None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:23.843672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024acb5-41b0-4645-88d8-44f4254f858d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:23.843672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024acb5-41b0-4645-88d8-44f4254f858d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:23.856021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242c6f4-a967-456a-8329-aa7a713a2d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:23.856021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c6f4-a967-456a-8329-aa7a713a2d8c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:23.856021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c6f4-a967-456a-8329-aa7a713a2d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:23.856021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c6f4-a967-456a-8329-aa7a713a2d8c None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:23.856396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242c6f4-a967-456a-8329-aa7a713a2d8c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:23.856396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242c6f4-a967-456a-8329-aa7a713a2d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:23.856396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242c6f4-a967-456a-8329-aa7a713a2d8c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:23.865067 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 121/241] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:23.871573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242c6f4-a967-456a-8329-aa7a713a2d8c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:23.964228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 121/242] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:04:23 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:04:23.987970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242c6f4-a967-456a-8329-aa7a713a2d8c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:24.027693 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68b664-3691-489c-bbde-71201fe090f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:24.028686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68b664-3691-489c-bbde-71201fe090f4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:24.028974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68b664-3691-489c-bbde-71201fe090f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:24.029315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68b664-3691-489c-bbde-71201fe090f4 None admin] PATH_INFO: `/v3/users/424342bb36b94944b72e21bd9858cd34` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:24.061778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68b664-3691-489c-bbde-71201fe090f4 None admin] RBAC: Authorizing `identity:get_user(user_id=424342bb36b94944b72e21bd9858cd34)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:24.063426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68b664-3691-489c-bbde-71201fe090f4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:24.065696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 122/243] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:23 2022] GET /identity/v3/users/424342bb36b94944b72e21bd9858cd34 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:24.071374 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024acb5-41b0-4645-88d8-44f4254f858d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:24.106340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:24.149431 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325337a-97a9-4d9d-9247-1fbf304e4021 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:24.149767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325337a-97a9-4d9d-9247-1fbf304e4021 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:24.150005 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325337a-97a9-4d9d-9247-1fbf304e4021 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:24.151558 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 123/244] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:24.157743 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea063024-5b2f-42f9-be2a-b9be9a7bcf3e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:24.158344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea063024-5b2f-42f9-be2a-b9be9a7bcf3e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:24.158344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea063024-5b2f-42f9-be2a-b9be9a7bcf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:24.176337 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ea063024-5b2f-42f9-be2a-b9be9a7bcf3e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:24.177643 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ea063024-5b2f-42f9-be2a-b9be9a7bcf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:24.188102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024acb5-41b0-4645-88d8-44f4254f858d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:24.235680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:24.244178 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522cfe6-4554-4da0-b12b-91da3b3df8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:24.245343 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522cfe6-4554-4da0-b12b-91da3b3df8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:24.245632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522cfe6-4554-4da0-b12b-91da3b3df8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:24.245921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522cfe6-4554-4da0-b12b-91da3b3df8a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:24.264296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 124/245] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:24.284699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea063024-5b2f-42f9-be2a-b9be9a7bcf3e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:24.337462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522cfe6-4554-4da0-b12b-91da3b3df8a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:24.338959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522cfe6-4554-4da0-b12b-91da3b3df8a1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:24.374417 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:24.409615 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea063024-5b2f-42f9-be2a-b9be9a7bcf3e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:24.455913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bc62e-3bc4-4e35-9807-326767577e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:24.455913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bc62e-3bc4-4e35-9807-326767577e31 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:24.456367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bc62e-3bc4-4e35-9807-326767577e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:24.456523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bc62e-3bc4-4e35-9807-326767577e31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:24.468754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 122/246] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:24.470141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44f8be-5d30-40ce-86f2-f31eeea84ca2 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:24.470434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44f8be-5d30-40ce-86f2-f31eeea84ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:24.470720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44f8be-5d30-40ce-86f2-f31eeea84ca2 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:24.473466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bc62e-3bc4-4e35-9807-326767577e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:24.476692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 123/247] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:24.477764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44f8be-5d30-40ce-86f2-f31eeea84ca2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-269bc62e-3bc4-4e35-9807-326767577e31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:24.481357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:24.482270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:24.483551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:24.483551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:24.483551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:24.483551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:24.483551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:24.483551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:24.483551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:24.483551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:24.483551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:24.483551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:24.483551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:24.483551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:24.483551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 125/248] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:04:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:24.485887 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706e608-e838-45f4-bbe0-2cae9846642f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:24.486393 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706e608-e838-45f4-bbe0-2cae9846642f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:24.486888 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706e608-e838-45f4-bbe0-2cae9846642f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:24.510476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2706e608-e838-45f4-bbe0-2cae9846642f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:24.511772 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2706e608-e838-45f4-bbe0-2cae9846642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:24.559241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:24.604242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 126/249] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:24.605574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706e608-e838-45f4-bbe0-2cae9846642f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:24.614910 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44f8be-5d30-40ce-86f2-f31eeea84ca2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:24.657285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:24.665432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e625d3-b0e4-48be-a18b-95a040151a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:24.666670 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e625d3-b0e4-48be-a18b-95a040151a52 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:24.667166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e625d3-b0e4-48be-a18b-95a040151a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:24.667674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e625d3-b0e4-48be-a18b-95a040151a52 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:24.669227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e625d3-b0e4-48be-a18b-95a040151a52 None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:24.670894 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e625d3-b0e4-48be-a18b-95a040151a52 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:24.674506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 124/250] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:24 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:24.675807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e625d3-b0e4-48be-a18b-95a040151a52 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:24.747371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706e608-e838-45f4-bbe0-2cae9846642f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:24.784330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343fed4-1744-4623-9a93-2565def55d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:24.785672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343fed4-1744-4623-9a93-2565def55d45 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:24.786163 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343fed4-1744-4623-9a93-2565def55d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:24.786638 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343fed4-1744-4623-9a93-2565def55d45 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:24.787801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343fed4-1744-4623-9a93-2565def55d45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:24.788338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343fed4-1744-4623-9a93-2565def55d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:24.789941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343fed4-1744-4623-9a93-2565def55d45 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:24.790696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e625d3-b0e4-48be-a18b-95a040151a52 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:24.799965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 127/251] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:24.801354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343fed4-1744-4623-9a93-2565def55d45 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:24.827317 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9357fb-8824-450f-a499-e420cb6cda74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:24.828204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9357fb-8824-450f-a499-e420cb6cda74 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:24.828490 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9357fb-8824-450f-a499-e420cb6cda74 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:24.828847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9357fb-8824-450f-a499-e420cb6cda74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:24.837611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:24.839917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9357fb-8824-450f-a499-e420cb6cda74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-6a9357fb-8824-450f-a499-e420cb6cda74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:24.858677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:24.859647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:24.861042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:24.861042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:24.861042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:24.861042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:24.861042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:24.861042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:24.861042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:24.861042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:24.861042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:24.861042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:24.861042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:24.861042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:24.861042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 125/252] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:24.861721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9357fb-8824-450f-a499-e420cb6cda74 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:24.920397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343fed4-1744-4623-9a93-2565def55d45 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:24.936791 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:24.958997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063c070-2d33-4634-baff-b4c1317c9999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:24.960051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063c070-2d33-4634-baff-b4c1317c9999 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:24.960603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063c070-2d33-4634-baff-b4c1317c9999 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:24.961107 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063c070-2d33-4634-baff-b4c1317c9999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:24.962166 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063c070-2d33-4634-baff-b4c1317c9999 None admin] RBAC: Adding query filter params (role.id=e3482518249a452d8c02c7d2d16f19dc, scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce, user.id=424342bb36b94944b72e21bd9858cd34) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:24.962684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063c070-2d33-4634-baff-b4c1317c9999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:24.964394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063c070-2d33-4634-baff-b4c1317c9999 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:24.971432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 128/253] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:24 2022] GET /identity/v3/role_assignments?user.id=424342bb36b94944b72e21bd9858cd34&scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce&role.id=e3482518249a452d8c02c7d2d16f19dc => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:24.977167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063c070-2d33-4634-baff-b4c1317c9999 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:24.990031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9357fb-8824-450f-a499-e420cb6cda74 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:25.028068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd715fd6-ab90-4ef4-946c-b8715399b4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:25.028894 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd715fd6-ab90-4ef4-946c-b8715399b4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:25.029181 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd715fd6-ab90-4ef4-946c-b8715399b4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:25.029464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd715fd6-ab90-4ef4-946c-b8715399b4f5 None admin] PATH_INFO: `/v3/users/b424af7d7c54488e93781e65d3b13eaf` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:25.031282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd715fd6-ab90-4ef4-946c-b8715399b4f5 None admin] RBAC: Authorizing `identity:get_user(user_id=b424af7d7c54488e93781e65d3b13eaf)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:25.032928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd715fd6-ab90-4ef4-946c-b8715399b4f5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:25.034778 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 126/254] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:24 2022] GET /identity/v3/users/b424af7d7c54488e93781e65d3b13eaf => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:25.040539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd715fd6-ab90-4ef4-946c-b8715399b4f5 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:25.151394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd715fd6-ab90-4ef4-946c-b8715399b4f5 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:25.180558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:25.188023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:25.190608 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79430c0f-5c1a-42d3-94ae-cb7fae1be1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:25.191797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79430c0f-5c1a-42d3-94ae-cb7fae1be1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:25.192299 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79430c0f-5c1a-42d3-94ae-cb7fae1be1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:25.192767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79430c0f-5c1a-42d3-94ae-cb7fae1be1f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:25.200083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063c070-2d33-4634-baff-b4c1317c9999 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:25.278726 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bac380-5fdb-4468-bb36-73d89ef42c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:25.279871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bac380-5fdb-4468-bb36-73d89ef42c8c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:25.280403 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bac380-5fdb-4468-bb36-73d89ef42c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:25.281001 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bac380-5fdb-4468-bb36-73d89ef42c8c None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:25.282501 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bac380-5fdb-4468-bb36-73d89ef42c8c None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:25.283013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bac380-5fdb-4468-bb36-73d89ef42c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:25.283806 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79430c0f-5c1a-42d3-94ae-cb7fae1be1f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:25.284864 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bac380-5fdb-4468-bb36-73d89ef42c8c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:25.285567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79430c0f-5c1a-42d3-94ae-cb7fae1be1f6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:25.299028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 129/255] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:25.300712 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8498fa-28fd-4f7a-83ef-7fd1c115fdd8 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:25.301209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8498fa-28fd-4f7a-83ef-7fd1c115fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:25.301711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8498fa-28fd-4f7a-83ef-7fd1c115fdd8 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:25.303225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 130/256] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:25.305268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8498fa-28fd-4f7a-83ef-7fd1c115fdd8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:25.471317 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 127/257] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:25.473445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43e01e-d9b6-43a9-bb96-6ddf8d72a51e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:25.473977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43e01e-d9b6-43a9-bb96-6ddf8d72a51e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:25.474458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43e01e-d9b6-43a9-bb96-6ddf8d72a51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:25.505129 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ad43e01e-d9b6-43a9-bb96-6ddf8d72a51e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:25.506321 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ad43e01e-d9b6-43a9-bb96-6ddf8d72a51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:25.508835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8498fa-28fd-4f7a-83ef-7fd1c115fdd8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:25.546929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:25.565371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772aa5f-ebf9-459e-b5d6-efa968fe4d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:25.566250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772aa5f-ebf9-459e-b5d6-efa968fe4d62 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:25.566534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772aa5f-ebf9-459e-b5d6-efa968fe4d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:25.566810 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772aa5f-ebf9-459e-b5d6-efa968fe4d62 None admin] PATH_INFO: `/v3/users/a737fd42eb7b4ae4a3b1bd7836f0c782` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:25.568759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772aa5f-ebf9-459e-b5d6-efa968fe4d62 None admin] RBAC: Authorizing `identity:get_user(user_id=a737fd42eb7b4ae4a3b1bd7836f0c782)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:25.570256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772aa5f-ebf9-459e-b5d6-efa968fe4d62 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:25.573234 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 131/258] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:25 2022] GET /identity/v3/users/a737fd42eb7b4ae4a3b1bd7836f0c782 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:25.574011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772aa5f-ebf9-459e-b5d6-efa968fe4d62 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:25.628647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:25.642597 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 128/259] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:25.644458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43e01e-d9b6-43a9-bb96-6ddf8d72a51e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:25.769591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772aa5f-ebf9-459e-b5d6-efa968fe4d62 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:25.788784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43e01e-d9b6-43a9-bb96-6ddf8d72a51e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:25.835580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a34da-1265-41fe-8194-f48289a132ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:25.836826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a34da-1265-41fe-8194-f48289a132ea None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:25.837316 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a34da-1265-41fe-8194-f48289a132ea None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:25.837789 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a34da-1265-41fe-8194-f48289a132ea None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:25.840297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a34da-1265-41fe-8194-f48289a132ea None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:25.841966 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a34da-1265-41fe-8194-f48289a132ea None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:25.845538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 132/260] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:25 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:25.846524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a34da-1265-41fe-8194-f48289a132ea None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:25.864890 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec7045-9eb0-470b-b291-1ba9286573c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:25.866988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec7045-9eb0-470b-b291-1ba9286573c7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:25.868293 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec7045-9eb0-470b-b291-1ba9286573c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:25.869015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec7045-9eb0-470b-b291-1ba9286573c7 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:25.871579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec7045-9eb0-470b-b291-1ba9286573c7 None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:25.875482 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec7045-9eb0-470b-b291-1ba9286573c7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:25.880496 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 129/261] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:25 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:25.883509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec7045-9eb0-470b-b291-1ba9286573c7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:25.937562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:26.016256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:26.030899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a34da-1265-41fe-8194-f48289a132ea None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:26.084348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec7045-9eb0-470b-b291-1ba9286573c7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:26.097664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8afd8a-fa7b-4fef-88b3-b7182f54747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:26.098859 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8afd8a-fa7b-4fef-88b3-b7182f54747e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:26.099382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8afd8a-fa7b-4fef-88b3-b7182f54747e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:26.099858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8afd8a-fa7b-4fef-88b3-b7182f54747e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:26.112327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8afd8a-fa7b-4fef-88b3-b7182f54747e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-2f8afd8a-fa7b-4fef-88b3-b7182f54747e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:26.120960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:26.121920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:26.122722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:26.122722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:26.122722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:26.122722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:26.122722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:26.122722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:26.122722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:26.122722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:26.122722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:26.122722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:26.122722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:26.122722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:26.125199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 133/262] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:04:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:26.127256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8afd8a-fa7b-4fef-88b3-b7182f54747e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:26.169300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d6890-7455-478c-9125-11b5a323e47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:26.169972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d6890-7455-478c-9125-11b5a323e47b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:26.170257 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d6890-7455-478c-9125-11b5a323e47b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:26.170535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d6890-7455-478c-9125-11b5a323e47b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:26.171384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d6890-7455-478c-9125-11b5a323e47b None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce, user.id=b424af7d7c54488e93781e65d3b13eaf) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:26.171696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d6890-7455-478c-9125-11b5a323e47b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:26.173720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d6890-7455-478c-9125-11b5a323e47b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:26.194090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 130/263] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:25 2022] GET /identity/v3/role_assignments?user.id=b424af7d7c54488e93781e65d3b13eaf&scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 608 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:26.194760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d6890-7455-478c-9125-11b5a323e47b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:26.309465 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8afd8a-fa7b-4fef-88b3-b7182f54747e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:26.373688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a9dfd-0c13-4a56-a72a-1e6ef629614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:26.374884 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9dfd-0c13-4a56-a72a-1e6ef629614a None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:26.375377 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9dfd-0c13-4a56-a72a-1e6ef629614a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:26.375902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9dfd-0c13-4a56-a72a-1e6ef629614a None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce/users/a737fd42eb7b4ae4a3b1bd7836f0c782/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:26.379094 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a9dfd-0c13-4a56-a72a-1e6ef629614a None admin] RBAC: Authorizing `identity:create_grant(project_id=c1615dfc209c4ce8a6f76bb6343932ce, user_id=a737fd42eb7b4ae4a3b1bd7836f0c782, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:26.384738 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a9dfd-0c13-4a56-a72a-1e6ef629614a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:26.417023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:26.430417 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d6890-7455-478c-9125-11b5a323e47b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:26.468670 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705a04b-7a71-4602-8b6c-a03584f0eea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:26.469401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705a04b-7a71-4602-8b6c-a03584f0eea3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:26.470360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705a04b-7a71-4602-8b6c-a03584f0eea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:26.470646 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705a04b-7a71-4602-8b6c-a03584f0eea3 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:26.471407 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705a04b-7a71-4602-8b6c-a03584f0eea3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:26.471717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705a04b-7a71-4602-8b6c-a03584f0eea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:26.473206 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705a04b-7a71-4602-8b6c-a03584f0eea3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:26.482257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 134/264] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:04:26 2022] PUT /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce/users/a737fd42eb7b4ae4a3b1bd7836f0c782/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:26.490349 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 131/265] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:26.496176 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a9dfd-0c13-4a56-a72a-1e6ef629614a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:26.517426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:26.623265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a9dfd-0c13-4a56-a72a-1e6ef629614a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:26.668479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ebda2-c270-4d35-8a0f-f045250f857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:26.669297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ebda2-c270-4d35-8a0f-f045250f857f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:26.669581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ebda2-c270-4d35-8a0f-f045250f857f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:26.669861 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ebda2-c270-4d35-8a0f-f045250f857f None admin] PATH_INFO: `/v3/users/b424af7d7c54488e93781e65d3b13eaf` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:26.677035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ebda2-c270-4d35-8a0f-f045250f857f None admin] RBAC: Authorizing `identity:get_user(user_id=b424af7d7c54488e93781e65d3b13eaf)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:26.678600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ebda2-c270-4d35-8a0f-f045250f857f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:26.680902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 135/266] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:26 2022] GET /identity/v3/users/b424af7d7c54488e93781e65d3b13eaf => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:26.686043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705a04b-7a71-4602-8b6c-a03584f0eea3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:26.797242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673aa5f-57b8-4f67-9fdf-f9f2912625e4 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:26.797611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673aa5f-57b8-4f67-9fdf-f9f2912625e4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:26.798436 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673aa5f-57b8-4f67-9fdf-f9f2912625e4 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:26.799892 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 136/267] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:04:26.810349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a5ab1-69e0-433f-9585-c095a098374d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:26.810349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a5ab1-69e0-433f-9585-c095a098374d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:26.810349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a5ab1-69e0-433f-9585-c095a098374d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:26.810670 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705a04b-7a71-4602-8b6c-a03584f0eea3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:26.826672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-cb5a5ab1-69e0-433f-9585-c095a098374d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:26.828222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cb5a5ab1-69e0-433f-9585-c095a098374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:26.847956 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c9b39-678c-4cae-a63e-884f1f8d364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:26.848750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c9b39-678c-4cae-a63e-884f1f8d364f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:26.849042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c9b39-678c-4cae-a63e-884f1f8d364f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:26.849319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c9b39-678c-4cae-a63e-884f1f8d364f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:26.870617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:26.903684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 137/268] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:26.925694 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c9b39-678c-4cae-a63e-884f1f8d364f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:26.927231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c9b39-678c-4cae-a63e-884f1f8d364f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:26.928937 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a5ab1-69e0-433f-9585-c095a098374d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:26.944378 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:27.033110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a5ab1-69e0-433f-9585-c095a098374d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:27.035565 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 132/269] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:27.045035 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c9b39-678c-4cae-a63e-884f1f8d364f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:27.081362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d650260-e173-45bc-9947-2a40be201582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:27.082547 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d650260-e173-45bc-9947-2a40be201582 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:27.083031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d650260-e173-45bc-9947-2a40be201582 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:27.083502 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d650260-e173-45bc-9947-2a40be201582 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:27.094426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d650260-e173-45bc-9947-2a40be201582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-7d650260-e173-45bc-9947-2a40be201582 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:27.103110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:27.104040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:27.104867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:27.104867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:27.104867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:27.104867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:27.104867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:27.104867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:27.104867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:27.104867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:27.104867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:27.104867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:27.104867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:27.104867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:27.107536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 138/270] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:27.113326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d650260-e173-45bc-9947-2a40be201582 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:27.137132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:27.188908 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:27.220341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d650260-e173-45bc-9947-2a40be201582 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:27.228870 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c9b39-678c-4cae-a63e-884f1f8d364f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:27.270940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b9a6f-38f6-4794-add6-f40e900a40fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:27.272212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b9a6f-38f6-4794-add6-f40e900a40fe None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:27.272891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b9a6f-38f6-4794-add6-f40e900a40fe None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:27.273373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b9a6f-38f6-4794-add6-f40e900a40fe None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:27.274790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b9a6f-38f6-4794-add6-f40e900a40fe None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:27.276326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b5ac6-86dd-40e0-97af-c16dd604fa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:27.276965 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b9a6f-38f6-4794-add6-f40e900a40fe None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:27.277071 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b5ac6-86dd-40e0-97af-c16dd604fa2c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:27.277293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b5ac6-86dd-40e0-97af-c16dd604fa2c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:27.277573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b5ac6-86dd-40e0-97af-c16dd604fa2c None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:27.278344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b5ac6-86dd-40e0-97af-c16dd604fa2c None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:27.278652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b5ac6-86dd-40e0-97af-c16dd604fa2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:27.280173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 133/271] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:27 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:27.284103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b5ac6-86dd-40e0-97af-c16dd604fa2c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:27.286771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b9a6f-38f6-4794-add6-f40e900a40fe None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:27.298676 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 139/272] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:27.299985 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed5bae-3154-41a7-b159-4210122c7c01 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:27.300298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed5bae-3154-41a7-b159-4210122c7c01 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:27.304029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed5bae-3154-41a7-b159-4210122c7c01 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:27.304029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 140/273] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:27.306264 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed5bae-3154-41a7-b159-4210122c7c01 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:27.404973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b9a6f-38f6-4794-add6-f40e900a40fe None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:27.413622 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed5bae-3154-41a7-b159-4210122c7c01 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:27.425877 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:27.444781 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed5411-51e7-4aae-8d5e-7edf80baa5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:27.445871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed5411-51e7-4aae-8d5e-7edf80baa5dd None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:27.446406 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed5411-51e7-4aae-8d5e-7edf80baa5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:27.446927 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed5411-51e7-4aae-8d5e-7edf80baa5dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:27.448221 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed5411-51e7-4aae-8d5e-7edf80baa5dd None admin] RBAC: Adding query filter params (role.id=282334a450b54dedb0b42d678d231caf, scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce, user.id=b424af7d7c54488e93781e65d3b13eaf) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:27.448829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed5411-51e7-4aae-8d5e-7edf80baa5dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:27.463554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe4697-d23f-49b2-9b77-1ce763be1c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:27.463554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe4697-d23f-49b2-9b77-1ce763be1c30 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:27.463770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed5411-51e7-4aae-8d5e-7edf80baa5dd None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:27.463843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe4697-d23f-49b2-9b77-1ce763be1c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:27.463843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe4697-d23f-49b2-9b77-1ce763be1c30 None admin] PATH_INFO: `/v3/users/54eabd38016d48c2b7c8babc5a800663` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:27.463843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:27.464064 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 134/274] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:27 2022] GET /identity/v3/role_assignments?user.id=b424af7d7c54488e93781e65d3b13eaf&scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce&role.id=282334a450b54dedb0b42d678d231caf => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:27.464064 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693c44-f2bf-47a5-bfca-d257e9940a49 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:27.464064 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693c44-f2bf-47a5-bfca-d257e9940a49 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:27.464064 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693c44-f2bf-47a5-bfca-d257e9940a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:27.466471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe4697-d23f-49b2-9b77-1ce763be1c30 None admin] RBAC: Authorizing `identity:get_user(user_id=54eabd38016d48c2b7c8babc5a800663)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:27.468041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe4697-d23f-49b2-9b77-1ce763be1c30 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:27.470047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 141/275] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:27 2022] GET /identity/v3/users/54eabd38016d48c2b7c8babc5a800663 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:27.475764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe4697-d23f-49b2-9b77-1ce763be1c30 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:27.480809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e4693c44-f2bf-47a5-bfca-d257e9940a49 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:27.482569 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e4693c44-f2bf-47a5-bfca-d257e9940a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:27.591141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe4697-d23f-49b2-9b77-1ce763be1c30 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:27.594366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 135/276] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:27.642592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9887a-8bcf-4cf9-8065-63d666c9501a None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:27.642896 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9887a-8bcf-4cf9-8065-63d666c9501a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:27.643215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9887a-8bcf-4cf9-8065-63d666c9501a None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:27.644714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 136/277] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:04:27.646877 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6f38f-f70b-4eec-806a-0a3aa173c461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:27.647540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6f38f-f70b-4eec-806a-0a3aa173c461 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:27.647900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6f38f-f70b-4eec-806a-0a3aa173c461 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:27.648195 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6f38f-f70b-4eec-806a-0a3aa173c461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:27.648864 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9887a-8bcf-4cf9-8065-63d666c9501a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:27.649036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6f38f-f70b-4eec-806a-0a3aa173c461 None admin] RBAC: Adding query filter params (role.id=d47bb3db22444385b7884acbc7e21b0f, user.id=54eabd38016d48c2b7c8babc5a800663, scope.system=all) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:27.649347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6f38f-f70b-4eec-806a-0a3aa173c461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:27.650810 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6f38f-f70b-4eec-806a-0a3aa173c461 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:27.656972 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 142/278] 10.222.0.74 () {56 vars in 1308 bytes} [Thu Jul 14 10:04:27 2022] GET /identity/v3/role_assignments?user.id=54eabd38016d48c2b7c8babc5a800663&scope.system=all&role.id=d47bb3db22444385b7884acbc7e21b0f => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:27.658784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb2a47-4584-4081-99b8-49b54fc61ddf None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:27.659071 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb2a47-4584-4081-99b8-49b54fc61ddf None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:27.659349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb2a47-4584-4081-99b8-49b54fc61ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:27.690366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-6feb2a47-4584-4081-99b8-49b54fc61ddf None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:27.692232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6feb2a47-4584-4081-99b8-49b54fc61ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:27.772707 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:27.786504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9887a-8bcf-4cf9-8065-63d666c9501a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:27.798247 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 143/279] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:27.815862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:27.825860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb2a47-4584-4081-99b8-49b54fc61ddf None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:27.848695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d4e2c-6f90-42e0-ae50-1633eeed02b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:27.849495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d4e2c-6f90-42e0-ae50-1633eeed02b1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:27.849776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d4e2c-6f90-42e0-ae50-1633eeed02b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:27.850048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d4e2c-6f90-42e0-ae50-1633eeed02b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:27.851304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d4e2c-6f90-42e0-ae50-1633eeed02b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:27.852815 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d4e2c-6f90-42e0-ae50-1633eeed02b1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:27.857029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 137/280] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:27.863351 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d4e2c-6f90-42e0-ae50-1633eeed02b1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:27.946890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb2a47-4584-4081-99b8-49b54fc61ddf None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:27.985422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eeb50-88cf-4e71-ac4a-d8cb00f4c685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:27.986323 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eeb50-88cf-4e71-ac4a-d8cb00f4c685 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:27.986605 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eeb50-88cf-4e71-ac4a-d8cb00f4c685 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:27.986879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eeb50-88cf-4e71-ac4a-d8cb00f4c685 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:27.995550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d4e2c-6f90-42e0-ae50-1633eeed02b1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:28.001329 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5eeb50-88cf-4e71-ac4a-d8cb00f4c685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-fa5eeb50-88cf-4e71-ac4a-d8cb00f4c685 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:28.009591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:28.010469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:28.011268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:28.011268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:28.011268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:28.011268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:28.011268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:28.011268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:28.011268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:28.011268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:28.011268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:28.011268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:28.011268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:28.011268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:28.013816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 144/281] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:28.020299 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eeb50-88cf-4e71-ac4a-d8cb00f4c685 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:28.036032 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef76a9-9156-4e91-b75d-d94cd2541b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:28.037164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef76a9-9156-4e91-b75d-d94cd2541b4b None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:28.037665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef76a9-9156-4e91-b75d-d94cd2541b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:28.038154 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef76a9-9156-4e91-b75d-d94cd2541b4b None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:28.039292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef76a9-9156-4e91-b75d-d94cd2541b4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:28.041075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef76a9-9156-4e91-b75d-d94cd2541b4b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:28.080162 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:28.133253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eeb50-88cf-4e71-ac4a-d8cb00f4c685 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:28.140103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 138/282] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:04:27 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:04:28.179166 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b94a7-e93b-4844-a38b-43783018fc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:28.180347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b94a7-e93b-4844-a38b-43783018fc47 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:28.180871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b94a7-e93b-4844-a38b-43783018fc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:28.181366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b94a7-e93b-4844-a38b-43783018fc47 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:28.182339 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b94a7-e93b-4844-a38b-43783018fc47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:28.182850 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b94a7-e93b-4844-a38b-43783018fc47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:28.184578 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b94a7-e93b-4844-a38b-43783018fc47 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:28.199740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 145/283] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:28.201617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef76a9-9156-4e91-b75d-d94cd2541b4b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:28.247246 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:28.315733 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef76a9-9156-4e91-b75d-d94cd2541b4b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:28.351176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39546ee-ba9f-4432-ba46-d1b79b1460a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:28.352502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39546ee-ba9f-4432-ba46-d1b79b1460a4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:28.352985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39546ee-ba9f-4432-ba46-d1b79b1460a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:28.353479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39546ee-ba9f-4432-ba46-d1b79b1460a4 None admin] PATH_INFO: `/v3/users/424342bb36b94944b72e21bd9858cd34` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:28.354864 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39546ee-ba9f-4432-ba46-d1b79b1460a4 None admin] RBAC: Authorizing `identity:get_user(user_id=424342bb36b94944b72e21bd9858cd34)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:28.356541 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39546ee-ba9f-4432-ba46-d1b79b1460a4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:28.358489 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 139/284] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:28 2022] GET /identity/v3/users/424342bb36b94944b72e21bd9858cd34 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:28.364784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b94a7-e93b-4844-a38b-43783018fc47 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:28.482655 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b94a7-e93b-4844-a38b-43783018fc47 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:28.493972 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:28.521229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f50f64-1ca8-44c3-bc67-ab1aadd83f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:28.522116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f50f64-1ca8-44c3-bc67-ab1aadd83f3a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:28.522400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f50f64-1ca8-44c3-bc67-ab1aadd83f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:28.522676 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f50f64-1ca8-44c3-bc67-ab1aadd83f3a None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:28.523896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f50f64-1ca8-44c3-bc67-ab1aadd83f3a None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:28.525464 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f50f64-1ca8-44c3-bc67-ab1aadd83f3a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:28.527274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 146/285] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:28 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:28.533933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39546ee-ba9f-4432-ba46-d1b79b1460a4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:28.727614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39546ee-ba9f-4432-ba46-d1b79b1460a4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:28.730435 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:28.768489 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a219b-ad69-4211-bf7a-678da3aaae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:28.769922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a219b-ad69-4211-bf7a-678da3aaae80 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:28.770205 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a219b-ad69-4211-bf7a-678da3aaae80 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:28.770479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a219b-ad69-4211-bf7a-678da3aaae80 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce/users/424342bb36b94944b72e21bd9858cd34/roles/e3482518249a452d8c02c7d2d16f19dc` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:28.777338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a219b-ad69-4211-bf7a-678da3aaae80 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1615dfc209c4ce8a6f76bb6343932ce, user_id=424342bb36b94944b72e21bd9858cd34, role_id=e3482518249a452d8c02c7d2d16f19dc)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:28.778882 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a219b-ad69-4211-bf7a-678da3aaae80 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:28.837405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 140/286] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:04:28 2022] PUT /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce/users/424342bb36b94944b72e21bd9858cd34/roles/e3482518249a452d8c02c7d2d16f19dc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:29.021680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a226bb-ddc8-4410-a837-6842c6a7a010 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:29.021992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a226bb-ddc8-4410-a837-6842c6a7a010 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:29.022159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a226bb-ddc8-4410-a837-6842c6a7a010 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:29.023548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 147/287] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:29.028941 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e3b1-ac2c-4dae-a241-7b382191fcec None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:29.029229 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e3b1-ac2c-4dae-a241-7b382191fcec None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:29.029500 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e3b1-ac2c-4dae-a241-7b382191fcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:29.050603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8520e3b1-ac2c-4dae-a241-7b382191fcec None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:29.052147 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8520e3b1-ac2c-4dae-a241-7b382191fcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:29.133060 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 141/288] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:29.157862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a226bb-ddc8-4410-a837-6842c6a7a010 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:29.267503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a226bb-ddc8-4410-a837-6842c6a7a010 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:29.309101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf2b6a-24b4-4fb6-9c96-f1c5f2529a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:29.309827 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf2b6a-24b4-4fb6-9c96-f1c5f2529a0b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:29.310110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf2b6a-24b4-4fb6-9c96-f1c5f2529a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:29.310387 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf2b6a-24b4-4fb6-9c96-f1c5f2529a0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:29.325009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf2b6a-24b4-4fb6-9c96-f1c5f2529a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-98bf2b6a-24b4-4fb6-9c96-f1c5f2529a0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:29.333509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:29.334400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:29.335206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:29.335206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:29.335206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:29.335206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:29.335206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:29.335206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:29.335206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:29.335206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:29.335206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:29.335206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:29.335206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:29.335206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:29.335206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 148/289] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:29.340884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520e3b1-ac2c-4dae-a241-7b382191fcec None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:29.467917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:29.478256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520e3b1-ac2c-4dae-a241-7b382191fcec None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:29.530609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59adf4-be23-4bdc-8898-dfbaaf0f309a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:29.531282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59adf4-be23-4bdc-8898-dfbaaf0f309a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:29.531563 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59adf4-be23-4bdc-8898-dfbaaf0f309a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:29.531839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59adf4-be23-4bdc-8898-dfbaaf0f309a None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:29.532655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59adf4-be23-4bdc-8898-dfbaaf0f309a None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:29.532962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59adf4-be23-4bdc-8898-dfbaaf0f309a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:29.534336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59adf4-be23-4bdc-8898-dfbaaf0f309a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:29.547262 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 142/290] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:29.553237 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf2b6a-24b4-4fb6-9c96-f1c5f2529a0b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:29.626869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:29.746905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf2b6a-24b4-4fb6-9c96-f1c5f2529a0b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:29.787643 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c28fa-82e0-46a7-a5d9-bf6d0f7e5531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:29.788555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c28fa-82e0-46a7-a5d9-bf6d0f7e5531 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:29.788837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c28fa-82e0-46a7-a5d9-bf6d0f7e5531 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:29.789117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c28fa-82e0-46a7-a5d9-bf6d0f7e5531 None admin] PATH_INFO: `/v3/users/a737fd42eb7b4ae4a3b1bd7836f0c782` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:29.790324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c28fa-82e0-46a7-a5d9-bf6d0f7e5531 None admin] RBAC: Authorizing `identity:get_user(user_id=a737fd42eb7b4ae4a3b1bd7836f0c782)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:29.791851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c28fa-82e0-46a7-a5d9-bf6d0f7e5531 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:29.793662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 149/291] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:29 2022] GET /identity/v3/users/a737fd42eb7b4ae4a3b1bd7836f0c782 => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:29.799691 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59adf4-be23-4bdc-8898-dfbaaf0f309a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:29.945373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59adf4-be23-4bdc-8898-dfbaaf0f309a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:29.987435 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e85ab-fc0b-4ba7-8d0b-9bfdd6e011f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:29.988106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e85ab-fc0b-4ba7-8d0b-9bfdd6e011f4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:29.988394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e85ab-fc0b-4ba7-8d0b-9bfdd6e011f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:29.988670 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e85ab-fc0b-4ba7-8d0b-9bfdd6e011f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:30.022310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:30.074447 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e85ab-fc0b-4ba7-8d0b-9bfdd6e011f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:30.076080 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e85ab-fc0b-4ba7-8d0b-9bfdd6e011f4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:30.159629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef6391-2e2d-46e5-8fd3-e2d9ad117b90 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:30.159944 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef6391-2e2d-46e5-8fd3-e2d9ad117b90 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:30.160230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef6391-2e2d-46e5-8fd3-e2d9ad117b90 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:30.161871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 150/292] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:04:30.167094 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420a207-0d6f-47df-9316-c81ea14f4b38 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:30.167381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420a207-0d6f-47df-9316-c81ea14f4b38 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:30.167661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420a207-0d6f-47df-9316-c81ea14f4b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:30.197523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0420a207-0d6f-47df-9316-c81ea14f4b38 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:30.198707 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0420a207-0d6f-47df-9316-c81ea14f4b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:30.218263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 143/293] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:30.225852 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e85ab-fc0b-4ba7-8d0b-9bfdd6e011f4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:30.324912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:30.336808 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 151/294] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:30.367444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420a207-0d6f-47df-9316-c81ea14f4b38 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:30.389803 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e85ab-fc0b-4ba7-8d0b-9bfdd6e011f4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:30.411018 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:30.447723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23f3ea-0808-4585-b177-8f7511942a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:30.449343 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23f3ea-0808-4585-b177-8f7511942a63 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:30.449830 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23f3ea-0808-4585-b177-8f7511942a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:30.450393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23f3ea-0808-4585-b177-8f7511942a63 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:30.451808 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23f3ea-0808-4585-b177-8f7511942a63 None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:30.453454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23f3ea-0808-4585-b177-8f7511942a63 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:30.456374 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 144/295] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:30 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:30.465092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23f3ea-0808-4585-b177-8f7511942a63 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:30.517628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420a207-0d6f-47df-9316-c81ea14f4b38 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:30.552964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98788db-81a6-43e1-8cc1-4c8ffb101c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:30.553766 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98788db-81a6-43e1-8cc1-4c8ffb101c3a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:30.554295 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98788db-81a6-43e1-8cc1-4c8ffb101c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:30.554295 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98788db-81a6-43e1-8cc1-4c8ffb101c3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:30.573013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98788db-81a6-43e1-8cc1-4c8ffb101c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:30.578346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23f3ea-0808-4585-b177-8f7511942a63 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-e98788db-81a6-43e1-8cc1-4c8ffb101c3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:30.590650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:30.591581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:30.592433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:30.592433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:30.592433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:30.592433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:30.592433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:30.592433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:30.592433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:30.592433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:30.592433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:30.592433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:30.592433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:30.592433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:30.592433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 152/296] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:30.601970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98788db-81a6-43e1-8cc1-4c8ffb101c3a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:30.608730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:30.625705 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68ae08-7500-4ac4-92c3-513ae604c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:30.626798 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68ae08-7500-4ac4-92c3-513ae604c009 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:30.627224 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68ae08-7500-4ac4-92c3-513ae604c009 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:30.628175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68ae08-7500-4ac4-92c3-513ae604c009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:30.629154 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68ae08-7500-4ac4-92c3-513ae604c009 None admin] RBAC: Adding query filter params (role.id=d47bb3db22444385b7884acbc7e21b0f, scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce, user.id=a737fd42eb7b4ae4a3b1bd7836f0c782) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:30.631072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68ae08-7500-4ac4-92c3-513ae604c009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:30.632709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68ae08-7500-4ac4-92c3-513ae604c009 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:30.643834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 145/297] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:30 2022] GET /identity/v3/role_assignments?user.id=a737fd42eb7b4ae4a3b1bd7836f0c782&scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce&role.id=d47bb3db22444385b7884acbc7e21b0f => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:30.754438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:30.764339 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98788db-81a6-43e1-8cc1-4c8ffb101c3a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:30.802283 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104773a6-1b34-41d1-ac04-545b5e45d5a5 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:30.802677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104773a6-1b34-41d1-ac04-545b5e45d5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:30.802833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104773a6-1b34-41d1-ac04-545b5e45d5a5 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:30.804251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 146/298] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:04:30.809807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbe80-fde9-4f12-939d-0effac5d6718 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:30.810127 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbe80-fde9-4f12-939d-0effac5d6718 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:30.810374 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbe80-fde9-4f12-939d-0effac5d6718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:30.814908 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeda64a-1aa7-4f91-b06f-7b90bcc8a38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:30.815628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeda64a-1aa7-4f91-b06f-7b90bcc8a38a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:30.815869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeda64a-1aa7-4f91-b06f-7b90bcc8a38a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:30.816483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeda64a-1aa7-4f91-b06f-7b90bcc8a38a None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:30.818217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeda64a-1aa7-4f91-b06f-7b90bcc8a38a None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:30.818530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeda64a-1aa7-4f91-b06f-7b90bcc8a38a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:30.819922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeda64a-1aa7-4f91-b06f-7b90bcc8a38a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:30.836385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e59dbe80-fde9-4f12-939d-0effac5d6718 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:30.837633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e59dbe80-fde9-4f12-939d-0effac5d6718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:30.842027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 153/299] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:30.848816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeda64a-1aa7-4f91-b06f-7b90bcc8a38a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:30.967527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 147/300] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:30.992141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dbe80-fde9-4f12-939d-0effac5d6718 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:30.999314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeda64a-1aa7-4f91-b06f-7b90bcc8a38a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:31.039278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2eec0-6f1c-4d36-83ff-fa14da6b2ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:31.040182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2eec0-6f1c-4d36-83ff-fa14da6b2ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:31.040463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2eec0-6f1c-4d36-83ff-fa14da6b2ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:31.040735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2eec0-6f1c-4d36-83ff-fa14da6b2ee6 None admin] PATH_INFO: `/v3/users/54eabd38016d48c2b7c8babc5a800663` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:31.044055 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2eec0-6f1c-4d36-83ff-fa14da6b2ee6 None admin] RBAC: Authorizing `identity:get_user(user_id=54eabd38016d48c2b7c8babc5a800663)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:31.045521 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2eec0-6f1c-4d36-83ff-fa14da6b2ee6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:31.049567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 154/301] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:30 2022] GET /identity/v3/users/54eabd38016d48c2b7c8babc5a800663 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:31.049567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0cee1-b1f7-468c-9b29-dc021877f75a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:31.049567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0cee1-b1f7-468c-9b29-dc021877f75a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:31.049852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0cee1-b1f7-468c-9b29-dc021877f75a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:31.050969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 155/302] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:31.059064 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0cee1-b1f7-468c-9b29-dc021877f75a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:31.096976 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:31.128468 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dbe80-fde9-4f12-939d-0effac5d6718 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:31.147376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:31.165785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50ffb2-cb40-47bc-8804-a4b79272d34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:31.166591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50ffb2-cb40-47bc-8804-a4b79272d34d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:31.166881 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50ffb2-cb40-47bc-8804-a4b79272d34d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:31.167185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50ffb2-cb40-47bc-8804-a4b79272d34d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:31.168585 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50ffb2-cb40-47bc-8804-a4b79272d34d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:31.169823 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50ffb2-cb40-47bc-8804-a4b79272d34d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:31.171615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 148/303] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:31.177508 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531499c-d393-4d98-87ed-d2a7d7b607ef None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:31.177794 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531499c-d393-4d98-87ed-d2a7d7b607ef None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:31.178079 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531499c-d393-4d98-87ed-d2a7d7b607ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:31.191399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0cee1-b1f7-468c-9b29-dc021877f75a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:31.197169 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5531499c-d393-4d98-87ed-d2a7d7b607ef None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:31.198362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5531499c-d393-4d98-87ed-d2a7d7b607ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:31.228579 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1a97a-755a-456b-a7d7-f527ca1632d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:31.229448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1a97a-755a-456b-a7d7-f527ca1632d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:31.229730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1a97a-755a-456b-a7d7-f527ca1632d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:31.230002 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1a97a-755a-456b-a7d7-f527ca1632d1 None admin] PATH_INFO: `/v3/system/users/54eabd38016d48c2b7c8babc5a800663/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:31.231496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1a97a-755a-456b-a7d7-f527ca1632d1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=54eabd38016d48c2b7c8babc5a800663, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:31.232929 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1a97a-755a-456b-a7d7-f527ca1632d1 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:31.270789 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 149/304] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:31.271499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531499c-d393-4d98-87ed-d2a7d7b607ef None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:31.317616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 156/305] 10.222.0.74 () {58 vars in 1334 bytes} [Thu Jul 14 10:04:31 2022] PUT /identity/v3/system/users/54eabd38016d48c2b7c8babc5a800663/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:31.318422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1a97a-755a-456b-a7d7-f527ca1632d1 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:31.393953 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531499c-d393-4d98-87ed-d2a7d7b607ef None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:31.412663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:31.429255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:31.431182 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a94c9f-cb8e-459a-9954-4c37c145c4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:31.431865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94c9f-cb8e-459a-9954-4c37c145c4e2 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:31.432178 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94c9f-cb8e-459a-9954-4c37c145c4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:31.432450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94c9f-cb8e-459a-9954-4c37c145c4e2 None admin] PATH_INFO: `/v3/groups` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:31.433145 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a94c9f-cb8e-459a-9954-4c37c145c4e2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:31.434811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a94c9f-cb8e-459a-9954-4c37c145c4e2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:31.443346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1a97a-755a-456b-a7d7-f527ca1632d1 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:31.480330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c44839-8472-4551-9fa0-a44358ce58ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:31.481143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c44839-8472-4551-9fa0-a44358ce58ff None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:31.481783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c44839-8472-4551-9fa0-a44358ce58ff None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:31.482229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c44839-8472-4551-9fa0-a44358ce58ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:31.493264 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c44839-8472-4551-9fa0-a44358ce58ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-48c44839-8472-4551-9fa0-a44358ce58ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:31.501035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:31.502187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:31.502989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:31.502989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:31.502989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:31.502989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:31.502989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:31.502989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:31.502989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:31.502989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:31.502989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:31.502989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:31.502989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:31.502989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:31.502989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 157/306] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:31.503832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51587afb-cb86-4276-a5cf-fa2bf474e1aa None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:31.503832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51587afb-cb86-4276-a5cf-fa2bf474e1aa None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:31.503950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51587afb-cb86-4276-a5cf-fa2bf474e1aa None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:31.505371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 158/307] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:31.510820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51587afb-cb86-4276-a5cf-fa2bf474e1aa None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:31.523182 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 150/308] 10.222.0.74 () {60 vars in 1134 bytes} [Thu Jul 14 10:04:31 2022] POST /identity/v3/groups => generated 229 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:04:31.524496 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536de34-49e8-4922-bf6f-41e6fa8fd17a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:31.524775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536de34-49e8-4922-bf6f-41e6fa8fd17a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:31.525050 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536de34-49e8-4922-bf6f-41e6fa8fd17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:31.554903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6536de34-49e8-4922-bf6f-41e6fa8fd17a None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:31.556500 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6536de34-49e8-4922-bf6f-41e6fa8fd17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:31.644306 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 151/309] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:31.644546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51587afb-cb86-4276-a5cf-fa2bf474e1aa None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:31.668503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536de34-49e8-4922-bf6f-41e6fa8fd17a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:31.686227 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11729894-e7a6-4d29-b00f-deffe6da3d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:31.686945 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11729894-e7a6-4d29-b00f-deffe6da3d68 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:31.687225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11729894-e7a6-4d29-b00f-deffe6da3d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:31.687499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11729894-e7a6-4d29-b00f-deffe6da3d68 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:31.689487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11729894-e7a6-4d29-b00f-deffe6da3d68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:31.689801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11729894-e7a6-4d29-b00f-deffe6da3d68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:31.691205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11729894-e7a6-4d29-b00f-deffe6da3d68 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:31.704418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 159/310] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:31.705716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11729894-e7a6-4d29-b00f-deffe6da3d68 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:31.719526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:31.803928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536de34-49e8-4922-bf6f-41e6fa8fd17a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:31.814645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:31.836835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11729894-e7a6-4d29-b00f-deffe6da3d68 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:31.852734 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2a836-0b34-4901-8654-fbddd072b6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:31.853562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2a836-0b34-4901-8654-fbddd072b6af None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:31.853842 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2a836-0b34-4901-8654-fbddd072b6af None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:31.854113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2a836-0b34-4901-8654-fbddd072b6af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:31.869527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2a836-0b34-4901-8654-fbddd072b6af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-20e2a836-0b34-4901-8654-fbddd072b6af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:31.877307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:31.879017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:31.879819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:31.879819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:31.879819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:31.879819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:31.879819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:31.879819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:31.879819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:31.879819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:31.879819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:31.879819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:31.879819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:31.879819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:31.883657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 152/311] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:31.884676 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedbf5d-0279-47d8-a4f6-a056f578ce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:31.885561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedbf5d-0279-47d8-a4f6-a056f578ce12 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:31.885840 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedbf5d-0279-47d8-a4f6-a056f578ce12 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:31.886112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedbf5d-0279-47d8-a4f6-a056f578ce12 None admin] PATH_INFO: `/v3/users/0b44350cdfae4baf994f3c35811c5a4e` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:31.887540 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2a836-0b34-4901-8654-fbddd072b6af None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:31.905317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedbf5d-0279-47d8-a4f6-a056f578ce12 None admin] RBAC: Authorizing `identity:get_user(user_id=0b44350cdfae4baf994f3c35811c5a4e)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:31.906729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedbf5d-0279-47d8-a4f6-a056f578ce12 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:31.914380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 160/312] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:31 2022] GET /identity/v3/users/0b44350cdfae4baf994f3c35811c5a4e => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:31.915197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedbf5d-0279-47d8-a4f6-a056f578ce12 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:31.987885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:32.002407 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2a836-0b34-4901-8654-fbddd072b6af None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:32.023729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedbf5d-0279-47d8-a4f6-a056f578ce12 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:32.039529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e0e1e-1ece-45a6-b873-ab17295e2441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:32.040758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e0e1e-1ece-45a6-b873-ab17295e2441 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:32.041246 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e0e1e-1ece-45a6-b873-ab17295e2441 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:32.041747 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e0e1e-1ece-45a6-b873-ab17295e2441 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:32.042699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e0e1e-1ece-45a6-b873-ab17295e2441 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:32.043297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e0e1e-1ece-45a6-b873-ab17295e2441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:32.045041 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e0e1e-1ece-45a6-b873-ab17295e2441 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:32.059757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 153/313] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:32.061063 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e0e1e-1ece-45a6-b873-ab17295e2441 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:32.063191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d3dba-3691-4bbc-92ff-47523f349ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:32.064264 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d3dba-3691-4bbc-92ff-47523f349ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:32.064696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d3dba-3691-4bbc-92ff-47523f349ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:32.065703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d3dba-3691-4bbc-92ff-47523f349ae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:32.066696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d3dba-3691-4bbc-92ff-47523f349ae8 None admin] RBAC: Adding query filter params (role.id=e3482518249a452d8c02c7d2d16f19dc, user.id=0b44350cdfae4baf994f3c35811c5a4e, scope.system=all) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:32.067155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d3dba-3691-4bbc-92ff-47523f349ae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:32.069310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d3dba-3691-4bbc-92ff-47523f349ae8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:32.084468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 161/314] 10.222.0.74 () {56 vars in 1308 bytes} [Thu Jul 14 10:04:31 2022] GET /identity/v3/role_assignments?user.id=0b44350cdfae4baf994f3c35811c5a4e&scope.system=all&role.id=e3482518249a452d8c02c7d2d16f19dc => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:32.092692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:32.173680 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e0e1e-1ece-45a6-b873-ab17295e2441 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:32.211420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fc997-498d-498b-9b63-a3704f41d022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:32.212508 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fc997-498d-498b-9b63-a3704f41d022 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:32.212889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fc997-498d-498b-9b63-a3704f41d022 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:32.213280 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fc997-498d-498b-9b63-a3704f41d022 None admin] PATH_INFO: `/v3/users/424342bb36b94944b72e21bd9858cd34` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:32.214677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fc997-498d-498b-9b63-a3704f41d022 None admin] RBAC: Authorizing `identity:get_user(user_id=424342bb36b94944b72e21bd9858cd34)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:32.216293 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fc997-498d-498b-9b63-a3704f41d022 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:32.223247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 154/315] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:32 2022] GET /identity/v3/users/424342bb36b94944b72e21bd9858cd34 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:32.224811 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d3dba-3691-4bbc-92ff-47523f349ae8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:32.333327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d3dba-3691-4bbc-92ff-47523f349ae8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:32.365449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:32.370571 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427948e4-4876-4c45-bf7f-87e44d2449e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:32.371346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427948e4-4876-4c45-bf7f-87e44d2449e7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:32.371821 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427948e4-4876-4c45-bf7f-87e44d2449e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:32.372225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427948e4-4876-4c45-bf7f-87e44d2449e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:32.443114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427948e4-4876-4c45-bf7f-87e44d2449e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:32.444616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427948e4-4876-4c45-bf7f-87e44d2449e7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:32.551964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 162/316] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:32.553393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fc997-498d-498b-9b63-a3704f41d022 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:32.663097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:32.669479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fc997-498d-498b-9b63-a3704f41d022 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:32.703954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10765d1-a9f0-4098-a549-f5b89e1a8fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:32.705325 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10765d1-a9f0-4098-a549-f5b89e1a8fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:32.705603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10765d1-a9f0-4098-a549-f5b89e1a8fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:32.705870 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10765d1-a9f0-4098-a549-f5b89e1a8fa5 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:32.707052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10765d1-a9f0-4098-a549-f5b89e1a8fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:32.708636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10765d1-a9f0-4098-a549-f5b89e1a8fa5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:32.710659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 155/317] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:32 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:32.716487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427948e4-4876-4c45-bf7f-87e44d2449e7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:32.753340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:32.819526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427948e4-4876-4c45-bf7f-87e44d2449e7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:32.854692 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b17359-a5e2-46f7-a3a3-cfe399b344cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:32.855354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17359-a5e2-46f7-a3a3-cfe399b344cc None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:32.855640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17359-a5e2-46f7-a3a3-cfe399b344cc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:32.855914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17359-a5e2-46f7-a3a3-cfe399b344cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:32.856781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b17359-a5e2-46f7-a3a3-cfe399b344cc None admin] RBAC: Adding query filter params (role.id=e3482518249a452d8c02c7d2d16f19dc, scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce, user.id=424342bb36b94944b72e21bd9858cd34) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:32.857090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b17359-a5e2-46f7-a3a3-cfe399b344cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:32.858547 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b17359-a5e2-46f7-a3a3-cfe399b344cc None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:32.872145 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 163/318] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:32 2022] GET /identity/v3/role_assignments?user.id=424342bb36b94944b72e21bd9858cd34&scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce&role.id=e3482518249a452d8c02c7d2d16f19dc => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:33.405356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78ddb7-4ca1-440b-8d24-0b9f5a44b485 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:33.405766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78ddb7-4ca1-440b-8d24-0b9f5a44b485 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:33.406056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78ddb7-4ca1-440b-8d24-0b9f5a44b485 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:33.407500 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 156/319] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:33.412807 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36660a26-caef-47f3-98d1-287feab9e7ae None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:33.413100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36660a26-caef-47f3-98d1-287feab9e7ae None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:33.413376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36660a26-caef-47f3-98d1-287feab9e7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:33.430548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-36660a26-caef-47f3-98d1-287feab9e7ae None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:33.431739 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-36660a26-caef-47f3-98d1-287feab9e7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:33.500364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 164/320] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:33.525053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78ddb7-4ca1-440b-8d24-0b9f5a44b485 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:33.627710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78ddb7-4ca1-440b-8d24-0b9f5a44b485 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:33.655238 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736b159-75ac-4c68-b707-b78ddc9aedaa None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:33.655568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736b159-75ac-4c68-b707-b78ddc9aedaa None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:33.655806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736b159-75ac-4c68-b707-b78ddc9aedaa None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:33.657340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 165/321] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:04:33.663715 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208147b3-1ade-4896-bbf5-1c8660a594e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:33.663863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7041-df81-45a4-b05d-2fc1a45cf5fb None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:33.663941 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208147b3-1ade-4896-bbf5-1c8660a594e9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:33.664041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7041-df81-45a4-b05d-2fc1a45cf5fb None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:33.664137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208147b3-1ade-4896-bbf5-1c8660a594e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:33.664209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7041-df81-45a4-b05d-2fc1a45cf5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:33.664276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208147b3-1ade-4896-bbf5-1c8660a594e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:33.675042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208147b3-1ade-4896-bbf5-1c8660a594e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:33.681066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-181a7041-df81-45a4-b05d-2fc1a45cf5fb None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:33.682324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-181a7041-df81-45a4-b05d-2fc1a45cf5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-208147b3-1ade-4896-bbf5-1c8660a594e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:33.682721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:33.683568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:33.684422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:33.684422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:33.684422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:33.684422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:33.684422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:33.684422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:33.684422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:33.684422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:33.684422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:33.684422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:33.684422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:33.684422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:33.684422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 157/322] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:33.691425 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208147b3-1ade-4896-bbf5-1c8660a594e9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:33.705522 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:33.718414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:33.753159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 166/323] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:33.776146 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a7041-df81-45a4-b05d-2fc1a45cf5fb None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:33.841005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208147b3-1ade-4896-bbf5-1c8660a594e9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:33.841548 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea12b0d-8e61-4c9c-bd8b-b87535b67405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:33.842223 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea12b0d-8e61-4c9c-bd8b-b87535b67405 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:33.842506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea12b0d-8e61-4c9c-bd8b-b87535b67405 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:33.842778 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea12b0d-8e61-4c9c-bd8b-b87535b67405 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:33.844480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea12b0d-8e61-4c9c-bd8b-b87535b67405 None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:33.844813 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea12b0d-8e61-4c9c-bd8b-b87535b67405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:33.846325 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea12b0d-8e61-4c9c-bd8b-b87535b67405 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:33.859967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 158/324] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:33.861820 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea12b0d-8e61-4c9c-bd8b-b87535b67405 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:33.889417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a7041-df81-45a4-b05d-2fc1a45cf5fb None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:33.924639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d50add-63c5-45a2-b5fa-c80e7b3caea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:33.925360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50add-63c5-45a2-b5fa-c80e7b3caea6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:33.925644 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50add-63c5-45a2-b5fa-c80e7b3caea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:33.925926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50add-63c5-45a2-b5fa-c80e7b3caea6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:33.927161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d50add-63c5-45a2-b5fa-c80e7b3caea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:33.928659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d50add-63c5-45a2-b5fa-c80e7b3caea6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:33.930590 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 167/325] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:33.935672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d50add-63c5-45a2-b5fa-c80e7b3caea6 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:33.961062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:33.962841 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:33.976352 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea12b0d-8e61-4c9c-bd8b-b87535b67405 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:34.015820 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db46a19-f937-481a-9739-caaf459b379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:34.016774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db46a19-f937-481a-9739-caaf459b379e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:34.017694 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db46a19-f937-481a-9739-caaf459b379e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:34.017974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db46a19-f937-481a-9739-caaf459b379e None admin] PATH_INFO: `/v3/users/54eabd38016d48c2b7c8babc5a800663` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:34.019479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db46a19-f937-481a-9739-caaf459b379e None admin] RBAC: Authorizing `identity:get_user(user_id=54eabd38016d48c2b7c8babc5a800663)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:34.020972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db46a19-f937-481a-9739-caaf459b379e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:34.022768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 159/326] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:33 2022] GET /identity/v3/users/54eabd38016d48c2b7c8babc5a800663 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:34.028342 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db46a19-f937-481a-9739-caaf459b379e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:34.045124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d50add-63c5-45a2-b5fa-c80e7b3caea6 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:34.084047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609a9e2-4de9-4b7f-8f04-d16a8a13f566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:34.084883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a9e2-4de9-4b7f-8f04-d16a8a13f566 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:34.085168 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a9e2-4de9-4b7f-8f04-d16a8a13f566 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:34.085820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a9e2-4de9-4b7f-8f04-d16a8a13f566 None admin] PATH_INFO: `/v3/groups` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:34.086518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609a9e2-4de9-4b7f-8f04-d16a8a13f566 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:34.087961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609a9e2-4de9-4b7f-8f04-d16a8a13f566 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:34.140950 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db46a19-f937-481a-9739-caaf459b379e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:34.175615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591ec19-e822-4ddf-97dc-4ae140c3d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:34.176234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591ec19-e822-4ddf-97dc-4ae140c3d250 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:34.176514 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591ec19-e822-4ddf-97dc-4ae140c3d250 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:34.176784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591ec19-e822-4ddf-97dc-4ae140c3d250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:34.177608 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591ec19-e822-4ddf-97dc-4ae140c3d250 None admin] RBAC: Adding query filter params (role.id=d47bb3db22444385b7884acbc7e21b0f, user.id=54eabd38016d48c2b7c8babc5a800663, scope.system=all) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:34.177913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591ec19-e822-4ddf-97dc-4ae140c3d250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:34.179399 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591ec19-e822-4ddf-97dc-4ae140c3d250 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:34.185319 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 168/327] 10.222.0.74 () {60 vars in 1134 bytes} [Thu Jul 14 10:04:33 2022] POST /identity/v3/groups => generated 226 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:04:34.191800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351209bf-3e5c-4a36-abb9-7923fc36f3af None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:34.191800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351209bf-3e5c-4a36-abb9-7923fc36f3af None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:34.191800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351209bf-3e5c-4a36-abb9-7923fc36f3af None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:34.191800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 169/328] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:34.195512 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 160/329] 10.222.0.74 () {56 vars in 1308 bytes} [Thu Jul 14 10:04:34 2022] GET /identity/v3/role_assignments?user.id=54eabd38016d48c2b7c8babc5a800663&scope.system=all&role.id=d47bb3db22444385b7884acbc7e21b0f => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:34.195696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609c3b-c878-4ad1-8506-fdce925581be None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:34.195969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609c3b-c878-4ad1-8506-fdce925581be None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:34.196256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609c3b-c878-4ad1-8506-fdce925581be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:34.215839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-af609c3b-c878-4ad1-8506-fdce925581be None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:34.217161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-af609c3b-c878-4ad1-8506-fdce925581be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:34.304110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 170/330] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:34.321718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591ec19-e822-4ddf-97dc-4ae140c3d250 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:34.339295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:34.435618 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591ec19-e822-4ddf-97dc-4ae140c3d250 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:34.473242 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2841a-42d7-4b39-854e-395983f726b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:34.474040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2841a-42d7-4b39-854e-395983f726b3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:34.474322 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2841a-42d7-4b39-854e-395983f726b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:34.474598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2841a-42d7-4b39-854e-395983f726b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:34.485353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2841a-42d7-4b39-854e-395983f726b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-28e2841a-42d7-4b39-854e-395983f726b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:34.493044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:34.494167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:34.495227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:34.495227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:34.495227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:34.495227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:34.495227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:34.495227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:34.495227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:34.495227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:34.495227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:34.495227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:34.495227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:34.495227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:34.495227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 161/331] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:34.501304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af609c3b-c878-4ad1-8506-fdce925581be None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:34.517661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:34.610801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af609c3b-c878-4ad1-8506-fdce925581be None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:34.703683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c71f6-77cc-4205-be21-85b8cec3ba14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:34.704876 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c71f6-77cc-4205-be21-85b8cec3ba14 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:34.705177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c71f6-77cc-4205-be21-85b8cec3ba14 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:34.705446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c71f6-77cc-4205-be21-85b8cec3ba14 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:34.706318 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c71f6-77cc-4205-be21-85b8cec3ba14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:34.706630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c71f6-77cc-4205-be21-85b8cec3ba14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:34.708090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c71f6-77cc-4205-be21-85b8cec3ba14 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:34.717753 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 171/332] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:34.723521 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2841a-42d7-4b39-854e-395983f726b3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:34.807416 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:34.839131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2841a-42d7-4b39-854e-395983f726b3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:34.884279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd118a3-ec5f-40e9-aa71-f0c6af3756c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:34.885178 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd118a3-ec5f-40e9-aa71-f0c6af3756c8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:34.885470 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd118a3-ec5f-40e9-aa71-f0c6af3756c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:34.885749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd118a3-ec5f-40e9-aa71-f0c6af3756c8 None admin] PATH_INFO: `/v3/users/0b44350cdfae4baf994f3c35811c5a4e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:34.887391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd118a3-ec5f-40e9-aa71-f0c6af3756c8 None admin] RBAC: Authorizing `identity:get_user(user_id=0b44350cdfae4baf994f3c35811c5a4e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:34.888889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd118a3-ec5f-40e9-aa71-f0c6af3756c8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:34.890866 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 162/333] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:34 2022] GET /identity/v3/users/0b44350cdfae4baf994f3c35811c5a4e => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:34.896128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c71f6-77cc-4205-be21-85b8cec3ba14 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:35.007101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:35.039207 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c71f6-77cc-4205-be21-85b8cec3ba14 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:35.086450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e9562-d8af-4533-b473-fa3eb49bae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:35.087324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e9562-d8af-4533-b473-fa3eb49bae4e None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:35.087600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e9562-d8af-4533-b473-fa3eb49bae4e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:35.087871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e9562-d8af-4533-b473-fa3eb49bae4e None admin] PATH_INFO: `/v3/system/users/0b44350cdfae4baf994f3c35811c5a4e/roles/e3482518249a452d8c02c7d2d16f19dc` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:35.089397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e9562-d8af-4533-b473-fa3eb49bae4e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0b44350cdfae4baf994f3c35811c5a4e, role_id=e3482518249a452d8c02c7d2d16f19dc)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:35.090790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e9562-d8af-4533-b473-fa3eb49bae4e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:35.169175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 172/334] 10.222.0.74 () {58 vars in 1334 bytes} [Thu Jul 14 10:04:34 2022] PUT /identity/v3/system/users/0b44350cdfae4baf994f3c35811c5a4e/roles/e3482518249a452d8c02c7d2d16f19dc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:36.717517 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6d658-40ce-4358-85dc-7eaa7c774655 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:36.718045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6d658-40ce-4358-85dc-7eaa7c774655 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:36.718045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6d658-40ce-4358-85dc-7eaa7c774655 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:36.719731 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 163/335] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:36.742030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229312f2-364c-4a3f-b84c-fe47d58fe354 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:36.742560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229312f2-364c-4a3f-b84c-fe47d58fe354 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:36.742560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229312f2-364c-4a3f-b84c-fe47d58fe354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:36.764443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-229312f2-364c-4a3f-b84c-fe47d58fe354 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:36.765632 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-229312f2-364c-4a3f-b84c-fe47d58fe354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:36.854687 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 173/336] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:36.905247 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229312f2-364c-4a3f-b84c-fe47d58fe354 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:36.905737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d5b2f-3e78-427a-9546-e60b898593b2 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:36.906034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d5b2f-3e78-427a-9546-e60b898593b2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:36.906319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d5b2f-3e78-427a-9546-e60b898593b2 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:36.907967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 164/337] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:36.913325 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedfff9-cb19-45d2-90b5-28db35e388e7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:36.913614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedfff9-cb19-45d2-90b5-28db35e388e7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:36.913896 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedfff9-cb19-45d2-90b5-28db35e388e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:36.932585 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0fedfff9-cb19-45d2-90b5-28db35e388e7 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:36.933796 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0fedfff9-cb19-45d2-90b5-28db35e388e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:36.999211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:37.010139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 165/338] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:37.035124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229312f2-364c-4a3f-b84c-fe47d58fe354 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:37.041614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedfff9-cb19-45d2-90b5-28db35e388e7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:37.076134 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ea7b6-3111-43a0-a45c-59a3e5763ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:37.076954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ea7b6-3111-43a0-a45c-59a3e5763ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:37.077239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ea7b6-3111-43a0-a45c-59a3e5763ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:37.077517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ea7b6-3111-43a0-a45c-59a3e5763ad1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:37.093236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ea7b6-3111-43a0-a45c-59a3e5763ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-243ea7b6-3111-43a0-a45c-59a3e5763ad1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:37.101975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:37.102860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:37.104123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:37.104123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:37.104123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:37.104123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:37.104123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:37.104123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:37.104123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:37.104123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:37.104123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:37.104123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:37.104123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:37.104123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:37.104123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 174/339] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:37.117389 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ea7b6-3111-43a0-a45c-59a3e5763ad1 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:37.194213 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:37.254079 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedfff9-cb19-45d2-90b5-28db35e388e7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:37.290688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ea7b6-3111-43a0-a45c-59a3e5763ad1 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:37.324979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:37.333791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989af1c1-c03c-4d06-93f9-eea75cb840f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:37.340173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989af1c1-c03c-4d06-93f9-eea75cb840f0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:37.340173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989af1c1-c03c-4d06-93f9-eea75cb840f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:37.340173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989af1c1-c03c-4d06-93f9-eea75cb840f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:37.340173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989af1c1-c03c-4d06-93f9-eea75cb840f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:37.340173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989af1c1-c03c-4d06-93f9-eea75cb840f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:37.340173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989af1c1-c03c-4d06-93f9-eea75cb840f0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:37.340841 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96543468-7b5c-414a-b2f4-70eb6f55b167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:37.341661 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96543468-7b5c-414a-b2f4-70eb6f55b167 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:37.341946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96543468-7b5c-414a-b2f4-70eb6f55b167 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:37.342230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96543468-7b5c-414a-b2f4-70eb6f55b167 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:37.356125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 175/340] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:37.357757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989af1c1-c03c-4d06-93f9-eea75cb840f0 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:37.381531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96543468-7b5c-414a-b2f4-70eb6f55b167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-96543468-7b5c-414a-b2f4-70eb6f55b167 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:37.389420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:37.390353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:37.391172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:37.391172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:37.391172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:37.391172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:37.391172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:37.391172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:37.391172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:37.391172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:37.391172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:37.391172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:37.391172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:37.391172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:37.391172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 166/341] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:37.398668 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96543468-7b5c-414a-b2f4-70eb6f55b167 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:37.495789 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989af1c1-c03c-4d06-93f9-eea75cb840f0 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:37.546045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96543468-7b5c-414a-b2f4-70eb6f55b167 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:37.549778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b31b0-c203-48c3-8c8a-c94dbacd2b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:37.550446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b31b0-c203-48c3-8c8a-c94dbacd2b15 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:37.550726 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b31b0-c203-48c3-8c8a-c94dbacd2b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:37.551000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b31b0-c203-48c3-8c8a-c94dbacd2b15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:37.616133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:37.635425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b31b0-c203-48c3-8c8a-c94dbacd2b15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:37.635633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68a379-ef39-4c22-94ed-cbfe940bbf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:37.636366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68a379-ef39-4c22-94ed-cbfe940bbf9c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:37.636648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68a379-ef39-4c22-94ed-cbfe940bbf9c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:37.636858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b31b0-c203-48c3-8c8a-c94dbacd2b15 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:37.636971 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68a379-ef39-4c22-94ed-cbfe940bbf9c None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:37.637662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68a379-ef39-4c22-94ed-cbfe940bbf9c None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:37.637965 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68a379-ef39-4c22-94ed-cbfe940bbf9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:37.639405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68a379-ef39-4c22-94ed-cbfe940bbf9c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:37.639821 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:37.658818 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 167/342] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:37.665293 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68a379-ef39-4c22-94ed-cbfe940bbf9c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:37.752120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 176/343] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:37.753520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b31b0-c203-48c3-8c8a-c94dbacd2b15 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:37.833538 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68a379-ef39-4c22-94ed-cbfe940bbf9c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:37.891696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:37.902517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b31b0-c203-48c3-8c8a-c94dbacd2b15 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:37.913382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea76f7-0f01-4dc5-943d-539c859b93ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:37.914058 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea76f7-0f01-4dc5-943d-539c859b93ff None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:37.914348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea76f7-0f01-4dc5-943d-539c859b93ff None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:37.914637 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea76f7-0f01-4dc5-943d-539c859b93ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:37.948136 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb83046-df53-406f-96b5-cf4102c6f898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:37.949485 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb83046-df53-406f-96b5-cf4102c6f898 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:37.949995 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb83046-df53-406f-96b5-cf4102c6f898 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:37.950479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb83046-df53-406f-96b5-cf4102c6f898 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:37.952038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb83046-df53-406f-96b5-cf4102c6f898 None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:37.953698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb83046-df53-406f-96b5-cf4102c6f898 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:37.957433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 177/344] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:37 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:37.959003 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b65a2-9e56-4dc9-8f4e-cad00c66d621 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:37.959587 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b65a2-9e56-4dc9-8f4e-cad00c66d621 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:37.960138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b65a2-9e56-4dc9-8f4e-cad00c66d621 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:37.961828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 178/345] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:37.970276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6e83-fcd6-46bb-80f6-3a0047d0d813 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:37.970863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6e83-fcd6-46bb-80f6-3a0047d0d813 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:37.971344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6e83-fcd6-46bb-80f6-3a0047d0d813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:38.000130 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e67e6e83-fcd6-46bb-80f6-3a0047d0d813 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:38.001854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e67e6e83-fcd6-46bb-80f6-3a0047d0d813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:38.015164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:38.024515 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea76f7-0f01-4dc5-943d-539c859b93ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:38.025994 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea76f7-0f01-4dc5-943d-539c859b93ff None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:38.153025 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 179/346] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:38.153898 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6e83-fcd6-46bb-80f6-3a0047d0d813 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:38.168919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 168/347] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:38.169817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea76f7-0f01-4dc5-943d-539c859b93ff None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:38.294787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:38.297228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:38.306699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea76f7-0f01-4dc5-943d-539c859b93ff None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:38.308588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6e83-fcd6-46bb-80f6-3a0047d0d813 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:38.341881 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4799c50-571a-4b22-ba1e-5afb1c2ee2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:38.343108 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4799c50-571a-4b22-ba1e-5afb1c2ee2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:38.343546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4799c50-571a-4b22-ba1e-5afb1c2ee2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:38.343980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4799c50-571a-4b22-ba1e-5afb1c2ee2a0 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:38.345384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4799c50-571a-4b22-ba1e-5afb1c2ee2a0 None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:38.346962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4799c50-571a-4b22-ba1e-5afb1c2ee2a0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:38.347099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5e10a-5efe-49db-a69f-6a0afd509f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:38.347961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5e10a-5efe-49db-a69f-6a0afd509f3a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:38.348422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5e10a-5efe-49db-a69f-6a0afd509f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:38.348858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5e10a-5efe-49db-a69f-6a0afd509f3a None admin] PATH_INFO: `/v3/groups/2b7c6144619943a48416cd40e5710bb8` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:38.349137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 169/348] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:38 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:38.349967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4799c50-571a-4b22-ba1e-5afb1c2ee2a0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:38.355664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5e10a-5efe-49db-a69f-6a0afd509f3a None admin] RBAC: Authorizing `identity:get_group(group_id=2b7c6144619943a48416cd40e5710bb8)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:38.358278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5e10a-5efe-49db-a69f-6a0afd509f3a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:38.360194 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 180/349] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:38 2022] GET /identity/v3/groups/2b7c6144619943a48416cd40e5710bb8 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:38.363117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313176ab-cd0b-4421-8e01-f6cbeeaad9ae None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:38.363577 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313176ab-cd0b-4421-8e01-f6cbeeaad9ae None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:38.364028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313176ab-cd0b-4421-8e01-f6cbeeaad9ae None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:38.365692 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 181/350] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:38.366527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313176ab-cd0b-4421-8e01-f6cbeeaad9ae None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:38.472111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4799c50-571a-4b22-ba1e-5afb1c2ee2a0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:38.486735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313176ab-cd0b-4421-8e01-f6cbeeaad9ae None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:38.509219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f16875-bad4-4acb-935b-a956b7883ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:38.510278 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f16875-bad4-4acb-935b-a956b7883ffe None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:38.510708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f16875-bad4-4acb-935b-a956b7883ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:38.511150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f16875-bad4-4acb-935b-a956b7883ffe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:38.523578 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f16875-bad4-4acb-935b-a956b7883ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:38.526654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97851d79-0710-411b-b843-abe3e0978089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:38.527715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97851d79-0710-411b-b843-abe3e0978089 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:38.528168 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97851d79-0710-411b-b843-abe3e0978089 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:38.528602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97851d79-0710-411b-b843-abe3e0978089 None admin] PATH_INFO: `/v3/groups/2b7c6144619943a48416cd40e5710bb8` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:38.529978 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97851d79-0710-411b-b843-abe3e0978089 None admin] RBAC: Authorizing `identity:get_group(group_id=2b7c6144619943a48416cd40e5710bb8)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:38.531572 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97851d79-0710-411b-b843-abe3e0978089 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-b8f16875-bad4-4acb-935b-a956b7883ffe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:38.531904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:38.533053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:38.533992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:38.533992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:38.533992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:38.533992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:38.533992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:38.533992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:38.533992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:38.533992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:38.533992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:38.533992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:38.533992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:38.533992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:38.533992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 170/351] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:04:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:38.534672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f16875-bad4-4acb-935b-a956b7883ffe None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:38.540930 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 182/352] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:38 2022] GET /identity/v3/groups/2b7c6144619943a48416cd40e5710bb8 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:38.542440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e745a2-45f3-45e2-b06b-c2c57ad61ab3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:38.542923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e745a2-45f3-45e2-b06b-c2c57ad61ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:38.543369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e745a2-45f3-45e2-b06b-c2c57ad61ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:38.559710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:38.563456 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-61e745a2-45f3-45e2-b06b-c2c57ad61ab3 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:38.565421 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-61e745a2-45f3-45e2-b06b-c2c57ad61ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:38.586959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:38.647937 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 183/353] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:38.648864 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e745a2-45f3-45e2-b06b-c2c57ad61ab3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:38.670766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f16875-bad4-4acb-935b-a956b7883ffe None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:38.715103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa957a-9006-4764-ab16-05707e933970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:38.715773 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa957a-9006-4764-ab16-05707e933970 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:38.716085 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa957a-9006-4764-ab16-05707e933970 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:38.716358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa957a-9006-4764-ab16-05707e933970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:38.717190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa957a-9006-4764-ab16-05707e933970 None admin] RBAC: Adding query filter params (group.id=2b7c6144619943a48416cd40e5710bb8, role.id=d47bb3db22444385b7884acbc7e21b0f, scope.project.id=8600563b295742f1a8d5ba26a2a51f14) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:38.717567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa957a-9006-4764-ab16-05707e933970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:38.719016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa957a-9006-4764-ab16-05707e933970 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:38.725057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 171/354] 10.222.0.74 () {56 vars in 1376 bytes} [Thu Jul 14 10:04:38 2022] GET /identity/v3/role_assignments?group.id=2b7c6144619943a48416cd40e5710bb8&scope.project.id=8600563b295742f1a8d5ba26a2a51f14&role.id=d47bb3db22444385b7884acbc7e21b0f => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:38.726688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa957a-9006-4764-ab16-05707e933970 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:38.785329 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e745a2-45f3-45e2-b06b-c2c57ad61ab3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:38.835534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6ccaf-727f-417e-94df-3166b9104b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:38.835790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:38.836245 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ccaf-727f-417e-94df-3166b9104b91 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:38.836531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ccaf-727f-417e-94df-3166b9104b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:38.836803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ccaf-727f-417e-94df-3166b9104b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:38.837656 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6ccaf-727f-417e-94df-3166b9104b91 None admin] RBAC: Adding query filter params (group.id=2b7c6144619943a48416cd40e5710bb8, role.id=d47bb3db22444385b7884acbc7e21b0f, scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:38.837966 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6ccaf-727f-417e-94df-3166b9104b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:38.839822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6ccaf-727f-417e-94df-3166b9104b91 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:38.847979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 184/355] 10.222.0.74 () {56 vars in 1376 bytes} [Thu Jul 14 10:04:38 2022] GET /identity/v3/role_assignments?group.id=2b7c6144619943a48416cd40e5710bb8&scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce&role.id=d47bb3db22444385b7884acbc7e21b0f => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:38.852039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aefe6-fe14-4036-9d70-e417dbe34594 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:38.852039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aefe6-fe14-4036-9d70-e417dbe34594 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:38.852039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aefe6-fe14-4036-9d70-e417dbe34594 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:38.852039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 185/356] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:38.853218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7928e1-ec32-43c5-aeb6-662cde97bf93 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:38.853543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7928e1-ec32-43c5-aeb6-662cde97bf93 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:38.853768 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7928e1-ec32-43c5-aeb6-662cde97bf93 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:38.856211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 186/357] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:38.857229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7928e1-ec32-43c5-aeb6-662cde97bf93 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:38.871378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa957a-9006-4764-ab16-05707e933970 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:38.881266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:38.919536 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24bca0-0d2a-474e-a91e-b7d9ba9e20cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:38.920811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24bca0-0d2a-474e-a91e-b7d9ba9e20cb None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:38.921102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24bca0-0d2a-474e-a91e-b7d9ba9e20cb None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:38.921379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24bca0-0d2a-474e-a91e-b7d9ba9e20cb None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:38.922172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24bca0-0d2a-474e-a91e-b7d9ba9e20cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:38.922490 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24bca0-0d2a-474e-a91e-b7d9ba9e20cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:38.924865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24bca0-0d2a-474e-a91e-b7d9ba9e20cb None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:38.938588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 172/358] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:38.941230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232efeb4-0d08-4d93-8768-442064cc31f7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:38.941529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232efeb4-0d08-4d93-8768-442064cc31f7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:38.941811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232efeb4-0d08-4d93-8768-442064cc31f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:38.965019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-232efeb4-0d08-4d93-8768-442064cc31f7 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:38.966640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-232efeb4-0d08-4d93-8768-442064cc31f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:38.996752 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7928e1-ec32-43c5-aeb6-662cde97bf93 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:39.042880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd42445-cb11-4dc9-aef1-6457cf477d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:39.043707 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd42445-cb11-4dc9-aef1-6457cf477d83 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:39.044070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd42445-cb11-4dc9-aef1-6457cf477d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:39.044461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd42445-cb11-4dc9-aef1-6457cf477d83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:39.059121 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd42445-cb11-4dc9-aef1-6457cf477d83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-efd42445-cb11-4dc9-aef1-6457cf477d83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:39.069014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:39.069965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:39.070794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:39.070794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:39.070794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:39.070794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:39.070794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:39.070794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:39.070794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:39.070794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:39.070794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:39.070794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:39.070794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:39.070794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:39.070794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 187/359] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:04:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:39.071932 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d6f9e-1ef0-4783-a7d2-d068e9eda4e8 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:39.073265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d6f9e-1ef0-4783-a7d2-d068e9eda4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:39.073265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d6f9e-1ef0-4783-a7d2-d068e9eda4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:39.075048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 173/360] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:39.075951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232efeb4-0d08-4d93-8768-442064cc31f7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:39.091358 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0c8d6f9e-1ef0-4783-a7d2-d068e9eda4e8 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:39.092636 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0c8d6f9e-1ef0-4783-a7d2-d068e9eda4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:39.168790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 188/361] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:39.169466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d6f9e-1ef0-4783-a7d2-d068e9eda4e8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:39.180348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:39.182542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:39.207810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232efeb4-0d08-4d93-8768-442064cc31f7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:39.249473 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db274a-ccff-4ba8-8041-894681eb12c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:39.250071 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db274a-ccff-4ba8-8041-894681eb12c3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:39.250355 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db274a-ccff-4ba8-8041-894681eb12c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:39.250631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db274a-ccff-4ba8-8041-894681eb12c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:39.309101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d6f9e-1ef0-4783-a7d2-d068e9eda4e8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:39.342803 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db274a-ccff-4ba8-8041-894681eb12c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:39.345720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db274a-ccff-4ba8-8041-894681eb12c3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:39.359942 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a36c4a-5195-4b06-8d87-2e4b092c1f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:39.361673 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a36c4a-5195-4b06-8d87-2e4b092c1f33 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:39.362209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a36c4a-5195-4b06-8d87-2e4b092c1f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:39.362711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a36c4a-5195-4b06-8d87-2e4b092c1f33 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:39.363671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a36c4a-5195-4b06-8d87-2e4b092c1f33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:39.364209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a36c4a-5195-4b06-8d87-2e4b092c1f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:39.365940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a36c4a-5195-4b06-8d87-2e4b092c1f33 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:39.375333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 189/362] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:39.381537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a36c4a-5195-4b06-8d87-2e4b092c1f33 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:39.440664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:39.464907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 174/363] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:39.466055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db274a-ccff-4ba8-8041-894681eb12c3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:39.484077 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:39.514177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a36c4a-5195-4b06-8d87-2e4b092c1f33 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:39.543602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da0047-fcee-452f-9fc7-02030cc3b40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:39.544558 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0047-fcee-452f-9fc7-02030cc3b40b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:39.544850 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0047-fcee-452f-9fc7-02030cc3b40b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:39.545135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0047-fcee-452f-9fc7-02030cc3b40b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:39.556290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da0047-fcee-452f-9fc7-02030cc3b40b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-28da0047-fcee-452f-9fc7-02030cc3b40b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:39.565926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:39.566920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:39.567756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:39.567756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:39.567756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:39.567756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:39.567756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:39.567756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:39.567756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:39.567756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:39.567756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:39.567756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:39.567756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:04:39.567756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:39.567756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 190/364] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:39.569171 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da0047-fcee-452f-9fc7-02030cc3b40b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:39.592332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db274a-ccff-4ba8-8041-894681eb12c3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:39.638147 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a1711-2b3f-4fca-872d-f2094c872faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:39.639358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a1711-2b3f-4fca-872d-f2094c872faa None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:39.639913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a1711-2b3f-4fca-872d-f2094c872faa None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:39.640226 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a1711-2b3f-4fca-872d-f2094c872faa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:39.655935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a1711-2b3f-4fca-872d-f2094c872faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-9c5a1711-2b3f-4fca-872d-f2094c872faa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:39.665805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:39.667932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:39.669408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:39.669408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:39.669408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:39.669408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:39.669408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:39.669408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:39.669408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:39.669408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:39.669408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:39.669408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:39.669408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:39.669408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:39.669408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 175/365] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:04:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:39.669408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a1711-2b3f-4fca-872d-f2094c872faa None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:39.720166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:39.724241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da0047-fcee-452f-9fc7-02030cc3b40b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:39.758775 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:39.773057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9f935-2b1c-4a03-8c7b-a77f7505c4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:39.773649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f935-2b1c-4a03-8c7b-a77f7505c4df None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:39.773940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f935-2b1c-4a03-8c7b-a77f7505c4df None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:39.774218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f935-2b1c-4a03-8c7b-a77f7505c4df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:39.807572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a1711-2b3f-4fca-872d-f2094c872faa None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:39.854078 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1997e8-79b1-42a3-a485-b94158220417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:39.854977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1997e8-79b1-42a3-a485-b94158220417 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:39.855258 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1997e8-79b1-42a3-a485-b94158220417 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:39.855673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1997e8-79b1-42a3-a485-b94158220417 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:39.857066 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1997e8-79b1-42a3-a485-b94158220417 None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:39.858523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1997e8-79b1-42a3-a485-b94158220417 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:39.860380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 176/366] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:39 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:39.861347 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1997e8-79b1-42a3-a485-b94158220417 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:39.863340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9f935-2b1c-4a03-8c7b-a77f7505c4df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:39.865902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9f935-2b1c-4a03-8c7b-a77f7505c4df None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:39.983951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1997e8-79b1-42a3-a485-b94158220417 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:39.987307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:39.989996 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 191/367] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:39.990912 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9f935-2b1c-4a03-8c7b-a77f7505c4df None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:40.036116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:40.042605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b574b0-c6b9-446c-9b08-4d795d614a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:40.044061 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b574b0-c6b9-446c-9b08-4d795d614a35 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:40.044558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b574b0-c6b9-446c-9b08-4d795d614a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:40.045372 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b574b0-c6b9-446c-9b08-4d795d614a35 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:40.046352 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b574b0-c6b9-446c-9b08-4d795d614a35 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:40.046885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b574b0-c6b9-446c-9b08-4d795d614a35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:40.048678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b574b0-c6b9-446c-9b08-4d795d614a35 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:40.059126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 177/368] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:40.060284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b574b0-c6b9-446c-9b08-4d795d614a35 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:40.131801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9f935-2b1c-4a03-8c7b-a77f7505c4df None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:40.172257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc74b1-e1ff-4daf-a7ad-d827d2c47ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:40.173227 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc74b1-e1ff-4daf-a7ad-d827d2c47ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:40.173672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc74b1-e1ff-4daf-a7ad-d827d2c47ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:40.174200 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc74b1-e1ff-4daf-a7ad-d827d2c47ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:40.175563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc74b1-e1ff-4daf-a7ad-d827d2c47ba0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:40.176135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc74b1-e1ff-4daf-a7ad-d827d2c47ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:40.177734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc74b1-e1ff-4daf-a7ad-d827d2c47ba0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:40.187227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b574b0-c6b9-446c-9b08-4d795d614a35 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:40.188234 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 192/369] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:40.189987 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc74b1-e1ff-4daf-a7ad-d827d2c47ba0 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:40.233453 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d535b-b0f4-4114-9a5e-a5ffee996e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:40.235328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d535b-b0f4-4114-9a5e-a5ffee996e4f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:40.235328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d535b-b0f4-4114-9a5e-a5ffee996e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:40.235328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d535b-b0f4-4114-9a5e-a5ffee996e4f None admin] PATH_INFO: `/v3/groups/2b7c6144619943a48416cd40e5710bb8` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:40.236228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d535b-b0f4-4114-9a5e-a5ffee996e4f None admin] RBAC: Authorizing `identity:get_group(group_id=2b7c6144619943a48416cd40e5710bb8)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:40.237684 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d535b-b0f4-4114-9a5e-a5ffee996e4f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:40.239605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 178/370] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:40 2022] GET /identity/v3/groups/2b7c6144619943a48416cd40e5710bb8 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:40.240404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d535b-b0f4-4114-9a5e-a5ffee996e4f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:40.300460 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:40.316344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:40.327801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc74b1-e1ff-4daf-a7ad-d827d2c47ba0 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:40.367528 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d535b-b0f4-4114-9a5e-a5ffee996e4f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:40.377598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22596d5a-7874-4c61-80cd-f9dcb02f27d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:40.378494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22596d5a-7874-4c61-80cd-f9dcb02f27d2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:40.378875 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22596d5a-7874-4c61-80cd-f9dcb02f27d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:40.379163 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22596d5a-7874-4c61-80cd-f9dcb02f27d2 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:40.380856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22596d5a-7874-4c61-80cd-f9dcb02f27d2 None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:40.382314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22596d5a-7874-4c61-80cd-f9dcb02f27d2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:40.384528 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 193/371] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:40 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:40.385410 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22596d5a-7874-4c61-80cd-f9dcb02f27d2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:40.421061 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601d164-6fba-407d-aa2b-947de2fb31eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:40.423825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601d164-6fba-407d-aa2b-947de2fb31eb None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:40.424664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601d164-6fba-407d-aa2b-947de2fb31eb None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:40.425546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601d164-6fba-407d-aa2b-947de2fb31eb None admin] PATH_INFO: `/v3/users/0b44350cdfae4baf994f3c35811c5a4e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:40.428754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601d164-6fba-407d-aa2b-947de2fb31eb None admin] RBAC: Authorizing `identity:get_user(user_id=0b44350cdfae4baf994f3c35811c5a4e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:40.430427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601d164-6fba-407d-aa2b-947de2fb31eb None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:40.433389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 179/372] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:04:40 2022] GET /identity/v3/users/0b44350cdfae4baf994f3c35811c5a4e => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:40.434707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601d164-6fba-407d-aa2b-947de2fb31eb None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:40.508628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22596d5a-7874-4c61-80cd-f9dcb02f27d2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:40.545323 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c84e90-70f1-4e6a-972b-01bae8d04a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:40.546352 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c84e90-70f1-4e6a-972b-01bae8d04a8c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:40.546852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c84e90-70f1-4e6a-972b-01bae8d04a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:40.547334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c84e90-70f1-4e6a-972b-01bae8d04a8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:40.558828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601d164-6fba-407d-aa2b-947de2fb31eb None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:40.560430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:40.578961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:40.598262 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d2af-5704-4802-9ada-60f6cef378dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:40.599275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d2af-5704-4802-9ada-60f6cef378dd None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:40.599783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d2af-5704-4802-9ada-60f6cef378dd None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:40.600304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d2af-5704-4802-9ada-60f6cef378dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:40.601412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18d2af-5704-4802-9ada-60f6cef378dd None admin] RBAC: Adding query filter params (group.id=2b7c6144619943a48416cd40e5710bb8, role.id=282334a450b54dedb0b42d678d231caf, scope.project.id=8600563b295742f1a8d5ba26a2a51f14) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:40.605584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18d2af-5704-4802-9ada-60f6cef378dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:40.605584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18d2af-5704-4802-9ada-60f6cef378dd None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:40.609917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 180/373] 10.222.0.74 () {56 vars in 1376 bytes} [Thu Jul 14 10:04:40 2022] GET /identity/v3/role_assignments?group.id=2b7c6144619943a48416cd40e5710bb8&scope.project.id=8600563b295742f1a8d5ba26a2a51f14&role.id=282334a450b54dedb0b42d678d231caf => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:40.611533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d2af-5704-4802-9ada-60f6cef378dd None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:40.625078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c84e90-70f1-4e6a-972b-01bae8d04a8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:40.627466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c84e90-70f1-4e6a-972b-01bae8d04a8c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:40.731907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d2af-5704-4802-9ada-60f6cef378dd None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:40.744415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 194/374] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:40.745365 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c84e90-70f1-4e6a-972b-01bae8d04a8c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:40.778548 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c47dcb-7a72-489e-98cc-4c9abe5cc064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:40.779925 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c47dcb-7a72-489e-98cc-4c9abe5cc064 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:40.780466 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c47dcb-7a72-489e-98cc-4c9abe5cc064 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:40.780948 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c47dcb-7a72-489e-98cc-4c9abe5cc064 None admin] PATH_INFO: `/v3/groups/2b7c6144619943a48416cd40e5710bb8` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:40.788937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c47dcb-7a72-489e-98cc-4c9abe5cc064 None admin] RBAC: Authorizing `identity:get_group(group_id=2b7c6144619943a48416cd40e5710bb8)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:40.790944 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c47dcb-7a72-489e-98cc-4c9abe5cc064 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:40.793357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 181/375] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:40 2022] GET /identity/v3/groups/2b7c6144619943a48416cd40e5710bb8 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:40.794378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c47dcb-7a72-489e-98cc-4c9abe5cc064 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:40.812024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:40.834381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:40.858110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c84e90-70f1-4e6a-972b-01bae8d04a8c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:40.895523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153e2fe-51a0-4e65-ba87-36fa3a9531be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:40.896194 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153e2fe-51a0-4e65-ba87-36fa3a9531be None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:40.896281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153e2fe-51a0-4e65-ba87-36fa3a9531be None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:40.896551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153e2fe-51a0-4e65-ba87-36fa3a9531be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:40.897413 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153e2fe-51a0-4e65-ba87-36fa3a9531be None admin] RBAC: Adding query filter params (role.id=e3482518249a452d8c02c7d2d16f19dc, user.id=0b44350cdfae4baf994f3c35811c5a4e, scope.system=all) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:40.897725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153e2fe-51a0-4e65-ba87-36fa3a9531be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:40.899170 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153e2fe-51a0-4e65-ba87-36fa3a9531be None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:40.913698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 195/376] 10.222.0.74 () {56 vars in 1308 bytes} [Thu Jul 14 10:04:40 2022] GET /identity/v3/role_assignments?user.id=0b44350cdfae4baf994f3c35811c5a4e&scope.system=all&role.id=e3482518249a452d8c02c7d2d16f19dc => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:40.914512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153e2fe-51a0-4e65-ba87-36fa3a9531be None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:40.931198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c47dcb-7a72-489e-98cc-4c9abe5cc064 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:41.030289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822b029-95c4-46b5-8408-1f44b52aa2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:41.031176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822b029-95c4-46b5-8408-1f44b52aa2bc None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:41.031455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822b029-95c4-46b5-8408-1f44b52aa2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:41.031724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822b029-95c4-46b5-8408-1f44b52aa2bc None admin] PATH_INFO: `/v3/projects/749adf9dd9f744529e5dfac400623e53` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:41.033624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822b029-95c4-46b5-8408-1f44b52aa2bc None admin] RBAC: Authorizing `identity:get_project(project_id=749adf9dd9f744529e5dfac400623e53)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:41.035088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822b029-95c4-46b5-8408-1f44b52aa2bc None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:41.044492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 182/377] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:40 2022] GET /identity/v3/projects/749adf9dd9f744529e5dfac400623e53 => generated 344 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:41.050275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822b029-95c4-46b5-8408-1f44b52aa2bc None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:41.137449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153e2fe-51a0-4e65-ba87-36fa3a9531be None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:41.162109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:41.182487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837ed07-a5ab-496d-adc2-0b47fbc8e065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:41.183159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837ed07-a5ab-496d-adc2-0b47fbc8e065 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:41.183440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837ed07-a5ab-496d-adc2-0b47fbc8e065 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:41.183712 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837ed07-a5ab-496d-adc2-0b47fbc8e065 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:41.186524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837ed07-a5ab-496d-adc2-0b47fbc8e065 None admin] RBAC: Adding query filter params (group.id=2b7c6144619943a48416cd40e5710bb8, role.id=282334a450b54dedb0b42d678d231caf, scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:41.186848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837ed07-a5ab-496d-adc2-0b47fbc8e065 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:41.188364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837ed07-a5ab-496d-adc2-0b47fbc8e065 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:41.205218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 196/378] 10.222.0.74 () {56 vars in 1376 bytes} [Thu Jul 14 10:04:40 2022] GET /identity/v3/role_assignments?group.id=2b7c6144619943a48416cd40e5710bb8&scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce&role.id=282334a450b54dedb0b42d678d231caf => generated 260 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:41.239384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6887901-e101-43b2-8b1e-e3008a104383 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:41.239716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6887901-e101-43b2-8b1e-e3008a104383 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:41.239940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6887901-e101-43b2-8b1e-e3008a104383 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:41.241507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 197/379] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:41.246887 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf6ca4-04b6-48de-8b88-97377806630d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:41.247194 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf6ca4-04b6-48de-8b88-97377806630d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:41.247444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf6ca4-04b6-48de-8b88-97377806630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:41.249752 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822b029-95c4-46b5-8408-1f44b52aa2bc None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:41.251837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:41.272943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-98bf6ca4-04b6-48de-8b88-97377806630d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:41.273878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-98bf6ca4-04b6-48de-8b88-97377806630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:41.300524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750a00e-1217-4465-995e-4bc049bddf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:41.301856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a00e-1217-4465-995e-4bc049bddf4b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:41.302347 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a00e-1217-4465-995e-4bc049bddf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:41.302824 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a00e-1217-4465-995e-4bc049bddf4b None admin] PATH_INFO: `/v3/groups/f5719f0c27524f6fa019c7a06245f8f2` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:41.315911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750a00e-1217-4465-995e-4bc049bddf4b None admin] RBAC: Authorizing `identity:get_group(group_id=f5719f0c27524f6fa019c7a06245f8f2)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:41.317979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750a00e-1217-4465-995e-4bc049bddf4b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:41.320452 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 183/380] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:41 2022] GET /identity/v3/groups/f5719f0c27524f6fa019c7a06245f8f2 => generated 229 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:41.325927 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750a00e-1217-4465-995e-4bc049bddf4b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:41.421924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 198/381] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:41.451017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf6ca4-04b6-48de-8b88-97377806630d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:41.476315 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750a00e-1217-4465-995e-4bc049bddf4b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:41.512028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04734c6e-8629-4d1a-a3d0-4393d6c72a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:41.512706 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04734c6e-8629-4d1a-a3d0-4393d6c72a75 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:41.512984 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04734c6e-8629-4d1a-a3d0-4393d6c72a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:41.513253 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04734c6e-8629-4d1a-a3d0-4393d6c72a75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:41.514085 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04734c6e-8629-4d1a-a3d0-4393d6c72a75 None admin] RBAC: Adding query filter params (group.id=f5719f0c27524f6fa019c7a06245f8f2, role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=749adf9dd9f744529e5dfac400623e53) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:41.514395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04734c6e-8629-4d1a-a3d0-4393d6c72a75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:41.515830 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04734c6e-8629-4d1a-a3d0-4393d6c72a75 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:41.527690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 184/382] 10.222.0.74 () {56 vars in 1376 bytes} [Thu Jul 14 10:04:41 2022] GET /identity/v3/role_assignments?group.id=f5719f0c27524f6fa019c7a06245f8f2&scope.project.id=749adf9dd9f744529e5dfac400623e53&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:41.600901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf6ca4-04b6-48de-8b88-97377806630d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:41.615844 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19163bd1-7bc3-4e46-82d6-f970cec4189e None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:41.616175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19163bd1-7bc3-4e46-82d6-f970cec4189e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:41.616428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19163bd1-7bc3-4e46-82d6-f970cec4189e None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:41.618118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 185/383] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:04:41.621716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:41.638394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262047c-cf5c-4d39-99e9-90da8d1bb9a8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:41.638715 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262047c-cf5c-4d39-99e9-90da8d1bb9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:41.638944 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262047c-cf5c-4d39-99e9-90da8d1bb9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:41.651107 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6625723-8926-4d76-ab56-4971f9902455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:41.651926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6625723-8926-4d76-ab56-4971f9902455 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:41.652231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6625723-8926-4d76-ab56-4971f9902455 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:41.652508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6625723-8926-4d76-ab56-4971f9902455 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:41.671129 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e262047c-cf5c-4d39-99e9-90da8d1bb9a8 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:41.674801 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e262047c-cf5c-4d39-99e9-90da8d1bb9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:41.677846 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6625723-8926-4d76-ab56-4971f9902455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-f6625723-8926-4d76-ab56-4971f9902455 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:41.685815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:41.686785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:41.687598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:41.687598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:41.687598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:41.687598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:41.687598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:41.687598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:41.687598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:41.687598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:41.687598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:41.687598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:41.687598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:41.687598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:41.689334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 199/384] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:41.695244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6625723-8926-4d76-ab56-4971f9902455 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:41.726584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:41.806603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 186/385] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:41.828271 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6625723-8926-4d76-ab56-4971f9902455 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:41.847480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262047c-cf5c-4d39-99e9-90da8d1bb9a8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:41.867128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c928432-aeb3-4c76-90ab-4c2ea783a8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:41.868213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c928432-aeb3-4c76-90ab-4c2ea783a8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:41.868695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c928432-aeb3-4c76-90ab-4c2ea783a8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:41.869151 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c928432-aeb3-4c76-90ab-4c2ea783a8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:41.870086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c928432-aeb3-4c76-90ab-4c2ea783a8b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:41.870572 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c928432-aeb3-4c76-90ab-4c2ea783a8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:41.872152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c928432-aeb3-4c76-90ab-4c2ea783a8b4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:41.882441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 200/386] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:41.888230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c928432-aeb3-4c76-90ab-4c2ea783a8b4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:41.945818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:42.023722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c928432-aeb3-4c76-90ab-4c2ea783a8b4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:42.039106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262047c-cf5c-4d39-99e9-90da8d1bb9a8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:42.062071 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39613708-a837-4d07-a88b-3c58d52c7db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:42.062939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39613708-a837-4d07-a88b-3c58d52c7db0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:42.063232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39613708-a837-4d07-a88b-3c58d52c7db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:42.063511 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39613708-a837-4d07-a88b-3c58d52c7db0 None admin] PATH_INFO: `/v3/groups/2b7c6144619943a48416cd40e5710bb8` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:42.065317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39613708-a837-4d07-a88b-3c58d52c7db0 None admin] RBAC: Authorizing `identity:get_group(group_id=2b7c6144619943a48416cd40e5710bb8)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:42.066785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39613708-a837-4d07-a88b-3c58d52c7db0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:42.068471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 201/387] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:41 2022] GET /identity/v3/groups/2b7c6144619943a48416cd40e5710bb8 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:42.073890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39613708-a837-4d07-a88b-3c58d52c7db0 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:42.090920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69456656-c128-42b5-be9f-c75833930c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:42.092126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69456656-c128-42b5-be9f-c75833930c76 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:42.092710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69456656-c128-42b5-be9f-c75833930c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:42.093183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69456656-c128-42b5-be9f-c75833930c76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:42.105242 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69456656-c128-42b5-be9f-c75833930c76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-69456656-c128-42b5-be9f-c75833930c76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:42.114098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:42.115018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:42.115807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:42.115807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:42.115807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:42.115807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:42.115807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:42.115807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:42.115807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:42.115807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:42.115807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:42.115807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:42.115807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:42.115807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:42.118494 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 187/388] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:42.124200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69456656-c128-42b5-be9f-c75833930c76 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:42.158095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:42.207111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:42.211152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39613708-a837-4d07-a88b-3c58d52c7db0 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:42.273110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f894a3-acd9-42b5-b164-cbe7aac285d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:42.273991 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f894a3-acd9-42b5-b164-cbe7aac285d8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:42.274335 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f894a3-acd9-42b5-b164-cbe7aac285d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:42.274617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f894a3-acd9-42b5-b164-cbe7aac285d8 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:42.276023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f894a3-acd9-42b5-b164-cbe7aac285d8 None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:42.279613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f894a3-acd9-42b5-b164-cbe7aac285d8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:42.281410 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 202/389] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:42 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:42.288905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f894a3-acd9-42b5-b164-cbe7aac285d8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:42.312675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69456656-c128-42b5-be9f-c75833930c76 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:42.378211 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5a0d0-76de-4eea-8ca9-099ff41ea802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:42.378895 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5a0d0-76de-4eea-8ca9-099ff41ea802 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:42.379190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5a0d0-76de-4eea-8ca9-099ff41ea802 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:42.379442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5a0d0-76de-4eea-8ca9-099ff41ea802 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:42.384261 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5a0d0-76de-4eea-8ca9-099ff41ea802 None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:42.384585 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5a0d0-76de-4eea-8ca9-099ff41ea802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:42.385968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5a0d0-76de-4eea-8ca9-099ff41ea802 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:42.395663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 188/390] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:42.403121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5a0d0-76de-4eea-8ca9-099ff41ea802 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:42.444287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f894a3-acd9-42b5-b164-cbe7aac285d8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:42.495391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:42.507756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c22b4b-5a2b-45a2-a385-8f9ac18467d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:42.512994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c22b4b-5a2b-45a2-a385-8f9ac18467d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:42.512994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c22b4b-5a2b-45a2-a385-8f9ac18467d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:42.512994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c22b4b-5a2b-45a2-a385-8f9ac18467d6 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14/groups/2b7c6144619943a48416cd40e5710bb8/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:42.514699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5a0d0-76de-4eea-8ca9-099ff41ea802 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:42.515706 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c22b4b-5a2b-45a2-a385-8f9ac18467d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8600563b295742f1a8d5ba26a2a51f14, group_id=2b7c6144619943a48416cd40e5710bb8, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:42.517770 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c22b4b-5a2b-45a2-a385-8f9ac18467d6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:42.551382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d331a-7f78-4f01-b352-d6a74e397fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:42.552493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d331a-7f78-4f01-b352-d6a74e397fbf None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:42.552773 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d331a-7f78-4f01-b352-d6a74e397fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:42.553041 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d331a-7f78-4f01-b352-d6a74e397fbf None admin] PATH_INFO: `/v3/groups/2b7c6144619943a48416cd40e5710bb8` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:42.554215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d331a-7f78-4f01-b352-d6a74e397fbf None admin] RBAC: Authorizing `identity:get_group(group_id=2b7c6144619943a48416cd40e5710bb8)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:42.555669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d331a-7f78-4f01-b352-d6a74e397fbf None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:42.557553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 189/391] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:42 2022] GET /identity/v3/groups/2b7c6144619943a48416cd40e5710bb8 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:42.564883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d331a-7f78-4f01-b352-d6a74e397fbf None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:42.669812 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d331a-7f78-4f01-b352-d6a74e397fbf None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:42.672659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 203/392] 10.222.0.74 () {58 vars in 1442 bytes} [Thu Jul 14 10:04:42 2022] PUT /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14/groups/2b7c6144619943a48416cd40e5710bb8/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:42.715904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d52fd-1f11-456c-a29d-2767fe0342f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:42.716796 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d52fd-1f11-456c-a29d-2767fe0342f6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:42.717075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d52fd-1f11-456c-a29d-2767fe0342f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:42.717346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d52fd-1f11-456c-a29d-2767fe0342f6 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:42.718531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d52fd-1f11-456c-a29d-2767fe0342f6 None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:42.720026 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d52fd-1f11-456c-a29d-2767fe0342f6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:42.722601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 190/393] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:42 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:42.728715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c22b4b-5a2b-45a2-a385-8f9ac18467d6 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:42.777410 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:42.879038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c22b4b-5a2b-45a2-a385-8f9ac18467d6 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:42.927683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341e116-2f6c-4f65-bbc2-7b455e476a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:42.929061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341e116-2f6c-4f65-bbc2-7b455e476a13 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:42.929546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341e116-2f6c-4f65-bbc2-7b455e476a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:42.930045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341e116-2f6c-4f65-bbc2-7b455e476a13 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce/groups/2b7c6144619943a48416cd40e5710bb8/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:42.932317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341e116-2f6c-4f65-bbc2-7b455e476a13 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1615dfc209c4ce8a6f76bb6343932ce, group_id=2b7c6144619943a48416cd40e5710bb8, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:42.934087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341e116-2f6c-4f65-bbc2-7b455e476a13 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:43.014576 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 204/394] 10.222.0.74 () {58 vars in 1442 bytes} [Thu Jul 14 10:04:42 2022] PUT /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce/groups/2b7c6144619943a48416cd40e5710bb8/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:43.391599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfb245-fb6c-4f95-b383-fc6c1a233f96 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:43.392220 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfb245-fb6c-4f95-b383-fc6c1a233f96 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:43.392322 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfb245-fb6c-4f95-b383-fc6c1a233f96 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:43.393664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 191/395] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:43.400083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80851a-b1fd-4a0d-a2ad-e8a05c03195d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:43.400379 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80851a-b1fd-4a0d-a2ad-e8a05c03195d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:43.400657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80851a-b1fd-4a0d-a2ad-e8a05c03195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:43.419207 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-dd80851a-b1fd-4a0d-a2ad-e8a05c03195d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:43.420415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-dd80851a-b1fd-4a0d-a2ad-e8a05c03195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:43.496663 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 205/396] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:43.518913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfb245-fb6c-4f95-b383-fc6c1a233f96 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:43.539078 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:43.629048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfb245-fb6c-4f95-b383-fc6c1a233f96 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:43.676143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9925503-ef59-4a16-b447-c07330810ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:43.676884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925503-ef59-4a16-b447-c07330810ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:43.677161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925503-ef59-4a16-b447-c07330810ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:43.677430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925503-ef59-4a16-b447-c07330810ea0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:43.693699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9925503-ef59-4a16-b447-c07330810ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-d9925503-ef59-4a16-b447-c07330810ea0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:43.701725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:43.702696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:43.703506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:43.703506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:43.703506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:43.703506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:43.703506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:43.703506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:43.703506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:43.703506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:43.703506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:43.703506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:43.703506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:43.703506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:43.703506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 192/397] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:04:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:43.709167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80851a-b1fd-4a0d-a2ad-e8a05c03195d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:43.744316 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:43.846599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80851a-b1fd-4a0d-a2ad-e8a05c03195d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:43.886478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86aa3c-98ab-44ee-8aa9-f1705b1201e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:43.887157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86aa3c-98ab-44ee-8aa9-f1705b1201e3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:43.887434 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86aa3c-98ab-44ee-8aa9-f1705b1201e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:43.887705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86aa3c-98ab-44ee-8aa9-f1705b1201e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:43.888481 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86aa3c-98ab-44ee-8aa9-f1705b1201e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:43.888781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86aa3c-98ab-44ee-8aa9-f1705b1201e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:43.890154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86aa3c-98ab-44ee-8aa9-f1705b1201e3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:43.900186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 206/398] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:43.905734 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9925503-ef59-4a16-b447-c07330810ea0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:44.020625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:44.043504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9925503-ef59-4a16-b447-c07330810ea0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:44.069636 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edee17-93b9-4166-8a35-99a556f305ab None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:44.070142 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edee17-93b9-4166-8a35-99a556f305ab None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:44.070220 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edee17-93b9-4166-8a35-99a556f305ab None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:44.071799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 207/399] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:44.085138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f019f10-29ca-4f93-a357-3805b22ffa07 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:44.085421 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f019f10-29ca-4f93-a357-3805b22ffa07 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:44.085697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f019f10-29ca-4f93-a357-3805b22ffa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:44.105980 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7f019f10-29ca-4f93-a357-3805b22ffa07 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:44.106607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2547-5687-48c7-94cf-3db851043410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:44.107480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2547-5687-48c7-94cf-3db851043410 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:44.107759 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2547-5687-48c7-94cf-3db851043410 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:44.108049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2547-5687-48c7-94cf-3db851043410 None admin] PATH_INFO: `/v3/groups/2b7c6144619943a48416cd40e5710bb8` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:44.108484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7f019f10-29ca-4f93-a357-3805b22ffa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:44.112936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc2547-5687-48c7-94cf-3db851043410 None admin] RBAC: Authorizing `identity:get_group(group_id=2b7c6144619943a48416cd40e5710bb8)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:44.114138 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc2547-5687-48c7-94cf-3db851043410 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:44.116118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 193/400] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:43 2022] GET /identity/v3/groups/2b7c6144619943a48416cd40e5710bb8 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:44.121161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2547-5687-48c7-94cf-3db851043410 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:44.185042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 208/401] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:44.223084 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f019f10-29ca-4f93-a357-3805b22ffa07 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:44.236484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:44.329064 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2547-5687-48c7-94cf-3db851043410 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:44.334251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f019f10-29ca-4f93-a357-3805b22ffa07 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:44.370523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad82bc-e96f-48d6-bf46-e8e8b5fe165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:44.371642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad82bc-e96f-48d6-bf46-e8e8b5fe165c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:44.372725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad82bc-e96f-48d6-bf46-e8e8b5fe165c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:44.373295 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad82bc-e96f-48d6-bf46-e8e8b5fe165c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:44.385268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad82bc-e96f-48d6-bf46-e8e8b5fe165c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:44.393553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7818f-2a5f-4630-bf16-0a989ef6b994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:44.394413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7818f-2a5f-4630-bf16-0a989ef6b994 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:44.394691 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7818f-2a5f-4630-bf16-0a989ef6b994 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:44.394960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7818f-2a5f-4630-bf16-0a989ef6b994 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-9bad82bc-e96f-48d6-bf46-e8e8b5fe165c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:44.395304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:44.396429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:44.397416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:44.397416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:44.397416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:44.397416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:44.397416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:44.397416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:44.397416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:44.397416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:44.397416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:44.397416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:44.397416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:44.397416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:44.398046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7818f-2a5f-4630-bf16-0a989ef6b994 None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:44.398046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7818f-2a5f-4630-bf16-0a989ef6b994 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:44.399283 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 194/402] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:44 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:44.400469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 209/403] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:04:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:44.404946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7818f-2a5f-4630-bf16-0a989ef6b994 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:44.409083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad82bc-e96f-48d6-bf46-e8e8b5fe165c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:44.443039 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:44.510084 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:44.546061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad82bc-e96f-48d6-bf46-e8e8b5fe165c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:44.565450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7818f-2a5f-4630-bf16-0a989ef6b994 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:44.585714 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffbd49-8894-4275-aed7-e474df4a2d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:44.587140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffbd49-8894-4275-aed7-e474df4a2d84 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:44.587906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffbd49-8894-4275-aed7-e474df4a2d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:44.588420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffbd49-8894-4275-aed7-e474df4a2d84 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:44.589883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffbd49-8894-4275-aed7-e474df4a2d84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:44.590536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffbd49-8894-4275-aed7-e474df4a2d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:44.592441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffbd49-8894-4275-aed7-e474df4a2d84 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:44.601060 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8851f-c5c6-4e38-add6-72de870e6434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:44.601919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8851f-c5c6-4e38-add6-72de870e6434 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:44.602194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8851f-c5c6-4e38-add6-72de870e6434 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:44.602464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8851f-c5c6-4e38-add6-72de870e6434 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14/groups/2b7c6144619943a48416cd40e5710bb8/roles/282334a450b54dedb0b42d678d231caf` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:44.604113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 210/404] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:44.605664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af0de-2643-4761-affb-ae0979d5b21f None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:44.606174 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af0de-2643-4761-affb-ae0979d5b21f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:44.606711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af0de-2643-4761-affb-ae0979d5b21f None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:44.608567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 211/405] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:44.609476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965af0de-2643-4761-affb-ae0979d5b21f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:44.612784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8851f-c5c6-4e38-add6-72de870e6434 None admin] RBAC: Authorizing `identity:create_grant(project_id=8600563b295742f1a8d5ba26a2a51f14, group_id=2b7c6144619943a48416cd40e5710bb8, role_id=282334a450b54dedb0b42d678d231caf)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:44.614263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8851f-c5c6-4e38-add6-72de870e6434 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:44.674510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 195/406] 10.222.0.74 () {58 vars in 1442 bytes} [Thu Jul 14 10:04:44 2022] PUT /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14/groups/2b7c6144619943a48416cd40e5710bb8/roles/282334a450b54dedb0b42d678d231caf => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:44.676409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff2364-c061-43fa-a2a0-bdf5740177ad None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:44.676960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff2364-c061-43fa-a2a0-bdf5740177ad None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:44.677501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff2364-c061-43fa-a2a0-bdf5740177ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:44.696617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5bff2364-c061-43fa-a2a0-bdf5740177ad None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:44.703420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5bff2364-c061-43fa-a2a0-bdf5740177ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:44.737971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965af0de-2643-4761-affb-ae0979d5b21f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:44.788031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 196/407] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:44.804418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:44.811679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459013fc-741f-4ff9-b5fd-558caac7d731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:44.812649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459013fc-741f-4ff9-b5fd-558caac7d731 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:44.812938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459013fc-741f-4ff9-b5fd-558caac7d731 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:44.813343 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459013fc-741f-4ff9-b5fd-558caac7d731 None admin] PATH_INFO: `/v3/groups/2b7c6144619943a48416cd40e5710bb8` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:44.814777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459013fc-741f-4ff9-b5fd-558caac7d731 None admin] RBAC: Authorizing `identity:get_group(group_id=2b7c6144619943a48416cd40e5710bb8)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:44.816361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459013fc-741f-4ff9-b5fd-558caac7d731 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:44.818432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 212/408] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:44 2022] GET /identity/v3/groups/2b7c6144619943a48416cd40e5710bb8 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:44.824269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff2364-c061-43fa-a2a0-bdf5740177ad None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:44.828132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:44.854177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459013fc-741f-4ff9-b5fd-558caac7d731 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:44.964227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff2364-c061-43fa-a2a0-bdf5740177ad None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:45.008260 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459013fc-741f-4ff9-b5fd-558caac7d731 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:45.014745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfb01d-d597-4a9e-bebd-66d22a953c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:45.015962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfb01d-d597-4a9e-bebd-66d22a953c50 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:45.016458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfb01d-d597-4a9e-bebd-66d22a953c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:45.022064 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfb01d-d597-4a9e-bebd-66d22a953c50 None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:45.023552 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfb01d-d597-4a9e-bebd-66d22a953c50 None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:45.025241 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfb01d-d597-4a9e-bebd-66d22a953c50 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:45.032376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 197/409] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:44 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:45.041588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfb01d-d597-4a9e-bebd-66d22a953c50 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:45.085592 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9aec2-ab30-4bbe-abe9-faa943796cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:45.086398 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9aec2-ab30-4bbe-abe9-faa943796cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:45.086672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9aec2-ab30-4bbe-abe9-faa943796cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:45.086941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9aec2-ab30-4bbe-abe9-faa943796cf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:45.108402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9aec2-ab30-4bbe-abe9-faa943796cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a7c9aec2-ab30-4bbe-abe9-faa943796cf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:45.126761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:45.127717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:45.128652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:45.128652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:45.128652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:45.128652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:45.128652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:45.128652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:45.128652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:45.128652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:45.128652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:45.128652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:45.128652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:45.128652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:45.129843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 213/410] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:04:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:45.135728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9aec2-ab30-4bbe-abe9-faa943796cf7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:45.168671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:45.203346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfb01d-d597-4a9e-bebd-66d22a953c50 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:45.209175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:45.242829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b5467-b379-497a-a20d-8085d954c81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:45.244699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b5467-b379-497a-a20d-8085d954c81a None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:45.245185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b5467-b379-497a-a20d-8085d954c81a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:45.245658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b5467-b379-497a-a20d-8085d954c81a None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce/groups/2b7c6144619943a48416cd40e5710bb8/roles/282334a450b54dedb0b42d678d231caf` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:45.248558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b5467-b379-497a-a20d-8085d954c81a None admin] RBAC: Authorizing `identity:create_grant(project_id=c1615dfc209c4ce8a6f76bb6343932ce, group_id=2b7c6144619943a48416cd40e5710bb8, role_id=282334a450b54dedb0b42d678d231caf)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:45.250427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b5467-b379-497a-a20d-8085d954c81a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:45.260694 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9aec2-ab30-4bbe-abe9-faa943796cf7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:45.295048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee807cea-9b5d-46ec-a629-9b73ef7487bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:45.295719 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee807cea-9b5d-46ec-a629-9b73ef7487bd None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:45.296072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee807cea-9b5d-46ec-a629-9b73ef7487bd None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:45.296290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee807cea-9b5d-46ec-a629-9b73ef7487bd None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:45.297027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee807cea-9b5d-46ec-a629-9b73ef7487bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:45.297328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee807cea-9b5d-46ec-a629-9b73ef7487bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:45.298766 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee807cea-9b5d-46ec-a629-9b73ef7487bd None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:45.307505 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 214/411] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:45.312085 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8af64-c61c-48df-b131-51040c0fa5ef None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:45.312085 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8af64-c61c-48df-b131-51040c0fa5ef None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:45.312085 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8af64-c61c-48df-b131-51040c0fa5ef None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:45.312085 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 215/412] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:45.317901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937541f0-d60b-449e-9e61-2da16099760b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:45.318682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937541f0-d60b-449e-9e61-2da16099760b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:45.319628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937541f0-d60b-449e-9e61-2da16099760b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:45.328496 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 198/413] 10.222.0.74 () {58 vars in 1442 bytes} [Thu Jul 14 10:04:45 2022] PUT /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce/groups/2b7c6144619943a48416cd40e5710bb8/roles/282334a450b54dedb0b42d678d231caf => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:04:45.330670 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b5467-b379-497a-a20d-8085d954c81a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:45.342382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-937541f0-d60b-449e-9e61-2da16099760b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:45.343966 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-937541f0-d60b-449e-9e61-2da16099760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:45.461809 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 216/414] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:45.505484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937541f0-d60b-449e-9e61-2da16099760b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:45.534019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b5467-b379-497a-a20d-8085d954c81a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:45.568271 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:45.582805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:45.597075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf85422-16fa-483f-a5b6-24440bec6f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:45.597942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf85422-16fa-483f-a5b6-24440bec6f56 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:45.598222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf85422-16fa-483f-a5b6-24440bec6f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:45.598492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf85422-16fa-483f-a5b6-24440bec6f56 None admin] PATH_INFO: `/v3/groups/f5719f0c27524f6fa019c7a06245f8f2` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:45.599860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf85422-16fa-483f-a5b6-24440bec6f56 None admin] RBAC: Authorizing `identity:get_group(group_id=f5719f0c27524f6fa019c7a06245f8f2)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:45.604029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf85422-16fa-483f-a5b6-24440bec6f56 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:45.605519 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 199/415] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:45 2022] GET /identity/v3/groups/f5719f0c27524f6fa019c7a06245f8f2 => generated 229 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:45.612951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf85422-16fa-483f-a5b6-24440bec6f56 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:45.656497 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937541f0-d60b-449e-9e61-2da16099760b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:45.706559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256bf0c-259f-4cdf-87a3-9f8ed2dbd0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:45.707916 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256bf0c-259f-4cdf-87a3-9f8ed2dbd0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:45.708235 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256bf0c-259f-4cdf-87a3-9f8ed2dbd0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:45.708510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256bf0c-259f-4cdf-87a3-9f8ed2dbd0f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:45.721933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256bf0c-259f-4cdf-87a3-9f8ed2dbd0f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c256bf0c-259f-4cdf-87a3-9f8ed2dbd0f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:45.732057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:45.733139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:45.733969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:45.733969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:45.733969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:45.733969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:45.733969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:45.733969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:45.733969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:45.733969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:45.733969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:45.733969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:45.733969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:45.733969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:45.733969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 217/416] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:45.735087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d04d6-a870-4709-ad4c-a34a1769cbcf None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:45.735376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d04d6-a870-4709-ad4c-a34a1769cbcf None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:45.736186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d04d6-a870-4709-ad4c-a34a1769cbcf None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:45.737905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 218/417] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:45.742411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d04d6-a870-4709-ad4c-a34a1769cbcf None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:45.759013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf85422-16fa-483f-a5b6-24440bec6f56 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:45.797544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5ed06-705c-46df-8869-2d653684ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:45.798821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5ed06-705c-46df-8869-2d653684ba6a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:45.799297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5ed06-705c-46df-8869-2d653684ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:45.799813 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5ed06-705c-46df-8869-2d653684ba6a None admin] PATH_INFO: `/v3/projects/749adf9dd9f744529e5dfac400623e53` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:45.801208 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5ed06-705c-46df-8869-2d653684ba6a None admin] RBAC: Authorizing `identity:get_project(project_id=749adf9dd9f744529e5dfac400623e53)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:45.802804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5ed06-705c-46df-8869-2d653684ba6a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:45.809227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 200/418] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:45 2022] GET /identity/v3/projects/749adf9dd9f744529e5dfac400623e53 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:45.809227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57815860-660c-4cb8-954a-67b6a8761442 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:45.809227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57815860-660c-4cb8-954a-67b6a8761442 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:45.809227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57815860-660c-4cb8-954a-67b6a8761442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:45.828052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-57815860-660c-4cb8-954a-67b6a8761442 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:45.830123 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-57815860-660c-4cb8-954a-67b6a8761442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:45.864694 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d04d6-a870-4709-ad4c-a34a1769cbcf None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:45.878607 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:45.898328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:45.903509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77510d4-21de-4da9-b240-bd83baa976b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:45.905526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 201/419] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:45.905526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57815860-660c-4cb8-954a-67b6a8761442 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:45.906681 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77510d4-21de-4da9-b240-bd83baa976b3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:45.916018 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77510d4-21de-4da9-b240-bd83baa976b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:45.916691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77510d4-21de-4da9-b240-bd83baa976b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:45.917642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77510d4-21de-4da9-b240-bd83baa976b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:45.919859 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77510d4-21de-4da9-b240-bd83baa976b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:45.919859 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77510d4-21de-4da9-b240-bd83baa976b3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:45.935488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 219/420] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:45.937169 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77510d4-21de-4da9-b240-bd83baa976b3 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:46.030289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57815860-660c-4cb8-954a-67b6a8761442 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:46.053216 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77510d4-21de-4da9-b240-bd83baa976b3 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:46.066300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbf969-7c7b-4708-9948-d39541714acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:46.067184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf969-7c7b-4708-9948-d39541714acb None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:46.067464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf969-7c7b-4708-9948-d39541714acb None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:46.067736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf969-7c7b-4708-9948-d39541714acb None admin] PATH_INFO: `/v3/projects/749adf9dd9f744529e5dfac400623e53/groups/f5719f0c27524f6fa019c7a06245f8f2/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:46.070040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbf969-7c7b-4708-9948-d39541714acb None admin] RBAC: Authorizing `identity:create_grant(project_id=749adf9dd9f744529e5dfac400623e53, group_id=f5719f0c27524f6fa019c7a06245f8f2, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:46.071472 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbf969-7c7b-4708-9948-d39541714acb None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:46.097396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36423c11-c9f5-46aa-bc54-7b9b86ca8b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:46.098857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36423c11-c9f5-46aa-bc54-7b9b86ca8b55 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:46.099381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36423c11-c9f5-46aa-bc54-7b9b86ca8b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:46.099851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36423c11-c9f5-46aa-bc54-7b9b86ca8b55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:46.110829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36423c11-c9f5-46aa-bc54-7b9b86ca8b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-36423c11-c9f5-46aa-bc54-7b9b86ca8b55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:46.118842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:46.119721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:46.120552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:46.120552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:46.120552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:46.120552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:46.120552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:46.120552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:46.120552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:46.120552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:46.120552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:46.120552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:46.120552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:04:46.120552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:46.121683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 220/421] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:46.122128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36423c11-c9f5-46aa-bc54-7b9b86ca8b55 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:46.160025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 202/422] 10.222.0.74 () {58 vars in 1442 bytes} [Thu Jul 14 10:04:45 2022] PUT /identity/v3/projects/749adf9dd9f744529e5dfac400623e53/groups/f5719f0c27524f6fa019c7a06245f8f2/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:46.160025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbf969-7c7b-4708-9948-d39541714acb None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:46.172027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:46.252422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:46.307769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbf969-7c7b-4708-9948-d39541714acb None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:46.331454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36423c11-c9f5-46aa-bc54-7b9b86ca8b55 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:46.373050 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eebe10-7c74-40e4-ac52-9c6f181bc548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:46.373750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eebe10-7c74-40e4-ac52-9c6f181bc548 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:46.374338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eebe10-7c74-40e4-ac52-9c6f181bc548 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:46.374614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eebe10-7c74-40e4-ac52-9c6f181bc548 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:46.375366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eebe10-7c74-40e4-ac52-9c6f181bc548 None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:46.376111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eebe10-7c74-40e4-ac52-9c6f181bc548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:46.378238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eebe10-7c74-40e4-ac52-9c6f181bc548 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:46.390371 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 203/423] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:04:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:46.391494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b246dc8-5904-4828-bbd1-f5cb7b53edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:46.392917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b246dc8-5904-4828-bbd1-f5cb7b53edde None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:46.393376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b246dc8-5904-4828-bbd1-f5cb7b53edde None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:46.393820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b246dc8-5904-4828-bbd1-f5cb7b53edde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:46.396288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eebe10-7c74-40e4-ac52-9c6f181bc548 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:46.484909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b246dc8-5904-4828-bbd1-f5cb7b53edde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:46.486327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b246dc8-5904-4828-bbd1-f5cb7b53edde None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:46.519985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eebe10-7c74-40e4-ac52-9c6f181bc548 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:46.521521 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:46.542012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:46.569722 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29269bb-c4f5-4674-a1c5-552311721d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:46.570688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29269bb-c4f5-4674-a1c5-552311721d74 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:46.571162 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29269bb-c4f5-4674-a1c5-552311721d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:46.571620 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29269bb-c4f5-4674-a1c5-552311721d74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:46.592998 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 221/424] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:46.598442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b246dc8-5904-4828-bbd1-f5cb7b53edde None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:46.703877 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b246dc8-5904-4828-bbd1-f5cb7b53edde None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:46.712861 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29269bb-c4f5-4674-a1c5-552311721d74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:46.714461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29269bb-c4f5-4674-a1c5-552311721d74 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:46.739975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f6306-4936-462a-8072-84f4668b1c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:46.740900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6306-4936-462a-8072-84f4668b1c50 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:46.741187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6306-4936-462a-8072-84f4668b1c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:46.741457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6306-4936-462a-8072-84f4668b1c50 None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:46.742712 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f6306-4936-462a-8072-84f4668b1c50 None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:46.744283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f6306-4936-462a-8072-84f4668b1c50 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:46.746371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 222/425] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:46 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:46.754451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f6306-4936-462a-8072-84f4668b1c50 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:46.759599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:46.863634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 204/426] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:04:46.868937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29269bb-c4f5-4674-a1c5-552311721d74 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:46.910764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:46.987243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f6306-4936-462a-8072-84f4668b1c50 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:47.009676 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29269bb-c4f5-4674-a1c5-552311721d74 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:47.045498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82966d-6280-49d1-a5fc-875c7b18c4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:47.046444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82966d-6280-49d1-a5fc-875c7b18c4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:47.046720 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82966d-6280-49d1-a5fc-875c7b18c4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:47.046985 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82966d-6280-49d1-a5fc-875c7b18c4e5 None admin] PATH_INFO: `/v3/groups/2b7c6144619943a48416cd40e5710bb8` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:47.048982 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82966d-6280-49d1-a5fc-875c7b18c4e5 None admin] RBAC: Authorizing `identity:get_group(group_id=2b7c6144619943a48416cd40e5710bb8)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:47.050547 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82966d-6280-49d1-a5fc-875c7b18c4e5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:47.052690 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 223/427] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:46 2022] GET /identity/v3/groups/2b7c6144619943a48416cd40e5710bb8 => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:47.058617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117d0f3-ad03-435b-a6ef-86066fd36730 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:47.058617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117d0f3-ad03-435b-a6ef-86066fd36730 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:47.058617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117d0f3-ad03-435b-a6ef-86066fd36730 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:47.059758 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 224/428] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:47.060612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117d0f3-ad03-435b-a6ef-86066fd36730 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:47.068542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39561ee5-ac02-41c0-b9f9-1dfec6b75d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:47.069846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39561ee5-ac02-41c0-b9f9-1dfec6b75d2f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:47.070332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39561ee5-ac02-41c0-b9f9-1dfec6b75d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:47.071653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39561ee5-ac02-41c0-b9f9-1dfec6b75d2f None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:47.073132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39561ee5-ac02-41c0-b9f9-1dfec6b75d2f None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:47.074792 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39561ee5-ac02-41c0-b9f9-1dfec6b75d2f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:47.077479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 205/429] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:46 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:47.078855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69734d9-42b1-4884-89c8-aa46b1f48607 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:47.079353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69734d9-42b1-4884-89c8-aa46b1f48607 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:47.079879 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69734d9-42b1-4884-89c8-aa46b1f48607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:47.100103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c69734d9-42b1-4884-89c8-aa46b1f48607 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:47.102364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c69734d9-42b1-4884-89c8-aa46b1f48607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:47.161250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:47.188289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 206/430] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:47.189239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69734d9-42b1-4884-89c8-aa46b1f48607 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:47.196193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117d0f3-ad03-435b-a6ef-86066fd36730 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:47.219871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:47.244892 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0190d06-46f2-457d-9145-a5f667991f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:47.245667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0190d06-46f2-457d-9145-a5f667991f4b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:47.245961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0190d06-46f2-457d-9145-a5f667991f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:47.247033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0190d06-46f2-457d-9145-a5f667991f4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:47.247878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0190d06-46f2-457d-9145-a5f667991f4b None admin] RBAC: Adding query filter params (group.id=2b7c6144619943a48416cd40e5710bb8, role.id=d47bb3db22444385b7884acbc7e21b0f, scope.project.id=8600563b295742f1a8d5ba26a2a51f14) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:47.248209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0190d06-46f2-457d-9145-a5f667991f4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:47.249728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0190d06-46f2-457d-9145-a5f667991f4b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:47.257212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 225/431] 10.222.0.74 () {56 vars in 1376 bytes} [Thu Jul 14 10:04:47 2022] GET /identity/v3/role_assignments?group.id=2b7c6144619943a48416cd40e5710bb8&scope.project.id=8600563b295742f1a8d5ba26a2a51f14&role.id=d47bb3db22444385b7884acbc7e21b0f => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:47.264023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0190d06-46f2-457d-9145-a5f667991f4b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:47.379447 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69734d9-42b1-4884-89c8-aa46b1f48607 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:47.418268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d117-b748-4bdf-a3ba-8a31bc9fc070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:47.419056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d117-b748-4bdf-a3ba-8a31bc9fc070 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:47.419335 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d117-b748-4bdf-a3ba-8a31bc9fc070 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:47.419606 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d117-b748-4bdf-a3ba-8a31bc9fc070 None admin] PATH_INFO: `/v3/groups/2b7c6144619943a48416cd40e5710bb8` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:47.420944 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68d117-b748-4bdf-a3ba-8a31bc9fc070 None admin] RBAC: Authorizing `identity:get_group(group_id=2b7c6144619943a48416cd40e5710bb8)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:47.422503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68d117-b748-4bdf-a3ba-8a31bc9fc070 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:47.424718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 207/432] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:47 2022] GET /identity/v3/groups/2b7c6144619943a48416cd40e5710bb8 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:47.430203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d117-b748-4bdf-a3ba-8a31bc9fc070 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:47.478939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0190d06-46f2-457d-9145-a5f667991f4b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:47.518860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd01a3-5c89-436b-85d6-f56ca38416cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:47.520185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd01a3-5c89-436b-85d6-f56ca38416cf None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:47.520679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd01a3-5c89-436b-85d6-f56ca38416cf None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:47.521158 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd01a3-5c89-436b-85d6-f56ca38416cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:47.523451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:47.527190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:47.534910 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd01a3-5c89-436b-85d6-f56ca38416cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:47.543957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d117-b748-4bdf-a3ba-8a31bc9fc070 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-3acd01a3-5c89-436b-85d6-f56ca38416cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:47.546527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:47.553974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:47.555009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:47.555009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:47.555009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:47.555009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:47.555009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:47.555009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:47.555009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:47.555009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:47.555009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:47.555009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:47.555009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:47.555009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:47.555009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 226/433] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:04:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:47.557182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd01a3-5c89-436b-85d6-f56ca38416cf None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:47.586759 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266e0b9-01d0-4eb0-8293-32c46ba51fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:47.587420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266e0b9-01d0-4eb0-8293-32c46ba51fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:47.587704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266e0b9-01d0-4eb0-8293-32c46ba51fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:47.587974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266e0b9-01d0-4eb0-8293-32c46ba51fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:47.588869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266e0b9-01d0-4eb0-8293-32c46ba51fe0 None admin] RBAC: Adding query filter params (group.id=2b7c6144619943a48416cd40e5710bb8, role.id=d47bb3db22444385b7884acbc7e21b0f, scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:47.589184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266e0b9-01d0-4eb0-8293-32c46ba51fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:47.590610 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266e0b9-01d0-4eb0-8293-32c46ba51fe0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:47.598877 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 208/434] 10.222.0.74 () {56 vars in 1376 bytes} [Thu Jul 14 10:04:47 2022] GET /identity/v3/role_assignments?group.id=2b7c6144619943a48416cd40e5710bb8&scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce&role.id=d47bb3db22444385b7884acbc7e21b0f => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:47.684688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd01a3-5c89-436b-85d6-f56ca38416cf None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:47.727389 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293db541-8c69-4db3-bf7b-59796303d81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:47.728478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293db541-8c69-4db3-bf7b-59796303d81f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:47.728970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293db541-8c69-4db3-bf7b-59796303d81f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:47.729449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293db541-8c69-4db3-bf7b-59796303d81f None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:47.730424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293db541-8c69-4db3-bf7b-59796303d81f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:47.730964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293db541-8c69-4db3-bf7b-59796303d81f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:47.732790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293db541-8c69-4db3-bf7b-59796303d81f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:47.742944 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 227/435] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:47.752990 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266e0b9-01d0-4eb0-8293-32c46ba51fe0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:47.812763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcce5b3-090b-4ad0-b22c-2d0f7170b2c7 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:47.813101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcce5b3-090b-4ad0-b22c-2d0f7170b2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:47.813380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcce5b3-090b-4ad0-b22c-2d0f7170b2c7 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:47.815563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 228/436] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:04:47.821249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4127f-eb7d-40da-9a01-5959935215d6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:47.821541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4127f-eb7d-40da-9a01-5959935215d6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:47.822321 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4127f-eb7d-40da-9a01-5959935215d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:47.850170 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d8a4127f-eb7d-40da-9a01-5959935215d6 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:47.854170 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d8a4127f-eb7d-40da-9a01-5959935215d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:47.927627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266e0b9-01d0-4eb0-8293-32c46ba51fe0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:47.947816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:47.980254 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 229/437] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:47.980443 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a5711-05e6-4a3d-8f6c-a5102f353cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:47.980443 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a5711-05e6-4a3d-8f6c-a5102f353cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:47.980443 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a5711-05e6-4a3d-8f6c-a5102f353cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:47.980681 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a5711-05e6-4a3d-8f6c-a5102f353cd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:47.997411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4127f-eb7d-40da-9a01-5959935215d6 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:48.006065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:48.082512 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a5711-05e6-4a3d-8f6c-a5102f353cd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:48.084332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a5711-05e6-4a3d-8f6c-a5102f353cd1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:48.125575 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4127f-eb7d-40da-9a01-5959935215d6 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:48.166629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70582b10-c033-4757-90bc-75b81e8433d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:48.167478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70582b10-c033-4757-90bc-75b81e8433d4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:48.167759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70582b10-c033-4757-90bc-75b81e8433d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:48.168060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70582b10-c033-4757-90bc-75b81e8433d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:48.179781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70582b10-c033-4757-90bc-75b81e8433d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-70582b10-c033-4757-90bc-75b81e8433d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:48.189680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:48.190703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:48.191518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:48.191518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:48.191518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:48.191518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:48.191518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:48.191518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:48.191518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:48.191518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:48.191518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:48.191518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:48.191518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:48.191518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:48.191518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 230/438] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:04:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:48.197030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70582b10-c033-4757-90bc-75b81e8433d4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:48.226266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 209/439] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:48.231386 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a5711-05e6-4a3d-8f6c-a5102f353cd1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:48.265527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:48.295108 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:48.326048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70582b10-c033-4757-90bc-75b81e8433d4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:48.351287 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a5711-05e6-4a3d-8f6c-a5102f353cd1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:48.362993 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f7bd7-be87-47f9-a4bf-fc0ebae3982a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:48.363798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f7bd7-be87-47f9-a4bf-fc0ebae3982a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:48.364234 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f7bd7-be87-47f9-a4bf-fc0ebae3982a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:48.364533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f7bd7-be87-47f9-a4bf-fc0ebae3982a None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:48.365270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f7bd7-be87-47f9-a4bf-fc0ebae3982a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:48.365581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f7bd7-be87-47f9-a4bf-fc0ebae3982a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:48.366976 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f7bd7-be87-47f9-a4bf-fc0ebae3982a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:48.376075 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 231/440] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:48.380497 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f7bd7-be87-47f9-a4bf-fc0ebae3982a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:48.392178 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3afd8-3b7e-40e7-bb91-8a7101f0a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:48.393033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3afd8-3b7e-40e7-bb91-8a7101f0a8fe None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:48.393310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3afd8-3b7e-40e7-bb91-8a7101f0a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:48.393579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3afd8-3b7e-40e7-bb91-8a7101f0a8fe None admin] PATH_INFO: `/v3/projects/8600563b295742f1a8d5ba26a2a51f14` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:48.394744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3afd8-3b7e-40e7-bb91-8a7101f0a8fe None admin] RBAC: Authorizing `identity:get_project(project_id=8600563b295742f1a8d5ba26a2a51f14)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:48.396219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3afd8-3b7e-40e7-bb91-8a7101f0a8fe None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:48.397895 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 210/441] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:48 2022] GET /identity/v3/projects/8600563b295742f1a8d5ba26a2a51f14 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:48.403086 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3afd8-3b7e-40e7-bb91-8a7101f0a8fe None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:48.489043 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f7bd7-be87-47f9-a4bf-fc0ebae3982a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:48.498243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:48.512221 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3afd8-3b7e-40e7-bb91-8a7101f0a8fe None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:48.530220 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:48.531973 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb5486-ea81-4590-849c-d955ddfe3e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:48.533194 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5486-ea81-4590-849c-d955ddfe3e03 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:48.533480 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5486-ea81-4590-849c-d955ddfe3e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:48.533763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5486-ea81-4590-849c-d955ddfe3e03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:48.547335 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1daeb7-4506-43b2-9566-a25d1416c9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:48.548275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1daeb7-4506-43b2-9566-a25d1416c9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:48.549107 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1daeb7-4506-43b2-9566-a25d1416c9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:48.549380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1daeb7-4506-43b2-9566-a25d1416c9d2 None admin] PATH_INFO: `/v3/groups/2b7c6144619943a48416cd40e5710bb8` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:48.550572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1daeb7-4506-43b2-9566-a25d1416c9d2 None admin] RBAC: Authorizing `identity:get_group(group_id=2b7c6144619943a48416cd40e5710bb8)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:48.552045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1daeb7-4506-43b2-9566-a25d1416c9d2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:48.553665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 211/442] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:48 2022] GET /identity/v3/groups/2b7c6144619943a48416cd40e5710bb8 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:48.554829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365e5d8-e595-4375-b595-47d7d682acff None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:48.555117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365e5d8-e595-4375-b595-47d7d682acff None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:48.555492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365e5d8-e595-4375-b595-47d7d682acff None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:48.557013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 212/443] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:48.559715 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365e5d8-e595-4375-b595-47d7d682acff None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:48.605827 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb5486-ea81-4590-849c-d955ddfe3e03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:48.607273 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb5486-ea81-4590-849c-d955ddfe3e03 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:48.659916 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365e5d8-e595-4375-b595-47d7d682acff None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:48.692900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71134b75-7af8-4ddf-9b55-ffa47ba2e67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:48.693545 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71134b75-7af8-4ddf-9b55-ffa47ba2e67a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:48.693833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71134b75-7af8-4ddf-9b55-ffa47ba2e67a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:48.694101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71134b75-7af8-4ddf-9b55-ffa47ba2e67a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:48.694919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71134b75-7af8-4ddf-9b55-ffa47ba2e67a None admin] RBAC: Adding query filter params (group.id=2b7c6144619943a48416cd40e5710bb8, role.id=282334a450b54dedb0b42d678d231caf, scope.project.id=8600563b295742f1a8d5ba26a2a51f14) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:48.695231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71134b75-7af8-4ddf-9b55-ffa47ba2e67a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:48.696684 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71134b75-7af8-4ddf-9b55-ffa47ba2e67a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:48.702808 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 213/444] 10.222.0.74 () {56 vars in 1376 bytes} [Thu Jul 14 10:04:48 2022] GET /identity/v3/role_assignments?group.id=2b7c6144619943a48416cd40e5710bb8&scope.project.id=8600563b295742f1a8d5ba26a2a51f14&role.id=282334a450b54dedb0b42d678d231caf => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:48.709571 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 232/445] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:04:48.709751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a6f06-84b7-44e0-baff-6d8767641cb8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:48.709751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a6f06-84b7-44e0-baff-6d8767641cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:48.709751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a6f06-84b7-44e0-baff-6d8767641cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:48.710591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb5486-ea81-4590-849c-d955ddfe3e03 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:48.722361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:48.729401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-df2a6f06-84b7-44e0-baff-6d8767641cb8 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:48.730640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-df2a6f06-84b7-44e0-baff-6d8767641cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:48.783888 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:48.807747 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 214/446] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:48.822723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb5486-ea81-4590-849c-d955ddfe3e03 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:48.831772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a6f06-84b7-44e0-baff-6d8767641cb8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:48.865097 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d4e44-0674-4344-86d2-e75d94b009fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:48.865968 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d4e44-0674-4344-86d2-e75d94b009fa None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:48.866255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d4e44-0674-4344-86d2-e75d94b009fa None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:48.866531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d4e44-0674-4344-86d2-e75d94b009fa None admin] PATH_INFO: `/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:48.867739 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d4e44-0674-4344-86d2-e75d94b009fa None admin] RBAC: Authorizing `identity:get_project(project_id=c1615dfc209c4ce8a6f76bb6343932ce)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:48.869227 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d4e44-0674-4344-86d2-e75d94b009fa None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:48.871058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 233/447] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:48 2022] GET /identity/v3/projects/c1615dfc209c4ce8a6f76bb6343932ce => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:48.876719 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d4e44-0674-4344-86d2-e75d94b009fa None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:48.949648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a6f06-84b7-44e0-baff-6d8767641cb8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:48.973933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:48.993264 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703fc6c-000a-4e1a-ab78-8ec1c355f66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:48.994396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703fc6c-000a-4e1a-ab78-8ec1c355f66e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:48.994886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703fc6c-000a-4e1a-ab78-8ec1c355f66e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:48.995167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703fc6c-000a-4e1a-ab78-8ec1c355f66e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:49.000397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d4e44-0674-4344-86d2-e75d94b009fa None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:49.007803 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703fc6c-000a-4e1a-ab78-8ec1c355f66e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-4703fc6c-000a-4e1a-ab78-8ec1c355f66e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:49.015575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:49.016591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:49.017977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:49.017977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:49.017977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:49.017977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:49.017977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:49.017977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:49.017977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:49.017977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:49.017977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:49.017977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:49.017977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:04:49.017977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:49.020432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 215/448] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:04:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:49.023158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703fc6c-000a-4e1a-ab78-8ec1c355f66e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:49.040520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a93e3-db21-4aa8-a01c-40fc1499e7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:49.041604 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a93e3-db21-4aa8-a01c-40fc1499e7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:49.041872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a93e3-db21-4aa8-a01c-40fc1499e7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:49.042143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a93e3-db21-4aa8-a01c-40fc1499e7d5 None admin] PATH_INFO: `/v3/groups/2b7c6144619943a48416cd40e5710bb8` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:49.043743 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a93e3-db21-4aa8-a01c-40fc1499e7d5 None admin] RBAC: Authorizing `identity:get_group(group_id=2b7c6144619943a48416cd40e5710bb8)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:49.045271 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a93e3-db21-4aa8-a01c-40fc1499e7d5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:49.047093 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 234/449] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:48 2022] GET /identity/v3/groups/2b7c6144619943a48416cd40e5710bb8 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:49.054695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a93e3-db21-4aa8-a01c-40fc1499e7d5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:49.084185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:49.156575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703fc6c-000a-4e1a-ab78-8ec1c355f66e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:49.174308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a93e3-db21-4aa8-a01c-40fc1499e7d5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:49.199928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b3355-1df0-4538-9a33-1194b52d412c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:49.200638 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b3355-1df0-4538-9a33-1194b52d412c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:49.201062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b3355-1df0-4538-9a33-1194b52d412c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:49.201259 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b3355-1df0-4538-9a33-1194b52d412c None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:49.202038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b3355-1df0-4538-9a33-1194b52d412c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:49.202343 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b3355-1df0-4538-9a33-1194b52d412c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:49.204926 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b3355-1df0-4538-9a33-1194b52d412c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:49.213395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 216/450] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:49.217115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24eff0-c5cb-47cd-8063-c54c75c69b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:49.218038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24eff0-c5cb-47cd-8063-c54c75c69b5c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:49.218328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24eff0-c5cb-47cd-8063-c54c75c69b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:49.218608 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24eff0-c5cb-47cd-8063-c54c75c69b5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:49.218696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b3355-1df0-4538-9a33-1194b52d412c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:49.219454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24eff0-c5cb-47cd-8063-c54c75c69b5c None admin] RBAC: Adding query filter params (group.id=2b7c6144619943a48416cd40e5710bb8, role.id=282334a450b54dedb0b42d678d231caf, scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:49.219769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24eff0-c5cb-47cd-8063-c54c75c69b5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:49.221984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24eff0-c5cb-47cd-8063-c54c75c69b5c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:49.228119 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 235/451] 10.222.0.74 () {56 vars in 1376 bytes} [Thu Jul 14 10:04:49 2022] GET /identity/v3/role_assignments?group.id=2b7c6144619943a48416cd40e5710bb8&scope.project.id=c1615dfc209c4ce8a6f76bb6343932ce&role.id=282334a450b54dedb0b42d678d231caf => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:49.324143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b3355-1df0-4538-9a33-1194b52d412c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:49.325652 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:49.359659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4561f-284e-439f-9c69-03a474b6783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:49.360350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4561f-284e-439f-9c69-03a474b6783b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:49.360655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4561f-284e-439f-9c69-03a474b6783b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:49.361549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4561f-284e-439f-9c69-03a474b6783b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:49.433647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4561f-284e-439f-9c69-03a474b6783b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:49.435127 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4561f-284e-439f-9c69-03a474b6783b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:49.540498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 217/452] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:04:49.546103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24eff0-c5cb-47cd-8063-c54c75c69b5c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:49.557669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:49.645083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24eff0-c5cb-47cd-8063-c54c75c69b5c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:49.678205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b02f6-e57e-4f05-9aaa-e89f5c580a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:49.679057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b02f6-e57e-4f05-9aaa-e89f5c580a8f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:49.679337 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b02f6-e57e-4f05-9aaa-e89f5c580a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:49.679608 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b02f6-e57e-4f05-9aaa-e89f5c580a8f None admin] PATH_INFO: `/v3/projects/749adf9dd9f744529e5dfac400623e53` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:49.680800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b02f6-e57e-4f05-9aaa-e89f5c580a8f None admin] RBAC: Authorizing `identity:get_project(project_id=749adf9dd9f744529e5dfac400623e53)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:49.682231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b02f6-e57e-4f05-9aaa-e89f5c580a8f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:49.683909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 236/453] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:04:49 2022] GET /identity/v3/projects/749adf9dd9f744529e5dfac400623e53 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:49.689354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4561f-284e-439f-9c69-03a474b6783b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:49.691494 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:49.786142 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4561f-284e-439f-9c69-03a474b6783b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:49.818548 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd70bde-7fb2-4696-9e73-112e810d2e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:49.819377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd70bde-7fb2-4696-9e73-112e810d2e84 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:49.819660 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd70bde-7fb2-4696-9e73-112e810d2e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:49.819933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd70bde-7fb2-4696-9e73-112e810d2e84 None admin] PATH_INFO: `/v3/groups/f5719f0c27524f6fa019c7a06245f8f2` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:49.821119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd70bde-7fb2-4696-9e73-112e810d2e84 None admin] RBAC: Authorizing `identity:get_group(group_id=f5719f0c27524f6fa019c7a06245f8f2)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:49.822553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd70bde-7fb2-4696-9e73-112e810d2e84 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:49.824166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 218/454] 10.222.0.74 () {56 vars in 1180 bytes} [Thu Jul 14 10:04:49 2022] GET /identity/v3/groups/f5719f0c27524f6fa019c7a06245f8f2 => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:49.829848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b02f6-e57e-4f05-9aaa-e89f5c580a8f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:49.904361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:49.927443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b02f6-e57e-4f05-9aaa-e89f5c580a8f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:49.959600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76ad80-1ac3-48f6-9c31-929a37763f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:49.960267 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76ad80-1ac3-48f6-9c31-929a37763f94 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:49.960552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76ad80-1ac3-48f6-9c31-929a37763f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:49.960823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76ad80-1ac3-48f6-9c31-929a37763f94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:49.961650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76ad80-1ac3-48f6-9c31-929a37763f94 None admin] RBAC: Adding query filter params (group.id=f5719f0c27524f6fa019c7a06245f8f2, role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=749adf9dd9f744529e5dfac400623e53) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:49.961960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76ad80-1ac3-48f6-9c31-929a37763f94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:49.963379 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76ad80-1ac3-48f6-9c31-929a37763f94 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:49.969057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 237/455] 10.222.0.74 () {56 vars in 1376 bytes} [Thu Jul 14 10:04:49 2022] GET /identity/v3/role_assignments?group.id=f5719f0c27524f6fa019c7a06245f8f2&scope.project.id=749adf9dd9f744529e5dfac400623e53&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:52.319860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c6249-8378-400b-b1c1-de13ddeeca5f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:52.320765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c6249-8378-400b-b1c1-de13ddeeca5f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:52.321217 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c6249-8378-400b-b1c1-de13ddeeca5f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:52.322764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 219/456] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:52.328471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20e7db-5f24-4345-bb16-f3d814c4a665 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:52.329414 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20e7db-5f24-4345-bb16-f3d814c4a665 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:52.329893 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20e7db-5f24-4345-bb16-f3d814c4a665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:52.356081 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-bd20e7db-5f24-4345-bb16-f3d814c4a665 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:52.357602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bd20e7db-5f24-4345-bb16-f3d814c4a665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:52.427298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 238/457] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:52.451362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c6249-8378-400b-b1c1-de13ddeeca5f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:52.524742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:52.557601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c6249-8378-400b-b1c1-de13ddeeca5f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:52.593015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a57fc-ba03-4b0e-bb99-b98bba7a614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:52.593738 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a57fc-ba03-4b0e-bb99-b98bba7a614e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:52.594029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a57fc-ba03-4b0e-bb99-b98bba7a614e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:52.594309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a57fc-ba03-4b0e-bb99-b98bba7a614e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:52.604593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a57fc-ba03-4b0e-bb99-b98bba7a614e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:52.606042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a57fc-ba03-4b0e-bb99-b98bba7a614e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-7e6a57fc-ba03-4b0e-bb99-b98bba7a614e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:04:52.624018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:52.624923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:52.627102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:04:52.627102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:04:52.627102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:52.627102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:52.627102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 220/458] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:52.631677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20e7db-5f24-4345-bb16-f3d814c4a665 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:52.730852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:52.766139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20e7db-5f24-4345-bb16-f3d814c4a665 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:52.815775 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7a5a3-c602-4288-a4eb-b8df413089d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:52.816476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7a5a3-c602-4288-a4eb-b8df413089d1 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:52.816757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7a5a3-c602-4288-a4eb-b8df413089d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:52.817030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7a5a3-c602-4288-a4eb-b8df413089d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:52.817764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7a5a3-c602-4288-a4eb-b8df413089d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:52.818066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7a5a3-c602-4288-a4eb-b8df413089d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:52.819436 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7a5a3-c602-4288-a4eb-b8df413089d1 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:52.843650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 239/459] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:52.849204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a57fc-ba03-4b0e-bb99-b98bba7a614e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:52.879217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a5d33-58f6-42c4-bb80-23f804889163 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:52.879526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a5d33-58f6-42c4-bb80-23f804889163 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:52.879779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a5d33-58f6-42c4-bb80-23f804889163 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:52.881925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 240/460] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:52.904105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a370a-d142-4bfb-a782-7bc6d0a31337 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:52.904406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a370a-d142-4bfb-a782-7bc6d0a31337 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:52.904730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a370a-d142-4bfb-a782-7bc6d0a31337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:52.929520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f26a370a-d142-4bfb-a782-7bc6d0a31337 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:52.931016 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f26a370a-d142-4bfb-a782-7bc6d0a31337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:52.972727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a57fc-ba03-4b0e-bb99-b98bba7a614e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:53.000863 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:53.013634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e32752-7ec7-43e4-9591-c5fed9d9cc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:53.014523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e32752-7ec7-43e4-9591-c5fed9d9cc70 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.014962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e32752-7ec7-43e4-9591-c5fed9d9cc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.015296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e32752-7ec7-43e4-9591-c5fed9d9cc70 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.016170 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e32752-7ec7-43e4-9591-c5fed9d9cc70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:53.016910 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 241/461] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:53.018741 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d9cf1-e81b-4c6c-a09d-39948d7f199c None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.019029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d9cf1-e81b-4c6c-a09d-39948d7f199c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.019304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d9cf1-e81b-4c6c-a09d-39948d7f199c None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.020657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 242/462] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:53.025256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e32752-7ec7-43e4-9591-c5fed9d9cc70 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:53.034101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46255e82-10f8-4a06-bbfe-fc89a4c290fe None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.034389 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46255e82-10f8-4a06-bbfe-fc89a4c290fe None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.034667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46255e82-10f8-4a06-bbfe-fc89a4c290fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.060704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-46255e82-10f8-4a06-bbfe-fc89a4c290fe None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:53.067676 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-46255e82-10f8-4a06-bbfe-fc89a4c290fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:53.107987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 221/463] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:04:52 2022] POST /identity/v3/users => generated 246 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:04:53.109886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e32752-7ec7-43e4-9591-c5fed9d9cc70 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:53.124902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:53.144024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 243/464] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:53.169263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46255e82-10f8-4a06-bbfe-fc89a4c290fe None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:53.275120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e32752-7ec7-43e4-9591-c5fed9d9cc70 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:53.314824 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcfb46-3b57-4991-8423-6bfe318cb3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:53.316931 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcfb46-3b57-4991-8423-6bfe318cb3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.316931 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcfb46-3b57-4991-8423-6bfe318cb3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.316931 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcfb46-3b57-4991-8423-6bfe318cb3e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.321907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46255e82-10f8-4a06-bbfe-fc89a4c290fe None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:53.332932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcfb46-3b57-4991-8423-6bfe318cb3e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:53.334913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcfb46-3b57-4991-8423-6bfe318cb3e2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-fdbcfb46-3b57-4991-8423-6bfe318cb3e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:04:53.355742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:53.356703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:53.357592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:04:53.357592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:04:53.357592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:53.357592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:53.357592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 222/465] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:53.359003 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b1751-8eff-428b-b93c-e3e4a89cba85 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.359231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b1751-8eff-428b-b93c-e3e4a89cba85 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.359506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b1751-8eff-428b-b93c-e3e4a89cba85 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.365239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 223/466] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:53.366934 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b1751-8eff-428b-b93c-e3e4a89cba85 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:53.378359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d345dd-8347-458e-a56e-af6c97f278b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:53.379185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d345dd-8347-458e-a56e-af6c97f278b9 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.379713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d345dd-8347-458e-a56e-af6c97f278b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.380099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d345dd-8347-458e-a56e-af6c97f278b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.393628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d345dd-8347-458e-a56e-af6c97f278b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:53.395691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d345dd-8347-458e-a56e-af6c97f278b9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-67d345dd-8347-458e-a56e-af6c97f278b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:04:53.418843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:53.419757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:53.420657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:04:53.420657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:04:53.420657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:53.420657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:53.420657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 244/467] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:53.421613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf7993-01e8-4708-9e0c-565766d1caf8 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.421903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf7993-01e8-4708-9e0c-565766d1caf8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.422447 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:53.424382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf7993-01e8-4708-9e0c-565766d1caf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.447892 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4acf7993-01e8-4708-9e0c-565766d1caf8 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:53.449299 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4acf7993-01e8-4708-9e0c-565766d1caf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:53.497592 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:53.500665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b1751-8eff-428b-b93c-e3e4a89cba85 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:53.538120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 245/468] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:53.539313 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf7993-01e8-4708-9e0c-565766d1caf8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:53.544345 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6dae3-add3-43e8-975c-01a491d368ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:53.545289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6dae3-add3-43e8-975c-01a491d368ff None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.545760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6dae3-add3-43e8-975c-01a491d368ff None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.546245 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6dae3-add3-43e8-975c-01a491d368ff None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.547292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6dae3-add3-43e8-975c-01a491d368ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:53.548268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6dae3-add3-43e8-975c-01a491d368ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:53.549966 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6dae3-add3-43e8-975c-01a491d368ff None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:53.573811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 224/469] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:53.577468 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6dae3-add3-43e8-975c-01a491d368ff None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:53.677005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:53.682362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf7993-01e8-4708-9e0c-565766d1caf8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:53.686665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6dae3-add3-43e8-975c-01a491d368ff None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:53.722252 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc6dfd-4fe0-4535-99c8-1e3785bd21b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:53.722578 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acb84c-65a7-4fa3-a52d-b0e8d2520e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:53.723323 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acb84c-65a7-4fa3-a52d-b0e8d2520e5d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.723603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acb84c-65a7-4fa3-a52d-b0e8d2520e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.723874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acb84c-65a7-4fa3-a52d-b0e8d2520e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.724122 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc6dfd-4fe0-4535-99c8-1e3785bd21b3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.724612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc6dfd-4fe0-4535-99c8-1e3785bd21b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.725098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc6dfd-4fe0-4535-99c8-1e3785bd21b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.726140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc6dfd-4fe0-4535-99c8-1e3785bd21b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:53.727041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc6dfd-4fe0-4535-99c8-1e3785bd21b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:53.729644 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc6dfd-4fe0-4535-99c8-1e3785bd21b3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:53.734431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acb84c-65a7-4fa3-a52d-b0e8d2520e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:53.735907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acb84c-65a7-4fa3-a52d-b0e8d2520e5d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:53.743860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 246/470] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:53.745073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc6dfd-4fe0-4535-99c8-1e3785bd21b3 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-42acb84c-65a7-4fa3-a52d-b0e8d2520e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:04:53.754120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:53.755013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:53.755902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:04:53.755902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:04:53.755902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:53.755902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:53.760306 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 225/471] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:53.761413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acb84c-65a7-4fa3-a52d-b0e8d2520e5d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:53.783135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:53.862083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc6dfd-4fe0-4535-99c8-1e3785bd21b3 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:53.864216 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acb84c-65a7-4fa3-a52d-b0e8d2520e5d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:53.899846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c13e4-bd58-4b08-9385-0e48b6dd7b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:53.900525 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c13e4-bd58-4b08-9385-0e48b6dd7b37 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.900804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c13e4-bd58-4b08-9385-0e48b6dd7b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.901073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c13e4-bd58-4b08-9385-0e48b6dd7b37 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.901772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c13e4-bd58-4b08-9385-0e48b6dd7b37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:53.902377 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793754-bab9-4a92-b4e9-313533a364ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:53.903262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793754-bab9-4a92-b4e9-313533a364ab None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.903365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c13e4-bd58-4b08-9385-0e48b6dd7b37 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:53.903802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793754-bab9-4a92-b4e9-313533a364ab None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.904280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793754-bab9-4a92-b4e9-313533a364ab None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.905144 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b793754-bab9-4a92-b4e9-313533a364ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:53.906775 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b793754-bab9-4a92-b4e9-313533a364ab None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:53.975634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:53.980329 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 226/472] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:04:53 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:04:53.981299 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c13e4-bd58-4b08-9385-0e48b6dd7b37 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:54.005104 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 247/473] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:04:53 2022] POST /identity/v3/users => generated 248 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:04:54.006493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc6716-5189-4aac-9795-5325a4416ea7 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:54.008417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc6716-5189-4aac-9795-5325a4416ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:54.008417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc6716-5189-4aac-9795-5325a4416ea7 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:54.021669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 248/474] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:54.030787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db97e8b-4744-4125-bd49-d502c3ca79d2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:54.031113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db97e8b-4744-4125-bd49-d502c3ca79d2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:54.031344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db97e8b-4744-4125-bd49-d502c3ca79d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:54.077374 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9db97e8b-4744-4125-bd49-d502c3ca79d2 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:54.079080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9db97e8b-4744-4125-bd49-d502c3ca79d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:54.181126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c13e4-bd58-4b08-9385-0e48b6dd7b37 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:54.214380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 249/475] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:04:54.219317 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8289c2-fdd1-45d4-970c-920d3489e627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:54.220062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8289c2-fdd1-45d4-970c-920d3489e627 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:54.221486 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8289c2-fdd1-45d4-970c-920d3489e627 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:54.221486 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8289c2-fdd1-45d4-970c-920d3489e627 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:54.221845 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8289c2-fdd1-45d4-970c-920d3489e627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:54.222150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8289c2-fdd1-45d4-970c-920d3489e627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:54.223535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8289c2-fdd1-45d4-970c-920d3489e627 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:54.234976 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db97e8b-4744-4125-bd49-d502c3ca79d2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:54.238985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 227/476] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:54.246391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8289c2-fdd1-45d4-970c-920d3489e627 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:54.266660 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:54.325704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:54.376264 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8289c2-fdd1-45d4-970c-920d3489e627 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:54.380276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db97e8b-4744-4125-bd49-d502c3ca79d2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:54.415411 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fffc8c-48bc-44c3-9869-f6a2995f886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:54.416222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fffc8c-48bc-44c3-9869-f6a2995f886a None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:54.416612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fffc8c-48bc-44c3-9869-f6a2995f886a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:54.416891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fffc8c-48bc-44c3-9869-f6a2995f886a None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:54.417600 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fffc8c-48bc-44c3-9869-f6a2995f886a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:54.419247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fffc8c-48bc-44c3-9869-f6a2995f886a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:54.421374 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1c028-9af9-4eab-8284-34cf18fd555a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:54.422050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1c028-9af9-4eab-8284-34cf18fd555a None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:54.422330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1c028-9af9-4eab-8284-34cf18fd555a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:54.422600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1c028-9af9-4eab-8284-34cf18fd555a None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:54.423911 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1c028-9af9-4eab-8284-34cf18fd555a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:54.425328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1c028-9af9-4eab-8284-34cf18fd555a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:54.453714 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.sql.core [None req-84f1c028-9af9-4eab-8284-34cf18fd555a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 10:04:54.453714 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 10:04:54.453714 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [parameters: {'id': '229146cf630e4c75b2f0676e164836a5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 10:04:54.453714 dv-cinder-849800-1-smb devstack@keystone.service[80502]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80502) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-84f1c028-9af9-4eab-8284-34cf18fd555a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application result.read() Jul 14 10:04:54.470742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return ref.to_dict() Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:04:54.471680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application yield resource Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise self.value Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application session.commit() Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 10:04:54.473251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.session.flush() Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application compat.raise_( Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 10:04:54.474129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:04:54.475032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application result.read() Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:04:54.487750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [parameters: {'id': '229146cf630e4c75b2f0676e164836a5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:54.489724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 10:04:54.491557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:54.497666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 250/477] 10.222.0.74 () {60 vars in 1131 bytes} [Thu Jul 14 10:04:54 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:04:54.497666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1c028-9af9-4eab-8284-34cf18fd555a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:54.513279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 228/478] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:04:54 2022] POST /identity/v3/users => generated 249 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:04:54.606771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:54.634792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1c028-9af9-4eab-8284-34cf18fd555a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:54.695268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa2365-13a9-4bfe-bd25-2513098556a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:54.696157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa2365-13a9-4bfe-bd25-2513098556a0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:54.696491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa2365-13a9-4bfe-bd25-2513098556a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:54.696724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa2365-13a9-4bfe-bd25-2513098556a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:54.726500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa2365-13a9-4bfe-bd25-2513098556a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-10fa2365-13a9-4bfe-bd25-2513098556a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:54.734537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:54.737118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:54.739161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:54.739161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:54.739161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:54.739161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:54.739161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:54.739161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:54.739161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:54.739161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:54.739161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:54.739161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:54.739161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:04:54.739161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:54.739161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 251/479] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:04:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:54.744017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fffc8c-48bc-44c3-9869-f6a2995f886a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:54.847756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fffc8c-48bc-44c3-9869-f6a2995f886a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:54.862071 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:54.887069 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17e263-f95f-4798-aef6-8a25feeb0eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:54.887755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17e263-f95f-4798-aef6-8a25feeb0eba None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:54.888118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17e263-f95f-4798-aef6-8a25feeb0eba None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:54.888396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17e263-f95f-4798-aef6-8a25feeb0eba None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:54.889168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17e263-f95f-4798-aef6-8a25feeb0eba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:54.889475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17e263-f95f-4798-aef6-8a25feeb0eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:54.890864 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17e263-f95f-4798-aef6-8a25feeb0eba None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:54.901950 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 229/480] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:55.509654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf43516-748f-4292-b68a-b76c7d7f28ee None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:55.510354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf43516-748f-4292-b68a-b76c7d7f28ee None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:55.510354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf43516-748f-4292-b68a-b76c7d7f28ee None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:55.511849 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 252/481] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:55.517059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de708a-d716-43cc-ac6d-94c7c84efbd4 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:55.517545 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de708a-d716-43cc-ac6d-94c7c84efbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:55.517711 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de708a-d716-43cc-ac6d-94c7c84efbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:55.541007 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-94de708a-d716-43cc-ac6d-94c7c84efbd4 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:55.542238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-94de708a-d716-43cc-ac6d-94c7c84efbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:55.638535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 230/482] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:55.666900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf43516-748f-4292-b68a-b76c7d7f28ee None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:55.789198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf43516-748f-4292-b68a-b76c7d7f28ee None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:55.842041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6d0ba-ab30-4e77-98d8-fcefdf8e2871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:55.842844 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6d0ba-ab30-4e77-98d8-fcefdf8e2871 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:55.843124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6d0ba-ab30-4e77-98d8-fcefdf8e2871 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:55.843399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6d0ba-ab30-4e77-98d8-fcefdf8e2871 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:55.859791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6d0ba-ab30-4e77-98d8-fcefdf8e2871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-55a6d0ba-ab30-4e77-98d8-fcefdf8e2871 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:55.868243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:55.869205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:55.870000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:55.870000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:55.870000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:55.870000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:55.870000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:55.870000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:55.870000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:55.870000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:55.870000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:55.870000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:55.870000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:04:55.870000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:55.870000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 253/483] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:04:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:55.875124 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de708a-d716-43cc-ac6d-94c7c84efbd4 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:56.032164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de708a-d716-43cc-ac6d-94c7c84efbd4 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:56.051407 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:56.075020 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f5f39-4a79-44cc-9d30-da5471cb028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:56.075860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f5f39-4a79-44cc-9d30-da5471cb028e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:56.076274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f5f39-4a79-44cc-9d30-da5471cb028e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:56.076655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f5f39-4a79-44cc-9d30-da5471cb028e None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:56.077537 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f5f39-4a79-44cc-9d30-da5471cb028e None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:56.077956 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f5f39-4a79-44cc-9d30-da5471cb028e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:56.079484 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f5f39-4a79-44cc-9d30-da5471cb028e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:56.089546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 231/484] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:04:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:56.101214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6d0ba-ab30-4e77-98d8-fcefdf8e2871 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:56.105107 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:56.252181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6d0ba-ab30-4e77-98d8-fcefdf8e2871 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:56.288745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2065c5-75fd-46b9-877a-aed749395df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:56.289553 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2065c5-75fd-46b9-877a-aed749395df0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:56.289836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2065c5-75fd-46b9-877a-aed749395df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:56.290111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2065c5-75fd-46b9-877a-aed749395df0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:56.301636 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2065c5-75fd-46b9-877a-aed749395df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:56.303052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2065c5-75fd-46b9-877a-aed749395df0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-df2065c5-75fd-46b9-877a-aed749395df0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:04:56.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:56.321612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:56.322477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:04:56.322477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:04:56.322477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:56.322477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:56.322477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 254/485] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:56.327751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f5f39-4a79-44cc-9d30-da5471cb028e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:56.425209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1895b26-ad03-4d2c-bd9f-fc6977786337 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:56.425529 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1895b26-ad03-4d2c-bd9f-fc6977786337 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:56.425803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1895b26-ad03-4d2c-bd9f-fc6977786337 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:56.427498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 255/486] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:04:56.432276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e3c15-f4ad-4c00-94ce-6252a8b0cf06 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:56.432563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e3c15-f4ad-4c00-94ce-6252a8b0cf06 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:56.432840 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e3c15-f4ad-4c00-94ce-6252a8b0cf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:56.451344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-567e3c15-f4ad-4c00-94ce-6252a8b0cf06 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:56.452564 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-567e3c15-f4ad-4c00-94ce-6252a8b0cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:56.459658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f5f39-4a79-44cc-9d30-da5471cb028e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:56.506179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:56.521645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404670f-42c7-4296-8301-3cef97236545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:56.522327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404670f-42c7-4296-8301-3cef97236545 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:56.522611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404670f-42c7-4296-8301-3cef97236545 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:56.522885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404670f-42c7-4296-8301-3cef97236545 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:56.532595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404670f-42c7-4296-8301-3cef97236545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:56.532595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404670f-42c7-4296-8301-3cef97236545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:56.532795 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 256/487] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:56.533190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404670f-42c7-4296-8301-3cef97236545 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:56.538913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 232/488] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:04:56.544216 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e3c15-f4ad-4c00-94ce-6252a8b0cf06 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:56.549310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404670f-42c7-4296-8301-3cef97236545 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:56.579048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:56.721867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e3c15-f4ad-4c00-94ce-6252a8b0cf06 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:56.740584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404670f-42c7-4296-8301-3cef97236545 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:56.769193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931092ae-1ba0-4fcf-b1f9-e629da2452ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:56.770099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931092ae-1ba0-4fcf-b1f9-e629da2452ca None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:56.770385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931092ae-1ba0-4fcf-b1f9-e629da2452ca None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:56.770657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931092ae-1ba0-4fcf-b1f9-e629da2452ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:56.779681 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931092ae-1ba0-4fcf-b1f9-e629da2452ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:56.781180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931092ae-1ba0-4fcf-b1f9-e629da2452ca None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:56.791616 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24251f86-4b4a-47a5-a56a-002671b3a758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:56.792511 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251f86-4b4a-47a5-a56a-002671b3a758 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:56.792791 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251f86-4b4a-47a5-a56a-002671b3a758 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:56.793063 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251f86-4b4a-47a5-a56a-002671b3a758 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-931092ae-1ba0-4fcf-b1f9-e629da2452ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:04:56.807683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:56.808672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:56.809593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:56.809593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:56.809593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:04:56.809593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:04:56.809593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:04:56.809593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:04:56.809593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:04:56.809593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:04:56.809593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:04:56.809593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:56.809593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 257/489] 10.222.0.74 () {56 vars in 1093 bytes} [Thu Jul 14 10:04:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:56.815435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa7b54-4c27-40d2-8e3d-499e3b47b1b8 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:56.815722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa7b54-4c27-40d2-8e3d-499e3b47b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:56.816010 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa7b54-4c27-40d2-8e3d-499e3b47b1b8 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:56.818657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24251f86-4b4a-47a5-a56a-002671b3a758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:56.821207 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 258/490] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:04:56.821972 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa7b54-4c27-40d2-8e3d-499e3b47b1b8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-24251f86-4b4a-47a5-a56a-002671b3a758 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:56.827779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:56.828689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:56.830118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:56.830118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:56.830118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:56.830118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:56.830118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:56.830118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:56.830118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:56.830118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:56.830118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:56.830118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:56.830118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:04:56.830118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:56.832833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 233/491] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:04:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:56.834267 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da3db8-74a6-4777-8faf-9618d0e32831 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:56.834774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da3db8-74a6-4777-8faf-9618d0e32831 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:56.835249 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da3db8-74a6-4777-8faf-9618d0e32831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:56.854143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f6da3db8-74a6-4777-8faf-9618d0e32831 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:56.856530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f6da3db8-74a6-4777-8faf-9618d0e32831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:56.875481 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:56.936940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa7b54-4c27-40d2-8e3d-499e3b47b1b8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:56.941716 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 234/492] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:56.942765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da3db8-74a6-4777-8faf-9618d0e32831 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:56.968435 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:57.001189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf04e9-3410-4919-a09f-126fde52db51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:57.002678 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf04e9-3410-4919-a09f-126fde52db51 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:57.003459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf04e9-3410-4919-a09f-126fde52db51 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:57.003918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf04e9-3410-4919-a09f-126fde52db51 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:57.005498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf04e9-3410-4919-a09f-126fde52db51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:57.006026 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf04e9-3410-4919-a09f-126fde52db51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:57.008090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf04e9-3410-4919-a09f-126fde52db51 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:57.055765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da3db8-74a6-4777-8faf-9618d0e32831 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:57.066383 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 259/493] 10.222.0.74 () {56 vars in 1133 bytes} [Thu Jul 14 10:04:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:57.067250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf04e9-3410-4919-a09f-126fde52db51 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:57.102570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fdd60-9305-495e-ba85-762dc06f8c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:57.104367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fdd60-9305-495e-ba85-762dc06f8c50 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:57.104764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fdd60-9305-495e-ba85-762dc06f8c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:57.105050 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fdd60-9305-495e-ba85-762dc06f8c50 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:57.105818 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fdd60-9305-495e-ba85-762dc06f8c50 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:57.106127 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fdd60-9305-495e-ba85-762dc06f8c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:57.107503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fdd60-9305-495e-ba85-762dc06f8c50 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:57.116904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 235/494] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:04:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:57.117730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fdd60-9305-495e-ba85-762dc06f8c50 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:57.192343 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf04e9-3410-4919-a09f-126fde52db51 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:57.193933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:57.211095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:57.228541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a8809-9ae1-46ab-b6d1-22eca85c0eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:57.229342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a8809-9ae1-46ab-b6d1-22eca85c0eab None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:57.229691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a8809-9ae1-46ab-b6d1-22eca85c0eab None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:57.229961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a8809-9ae1-46ab-b6d1-22eca85c0eab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:57.233385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fdd60-9305-495e-ba85-762dc06f8c50 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:57.241573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a8809-9ae1-46ab-b6d1-22eca85c0eab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-4e2a8809-9ae1-46ab-b6d1-22eca85c0eab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:57.249296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:57.250197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:57.251009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:57.251009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:57.251009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:57.251009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:57.251009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:57.251009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:57.251009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:57.251009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:57.251009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:57.251009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:57.251009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:04:57.251009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:57.251009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 260/495] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:04:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:57.251785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a8809-9ae1-46ab-b6d1-22eca85c0eab None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:57.275769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afde50-e368-4be5-bf97-f81d53eb17be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:57.276456 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afde50-e368-4be5-bf97-f81d53eb17be None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:57.276741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afde50-e368-4be5-bf97-f81d53eb17be None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:57.277019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afde50-e368-4be5-bf97-f81d53eb17be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:57.348619 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afde50-e368-4be5-bf97-f81d53eb17be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:57.350097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afde50-e368-4be5-bf97-f81d53eb17be None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:57.354752 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a8809-9ae1-46ab-b6d1-22eca85c0eab None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:57.392467 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941335c-5ae8-4b4f-a51f-e15fd479ff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:57.393266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941335c-5ae8-4b4f-a51f-e15fd479ff3c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:57.393786 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941335c-5ae8-4b4f-a51f-e15fd479ff3c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:57.393786 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941335c-5ae8-4b4f-a51f-e15fd479ff3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:57.404398 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941335c-5ae8-4b4f-a51f-e15fd479ff3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:57.405860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941335c-5ae8-4b4f-a51f-e15fd479ff3c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-f941335c-5ae8-4b4f-a51f-e15fd479ff3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:04:57.424051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:57.424936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:57.425800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:04:57.425800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:04:57.425800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:57.425800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:57.425800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 261/496] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:57.431262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e8e3-29de-4494-b799-5e6afc70ea94 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:57.431262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e8e3-29de-4494-b799-5e6afc70ea94 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:57.431262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e8e3-29de-4494-b799-5e6afc70ea94 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:57.431262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 262/497] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:57.431262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603e8e3-29de-4494-b799-5e6afc70ea94 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:57.447593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:57.449586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:57.472064 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 236/498] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:57.472064 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afde50-e368-4be5-bf97-f81d53eb17be None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:57.548159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603e8e3-29de-4494-b799-5e6afc70ea94 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:57.572601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afde50-e368-4be5-bf97-f81d53eb17be None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:57.584113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb39e6-1988-4047-bfdc-132f76505136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:57.584790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb39e6-1988-4047-bfdc-132f76505136 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:57.585075 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb39e6-1988-4047-bfdc-132f76505136 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:57.585351 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb39e6-1988-4047-bfdc-132f76505136 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:57.586096 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb39e6-1988-4047-bfdc-132f76505136 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:57.586521 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb39e6-1988-4047-bfdc-132f76505136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:57.588012 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb39e6-1988-4047-bfdc-132f76505136 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:57.601557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 263/499] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:04:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:57.601557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1df40-b0ae-4501-8bb2-c4a45e248475 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:57.601557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1df40-b0ae-4501-8bb2-c4a45e248475 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:57.601557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1df40-b0ae-4501-8bb2-c4a45e248475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:57.612689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796874a-085b-4878-8da9-7c1661e478e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:57.613297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796874a-085b-4878-8da9-7c1661e478e4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:57.613583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796874a-085b-4878-8da9-7c1661e478e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:57.613858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796874a-085b-4878-8da9-7c1661e478e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:57.614590 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796874a-085b-4878-8da9-7c1661e478e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:57.614899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796874a-085b-4878-8da9-7c1661e478e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:57.616314 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796874a-085b-4878-8da9-7c1661e478e4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:57.617512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a2c1df40-b0ae-4501-8bb2-c4a45e248475 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:57.618841 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a2c1df40-b0ae-4501-8bb2-c4a45e248475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:57.628549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 237/500] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:57.629620 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796874a-085b-4878-8da9-7c1661e478e4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:57.672099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:57.695286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 264/501] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:57.696154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1df40-b0ae-4501-8bb2-c4a45e248475 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:57.704189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:57.732377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796874a-085b-4878-8da9-7c1661e478e4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:57.765886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaab46-1a19-4835-94c4-17dcf7b19a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:57.766677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaab46-1a19-4835-94c4-17dcf7b19a68 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:57.767537 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaab46-1a19-4835-94c4-17dcf7b19a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:57.767814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaab46-1a19-4835-94c4-17dcf7b19a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:57.778151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aaab46-1a19-4835-94c4-17dcf7b19a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:57.779598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aaab46-1a19-4835-94c4-17dcf7b19a68 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:57.794864 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1df40-b0ae-4501-8bb2-c4a45e248475 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-96aaab46-1a19-4835-94c4-17dcf7b19a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:04:57.797037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:57.798062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:57.799102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:04:57.799102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:04:57.799102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:57.799102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:57.802853 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 238/502] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:57.803577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaab46-1a19-4835-94c4-17dcf7b19a68 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:57.828941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13103c6-f527-4e01-b831-e062ba8dae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:57.830269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13103c6-f527-4e01-b831-e062ba8dae74 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:57.830554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13103c6-f527-4e01-b831-e062ba8dae74 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:57.830828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13103c6-f527-4e01-b831-e062ba8dae74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:57.840905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13103c6-f527-4e01-b831-e062ba8dae74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:57.842370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13103c6-f527-4e01-b831-e062ba8dae74 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a13103c6-f527-4e01-b831-e062ba8dae74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:04:57.859919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:57.860906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:57.861777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:04:57.861777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:04:57.861777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:57.861777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:57.861777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 265/503] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:57.862486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73315905-22be-44b9-8bcc-380518acc222 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:57.862831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73315905-22be-44b9-8bcc-380518acc222 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:57.863048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73315905-22be-44b9-8bcc-380518acc222 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:57.864340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 266/504] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:04:57.865087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73315905-22be-44b9-8bcc-380518acc222 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:57.897707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:57.906651 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaab46-1a19-4835-94c4-17dcf7b19a68 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:57.923354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:57.939865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f97ea3-746d-4e2e-949e-dd88248f8e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:57.940687 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f97ea3-746d-4e2e-949e-dd88248f8e6e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:57.940966 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f97ea3-746d-4e2e-949e-dd88248f8e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:57.941232 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f97ea3-746d-4e2e-949e-dd88248f8e6e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:57.948591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f97ea3-746d-4e2e-949e-dd88248f8e6e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:57.950116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f97ea3-746d-4e2e-949e-dd88248f8e6e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:57.964209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73315905-22be-44b9-8bcc-380518acc222 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-51f97ea3-746d-4e2e-949e-dd88248f8e6e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:04:57.965583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:57.966555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:57.967475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:57.967475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:57.967475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:04:57.967475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:04:57.967475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:04:57.967475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:04:57.967475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:04:57.967475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:04:57.967475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:04:57.967475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:57.967475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 239/505] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:57.968077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f97ea3-746d-4e2e-949e-dd88248f8e6e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:58.003252 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8c8bd-d261-43d3-9f87-7aba326a0446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:58.004072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c8bd-d261-43d3-9f87-7aba326a0446 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:58.004357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c8bd-d261-43d3-9f87-7aba326a0446 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:58.004631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c8bd-d261-43d3-9f87-7aba326a0446 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:58.014631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8c8bd-d261-43d3-9f87-7aba326a0446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-91b8c8bd-d261-43d3-9f87-7aba326a0446 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:04:58.022812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:58.023697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:58.024556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:58.024556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:58.024556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:58.024556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:58.024556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:04:58.024556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:04:58.024556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:04:58.024556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:04:58.024556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:04:58.024556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:04:58.024556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:04:58.024556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:58.024556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 267/506] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:04:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:58.025232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8c8bd-d261-43d3-9f87-7aba326a0446 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:58.072235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f97ea3-746d-4e2e-949e-dd88248f8e6e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:58.104966 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11beb96-5e84-4233-b268-dc7630ff4e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:58.105633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11beb96-5e84-4233-b268-dc7630ff4e5a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:58.105916 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11beb96-5e84-4233-b268-dc7630ff4e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:58.106187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11beb96-5e84-4233-b268-dc7630ff4e5a None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:58.106909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11beb96-5e84-4233-b268-dc7630ff4e5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:58.107211 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11beb96-5e84-4233-b268-dc7630ff4e5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:58.108627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11beb96-5e84-4233-b268-dc7630ff4e5a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:58.120401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 240/507] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:58.121545 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b65656-1372-4a1b-8306-55d8567bcf1e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:58.121835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b65656-1372-4a1b-8306-55d8567bcf1e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:58.122118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b65656-1372-4a1b-8306-55d8567bcf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:58.125684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8c8bd-d261-43d3-9f87-7aba326a0446 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:58.140557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f3b65656-1372-4a1b-8306-55d8567bcf1e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:04:58.141775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f3b65656-1372-4a1b-8306-55d8567bcf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:58.143655 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:58.149771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:58.160610 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33509a-4435-4e42-9ade-c7011a0aec9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:58.161499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33509a-4435-4e42-9ade-c7011a0aec9c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:58.161780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33509a-4435-4e42-9ade-c7011a0aec9c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:58.162056 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33509a-4435-4e42-9ade-c7011a0aec9c None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:58.162770 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33509a-4435-4e42-9ade-c7011a0aec9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:58.163074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33509a-4435-4e42-9ade-c7011a0aec9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:58.164474 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33509a-4435-4e42-9ade-c7011a0aec9c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:58.176521 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 268/508] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:58.177388 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33509a-4435-4e42-9ade-c7011a0aec9c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:58.209898 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 241/509] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:04:58.211055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b65656-1372-4a1b-8306-55d8567bcf1e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:58.288105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33509a-4435-4e42-9ade-c7011a0aec9c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:58.308077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b65656-1372-4a1b-8306-55d8567bcf1e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:58.321825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b084c-94f4-44ff-8da0-398dc2f7e34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:58.322527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b084c-94f4-44ff-8da0-398dc2f7e34a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:58.322809 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b084c-94f4-44ff-8da0-398dc2f7e34a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:58.323083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b084c-94f4-44ff-8da0-398dc2f7e34a None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:58.323917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b084c-94f4-44ff-8da0-398dc2f7e34a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:58.324275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b084c-94f4-44ff-8da0-398dc2f7e34a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:58.325709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b084c-94f4-44ff-8da0-398dc2f7e34a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:58.340440 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4450e5d-4a2f-4fe7-ba2e-3b663aea6bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:58.341088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4450e5d-4a2f-4fe7-ba2e-3b663aea6bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:58.341371 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4450e5d-4a2f-4fe7-ba2e-3b663aea6bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:58.341644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4450e5d-4a2f-4fe7-ba2e-3b663aea6bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:58.342272 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 269/510] 10.222.0.74 () {56 vars in 1137 bytes} [Thu Jul 14 10:04:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:58.342403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4450e5d-4a2f-4fe7-ba2e-3b663aea6bc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:58.342689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4450e5d-4a2f-4fe7-ba2e-3b663aea6bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:58.343067 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b084c-94f4-44ff-8da0-398dc2f7e34a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:58.344098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4450e5d-4a2f-4fe7-ba2e-3b663aea6bc9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:58.354308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 242/511] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:58.355089 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4450e5d-4a2f-4fe7-ba2e-3b663aea6bc9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:58.359784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:58.382217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:58.446466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b084c-94f4-44ff-8da0-398dc2f7e34a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:58.455291 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4450e5d-4a2f-4fe7-ba2e-3b663aea6bc9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:58.480414 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714faa2f-19bf-4c53-bb03-2ebd0c6bf00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:58.481237 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714faa2f-19bf-4c53-bb03-2ebd0c6bf00b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:58.481517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714faa2f-19bf-4c53-bb03-2ebd0c6bf00b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:58.481792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714faa2f-19bf-4c53-bb03-2ebd0c6bf00b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:58.488197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a966d9-cf9c-45f5-8c4e-0160d6912504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:58.488365 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714faa2f-19bf-4c53-bb03-2ebd0c6bf00b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:58.488973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a966d9-cf9c-45f5-8c4e-0160d6912504 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:58.489250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a966d9-cf9c-45f5-8c4e-0160d6912504 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:58.489524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a966d9-cf9c-45f5-8c4e-0160d6912504 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:58.489800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714faa2f-19bf-4c53-bb03-2ebd0c6bf00b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:58.496741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a966d9-cf9c-45f5-8c4e-0160d6912504 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:58.498152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a966d9-cf9c-45f5-8c4e-0160d6912504 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-714faa2f-19bf-4c53-bb03-2ebd0c6bf00b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:04:58.503905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:58.504771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:58.505923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:04:58.505923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:04:58.505923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:04:58.505923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:04:58.505923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:04:58.505923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:04:58.505923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:04:58.505923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:58.505923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 270/512] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:58.506559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714faa2f-19bf-4c53-bb03-2ebd0c6bf00b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-d7a966d9-cf9c-45f5-8c4e-0160d6912504 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:04:58.512005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:58.512885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:58.513790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:58.513790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:58.513790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:04:58.513790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:04:58.513790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:04:58.513790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:04:58.513790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:04:58.513790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:04:58.513790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:04:58.513790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:58.513790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 243/513] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:04:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:58.514927 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a966d9-cf9c-45f5-8c4e-0160d6912504 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:58.577065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:58.603394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:58.609554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714faa2f-19bf-4c53-bb03-2ebd0c6bf00b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:58.614641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a966d9-cf9c-45f5-8c4e-0160d6912504 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:58.642716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea40cf4-06b9-42f9-90a5-a7325d09f4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:58.643441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea40cf4-06b9-42f9-90a5-a7325d09f4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:58.643723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea40cf4-06b9-42f9-90a5-a7325d09f4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:58.644124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea40cf4-06b9-42f9-90a5-a7325d09f4e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:58.650545 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f45e1e-b81d-4e9d-a88e-6851f5836d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:58.651207 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45e1e-b81d-4e9d-a88e-6851f5836d7f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:58.651475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45e1e-b81d-4e9d-a88e-6851f5836d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:58.651747 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45e1e-b81d-4e9d-a88e-6851f5836d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:58.654780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea40cf4-06b9-42f9-90a5-a7325d09f4e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:58.656282 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea40cf4-06b9-42f9-90a5-a7325d09f4e1 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-cea40cf4-06b9-42f9-90a5-a7325d09f4e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:04:58.674447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:58.675362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:58.676233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:04:58.676233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:04:58.676233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:58.676233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:58.676233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 271/514] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:58.676614 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea40cf4-06b9-42f9-90a5-a7325d09f4e1 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:58.724920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f45e1e-b81d-4e9d-a88e-6851f5836d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:58.726380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f45e1e-b81d-4e9d-a88e-6851f5836d7f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:58.774107 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea40cf4-06b9-42f9-90a5-a7325d09f4e1 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:58.785346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:58.807152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dd1ce-b763-4c27-a415-639753dbf875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:58.807947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd1ce-b763-4c27-a415-639753dbf875 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:58.808262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd1ce-b763-4c27-a415-639753dbf875 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:58.808540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd1ce-b763-4c27-a415-639753dbf875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:58.820574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1dd1ce-b763-4c27-a415-639753dbf875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:58.822034 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1dd1ce-b763-4c27-a415-639753dbf875 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:58.822846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 244/515] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:58.823671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f45e1e-b81d-4e9d-a88e-6851f5836d7f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:58.834446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-2c1dd1ce-b763-4c27-a415-639753dbf875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:04:58.843869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:58.844781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:58.845661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:04:58.845661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:04:58.845661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:58.845661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:58.845661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 272/516] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:58.845940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dd1ce-b763-4c27-a415-639753dbf875 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:58.925797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f45e1e-b81d-4e9d-a88e-6851f5836d7f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:58.943949 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dd1ce-b763-4c27-a415-639753dbf875 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:58.959428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78188f35-df6b-4622-8c29-f7a4899d9d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:58.960121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78188f35-df6b-4622-8c29-f7a4899d9d74 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:58.960430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78188f35-df6b-4622-8c29-f7a4899d9d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:58.960709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78188f35-df6b-4622-8c29-f7a4899d9d74 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:58.961486 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78188f35-df6b-4622-8c29-f7a4899d9d74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:58.961790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78188f35-df6b-4622-8c29-f7a4899d9d74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:58.963254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78188f35-df6b-4622-8c29-f7a4899d9d74 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:58.976884 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de933db2-d9b1-4f12-8045-c9ec2a65e415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:58.977543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de933db2-d9b1-4f12-8045-c9ec2a65e415 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:58.977818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de933db2-d9b1-4f12-8045-c9ec2a65e415 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:58.978084 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de933db2-d9b1-4f12-8045-c9ec2a65e415 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:58.978905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de933db2-d9b1-4f12-8045-c9ec2a65e415 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:58.979206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de933db2-d9b1-4f12-8045-c9ec2a65e415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:58.980552 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 245/517] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:04:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:58.980669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de933db2-d9b1-4f12-8045-c9ec2a65e415 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:58.981351 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78188f35-df6b-4622-8c29-f7a4899d9d74 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:58.998213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 273/518] 10.222.0.74 () {56 vars in 1137 bytes} [Thu Jul 14 10:04:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:58.999016 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de933db2-d9b1-4f12-8045-c9ec2a65e415 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:59.006085 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:59.058268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:59.082780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78188f35-df6b-4622-8c29-f7a4899d9d74 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:59.099895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de933db2-d9b1-4f12-8045-c9ec2a65e415 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:59.116249 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45e9e0-e832-431d-af2c-e31c60c61494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:59.116907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45e9e0-e832-431d-af2c-e31c60c61494 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:59.117184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45e9e0-e832-431d-af2c-e31c60c61494 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:59.117461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45e9e0-e832-431d-af2c-e31c60c61494 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:59.118224 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45e9e0-e832-431d-af2c-e31c60c61494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:59.118525 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45e9e0-e832-431d-af2c-e31c60c61494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:59.119879 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45e9e0-e832-431d-af2c-e31c60c61494 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:59.131658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 246/519] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:59.132471 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45e9e0-e832-431d-af2c-e31c60c61494 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:59.138759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de99350-1d51-42f4-ba57-e7892fcd27d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:59.139560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99350-1d51-42f4-ba57-e7892fcd27d9 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:59.139838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99350-1d51-42f4-ba57-e7892fcd27d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:59.140141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99350-1d51-42f4-ba57-e7892fcd27d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:59.150165 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de99350-1d51-42f4-ba57-e7892fcd27d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:59.151593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de99350-1d51-42f4-ba57-e7892fcd27d9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-5de99350-1d51-42f4-ba57-e7892fcd27d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:04:59.169350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:59.170206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:59.171067 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:04:59.171067 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:04:59.171067 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:59.171067 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:04:59.171067 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 274/520] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:59.171347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de99350-1d51-42f4-ba57-e7892fcd27d9 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:59.219712 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:59.238640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45e9e0-e832-431d-af2c-e31c60c61494 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:59.268065 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de99350-1d51-42f4-ba57-e7892fcd27d9 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:59.274771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee74883-437a-4b8e-a4d4-ee8b0ff2675e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:59.275434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee74883-437a-4b8e-a4d4-ee8b0ff2675e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:59.275720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee74883-437a-4b8e-a4d4-ee8b0ff2675e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:59.276011 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee74883-437a-4b8e-a4d4-ee8b0ff2675e None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:59.276742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee74883-437a-4b8e-a4d4-ee8b0ff2675e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:59.277048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee74883-437a-4b8e-a4d4-ee8b0ff2675e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:59.278412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee74883-437a-4b8e-a4d4-ee8b0ff2675e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:59.278835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:59.290360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 247/521] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:59.291163 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee74883-437a-4b8e-a4d4-ee8b0ff2675e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:59.302281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75001cd-eacf-49ea-891b-d6ec0513ccd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:59.302938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75001cd-eacf-49ea-891b-d6ec0513ccd9 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:59.303219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75001cd-eacf-49ea-891b-d6ec0513ccd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:59.303487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75001cd-eacf-49ea-891b-d6ec0513ccd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:59.304358 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75001cd-eacf-49ea-891b-d6ec0513ccd9 None admin] RBAC: Adding query filter params (role.id=feef3a85c1c0446590c2671a9f266cf4, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=2a0626754b40449ba2346d05c5c90a35) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:59.304985 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75001cd-eacf-49ea-891b-d6ec0513ccd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:59.306839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75001cd-eacf-49ea-891b-d6ec0513ccd9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:59.312177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 275/522] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:04:59 2022] GET /identity/v3/role_assignments?user.id=2a0626754b40449ba2346d05c5c90a35&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=feef3a85c1c0446590c2671a9f266cf4 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:59.312920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75001cd-eacf-49ea-891b-d6ec0513ccd9 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:59.403953 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee74883-437a-4b8e-a4d4-ee8b0ff2675e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:59.427084 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75001cd-eacf-49ea-891b-d6ec0513ccd9 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:59.443351 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851acfdc-8075-4101-bbea-9ba86f701734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:59.444048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851acfdc-8075-4101-bbea-9ba86f701734 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:59.444326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851acfdc-8075-4101-bbea-9ba86f701734 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:59.444602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851acfdc-8075-4101-bbea-9ba86f701734 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:59.461017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:59.467873 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750015d8-b24c-403b-8a54-aa354690c0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:59.468593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750015d8-b24c-403b-8a54-aa354690c0cf None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:59.468877 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750015d8-b24c-403b-8a54-aa354690c0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:59.469162 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750015d8-b24c-403b-8a54-aa354690c0cf None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:59.470463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750015d8-b24c-403b-8a54-aa354690c0cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:59.471928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750015d8-b24c-403b-8a54-aa354690c0cf None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:59.516188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851acfdc-8075-4101-bbea-9ba86f701734 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:59.518141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851acfdc-8075-4101-bbea-9ba86f701734 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:59.556783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 276/523] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:04:59 2022] POST /identity/v3/users => generated 247 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:04:59.557848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750015d8-b24c-403b-8a54-aa354690c0cf None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:59.603542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:59.654634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 248/524] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:04:59.656206 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851acfdc-8075-4101-bbea-9ba86f701734 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:59.694541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750015d8-b24c-403b-8a54-aa354690c0cf None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:59.718721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:59.737434 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b1c4c-09d2-4dda-aea9-d6e892bde07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:59.738046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b1c4c-09d2-4dda-aea9-d6e892bde07b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:59.738332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b1c4c-09d2-4dda-aea9-d6e892bde07b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:59.738616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b1c4c-09d2-4dda-aea9-d6e892bde07b None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:59.739353 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b1c4c-09d2-4dda-aea9-d6e892bde07b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:04:59.739662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b1c4c-09d2-4dda-aea9-d6e892bde07b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:59.741100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b1c4c-09d2-4dda-aea9-d6e892bde07b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:59.757508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 277/525] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:04:59.758372 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b1c4c-09d2-4dda-aea9-d6e892bde07b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:59.793205 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851acfdc-8075-4101-bbea-9ba86f701734 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:59.838932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4eb4f-cc68-441e-bf41-215c489241dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:59.838932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4eb4f-cc68-441e-bf41-215c489241dd None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:59.839929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4eb4f-cc68-441e-bf41-215c489241dd None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:59.839929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4eb4f-cc68-441e-bf41-215c489241dd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:59.848809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4eb4f-cc68-441e-bf41-215c489241dd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:59.850261 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4eb4f-cc68-441e-bf41-215c489241dd None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-ace4eb4f-cc68-441e-bf41-215c489241dd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:04:59.871678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:59.872674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:59.873653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:59.873653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:59.873653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:04:59.873653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:04:59.873653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:04:59.873653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:04:59.873653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:04:59.873653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:04:59.873653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:04:59.873653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:04:59.876296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 249/526] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:04:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:04:59.877263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4eb4f-cc68-441e-bf41-215c489241dd None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:59.887929 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:59.903716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b1c4c-09d2-4dda-aea9-d6e892bde07b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:59.952123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae00f-a70a-4db7-bc2d-f42d5df84834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:59.953401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae00f-a70a-4db7-bc2d-f42d5df84834 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:59.953827 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae00f-a70a-4db7-bc2d-f42d5df84834 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:59.954772 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae00f-a70a-4db7-bc2d-f42d5df84834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:59.968832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ae00f-a70a-4db7-bc2d-f42d5df84834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:59.971840 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ae00f-a70a-4db7-bc2d-f42d5df84834 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:59.994612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4eb4f-cc68-441e-bf41-215c489241dd None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-8d6ae00f-a70a-4db7-bc2d-f42d5df84834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:04:59.996452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:04:59.997488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:04:59.998563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:04:59.998563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:04:59.998563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:04:59.998563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:00.000125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:00.002726 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 278/527] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:00.003721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae00f-a70a-4db7-bc2d-f42d5df84834 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:00.048805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178258a-8348-4bb2-8e5d-545b903c67b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:00.049850 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178258a-8348-4bb2-8e5d-545b903c67b0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:00.050298 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178258a-8348-4bb2-8e5d-545b903c67b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:00.050711 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178258a-8348-4bb2-8e5d-545b903c67b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:00.064104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178258a-8348-4bb2-8e5d-545b903c67b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:00.066232 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178258a-8348-4bb2-8e5d-545b903c67b0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-e178258a-8348-4bb2-8e5d-545b903c67b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:00.086843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:00.087947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:00.089054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:00.089054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:00.089054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:00.089054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:00.089054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:00.089054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:00.089054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:00.089054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:00.092300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 250/528] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:04:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:00.093232 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178258a-8348-4bb2-8e5d-545b903c67b0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:00.132671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae00f-a70a-4db7-bc2d-f42d5df84834 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:00.171136 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f4f98-1d11-45db-be79-7cee531619b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:00.171825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4f98-1d11-45db-be79-7cee531619b4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:00.172141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4f98-1d11-45db-be79-7cee531619b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:00.172421 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4f98-1d11-45db-be79-7cee531619b4 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:00.173299 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f4f98-1d11-45db-be79-7cee531619b4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:00.173610 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f4f98-1d11-45db-be79-7cee531619b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:00.175468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f4f98-1d11-45db-be79-7cee531619b4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:00.189369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:00.193883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 279/529] 10.222.0.74 () {56 vars in 1139 bytes} [Thu Jul 14 10:05:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:00.194606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f4f98-1d11-45db-be79-7cee531619b4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:00.211771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178258a-8348-4bb2-8e5d-545b903c67b0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:00.248157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30508d03-f04c-4284-b463-4eeb900ab8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:00.249261 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30508d03-f04c-4284-b463-4eeb900ab8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:00.249754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30508d03-f04c-4284-b463-4eeb900ab8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:00.250225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30508d03-f04c-4284-b463-4eeb900ab8f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:00.251687 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30508d03-f04c-4284-b463-4eeb900ab8f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:00.252226 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30508d03-f04c-4284-b463-4eeb900ab8f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:00.253774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30508d03-f04c-4284-b463-4eeb900ab8f0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:00.266037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 251/530] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:00.267672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30508d03-f04c-4284-b463-4eeb900ab8f0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:00.293325 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:00.300173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f4f98-1d11-45db-be79-7cee531619b4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:00.336829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cad144-0448-4f0a-a4df-0bd32b798cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:00.337506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cad144-0448-4f0a-a4df-0bd32b798cbd None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:00.337802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cad144-0448-4f0a-a4df-0bd32b798cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:00.338445 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cad144-0448-4f0a-a4df-0bd32b798cbd None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:00.338854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cad144-0448-4f0a-a4df-0bd32b798cbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:00.339161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cad144-0448-4f0a-a4df-0bd32b798cbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:00.340648 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cad144-0448-4f0a-a4df-0bd32b798cbd None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:00.359636 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 280/531] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:00.361184 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cad144-0448-4f0a-a4df-0bd32b798cbd None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:00.374168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30508d03-f04c-4284-b463-4eeb900ab8f0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:00.409613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fd6f4-e5ca-4029-91f3-d31140bd8a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:00.410599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fd6f4-e5ca-4029-91f3-d31140bd8a2e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:00.411322 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fd6f4-e5ca-4029-91f3-d31140bd8a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:00.411811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fd6f4-e5ca-4029-91f3-d31140bd8a2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:00.424654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:00.471231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cad144-0448-4f0a-a4df-0bd32b798cbd None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:00.512450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fd6f4-e5ca-4029-91f3-d31140bd8a2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:00.513847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fd6f4-e5ca-4029-91f3-d31140bd8a2e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:00.519652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89b444-f41c-4dbc-95ac-d594a18f2c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:00.520759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b444-f41c-4dbc-95ac-d594a18f2c3f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:00.521251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b444-f41c-4dbc-95ac-d594a18f2c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:00.521806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b444-f41c-4dbc-95ac-d594a18f2c3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:00.532147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89b444-f41c-4dbc-95ac-d594a18f2c3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:00.534592 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89b444-f41c-4dbc-95ac-d594a18f2c3f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:00.540902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-fa89b444-f41c-4dbc-95ac-d594a18f2c3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:00.554791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:00.555869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:00.556804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:00.556804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:00.556804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:00.556804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:00.556804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:00.556804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:00.556804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:00.556804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:00.560133 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 281/532] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:00.561115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89b444-f41c-4dbc-95ac-d594a18f2c3f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:00.630569 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 252/533] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:05:00.632158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fd6f4-e5ca-4029-91f3-d31140bd8a2e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:00.698126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89b444-f41c-4dbc-95ac-d594a18f2c3f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:00.720503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:00.743617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f720c9-69e0-4623-b04a-a6ff4672284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:00.744313 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f720c9-69e0-4623-b04a-a6ff4672284f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:00.744598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f720c9-69e0-4623-b04a-a6ff4672284f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:00.744875 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f720c9-69e0-4623-b04a-a6ff4672284f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:00.745710 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f720c9-69e0-4623-b04a-a6ff4672284f None admin] RBAC: Adding query filter params (role.id=feef3a85c1c0446590c2671a9f266cf4, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=12abc4b2a8d348d992e0bb00a1218929) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:00.746021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f720c9-69e0-4623-b04a-a6ff4672284f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:00.747468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f720c9-69e0-4623-b04a-a6ff4672284f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:00.753914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 282/534] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:00 2022] GET /identity/v3/role_assignments?user.id=12abc4b2a8d348d992e0bb00a1218929&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=feef3a85c1c0446590c2671a9f266cf4 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:00.754502 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f720c9-69e0-4623-b04a-a6ff4672284f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:00.762790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fd6f4-e5ca-4029-91f3-d31140bd8a2e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:00.795250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:00.809900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd72af0-c800-4aae-aa72-9a2b5677179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:00.810936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72af0-c800-4aae-aa72-9a2b5677179f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:00.811394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72af0-c800-4aae-aa72-9a2b5677179f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:00.814393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72af0-c800-4aae-aa72-9a2b5677179f None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:00.814393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd72af0-c800-4aae-aa72-9a2b5677179f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:00.814393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd72af0-c800-4aae-aa72-9a2b5677179f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:00.816301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd72af0-c800-4aae-aa72-9a2b5677179f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:00.834022 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 253/535] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:00.840920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd72af0-c800-4aae-aa72-9a2b5677179f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:00.956093 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f720c9-69e0-4623-b04a-a6ff4672284f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:00.980021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd72af0-c800-4aae-aa72-9a2b5677179f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:00.993193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e2d2-8f43-46b5-b4a5-c4759cec3b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:00.994219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e2d2-8f43-46b5-b4a5-c4759cec3b2c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:00.994345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e2d2-8f43-46b5-b4a5-c4759cec3b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:00.994577 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e2d2-8f43-46b5-b4a5-c4759cec3b2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:01.005680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2e2d2-8f43-46b5-b4a5-c4759cec3b2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:01.007180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2e2d2-8f43-46b5-b4a5-c4759cec3b2c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-38a2e2d2-8f43-46b5-b4a5-c4759cec3b2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:01.024928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:01.025901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:01.026798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:01.026798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:01.026798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:01.026798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:01.026798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 283/536] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:01.027872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d70ee-3ca6-4764-8d02-20238b3e87ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:01.028808 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d70ee-3ca6-4764-8d02-20238b3e87ca None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:01.029290 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d70ee-3ca6-4764-8d02-20238b3e87ca None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:01.029761 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d70ee-3ca6-4764-8d02-20238b3e87ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:01.030885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d70ee-3ca6-4764-8d02-20238b3e87ca None admin] RBAC: Adding query filter params (role.id=feef3a85c1c0446590c2671a9f266cf4, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=397a66eb12254a65bf05bc9fff9a868e) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:01.031405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d70ee-3ca6-4764-8d02-20238b3e87ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:01.031639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e2d2-8f43-46b5-b4a5-c4759cec3b2c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:01.033938 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d70ee-3ca6-4764-8d02-20238b3e87ca None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:01.042673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 254/537] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:00 2022] GET /identity/v3/role_assignments?user.id=397a66eb12254a65bf05bc9fff9a868e&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=feef3a85c1c0446590c2671a9f266cf4 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:01.084984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:01.169688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e2d2-8f43-46b5-b4a5-c4759cec3b2c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:01.216826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a31f5f-844b-4b76-ac9f-1bff2635a486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:01.217868 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a31f5f-844b-4b76-ac9f-1bff2635a486 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:01.218357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a31f5f-844b-4b76-ac9f-1bff2635a486 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:01.218836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a31f5f-844b-4b76-ac9f-1bff2635a486 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:01.219767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a31f5f-844b-4b76-ac9f-1bff2635a486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:01.220344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a31f5f-844b-4b76-ac9f-1bff2635a486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:01.221938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a31f5f-844b-4b76-ac9f-1bff2635a486 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:01.239612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 284/538] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:01.244826 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d70ee-3ca6-4764-8d02-20238b3e87ca None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:01.298864 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:01.368441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d70ee-3ca6-4764-8d02-20238b3e87ca None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:01.409919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff7034-7448-45e2-987f-ee9f4492a440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:01.411356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7034-7448-45e2-987f-ee9f4492a440 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:01.411857 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7034-7448-45e2-987f-ee9f4492a440 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:01.412374 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7034-7448-45e2-987f-ee9f4492a440 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:01.419565 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff7034-7448-45e2-987f-ee9f4492a440 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:01.421312 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff7034-7448-45e2-987f-ee9f4492a440 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-feff7034-7448-45e2-987f-ee9f4492a440 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:01.444442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:01.445370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:01.446239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:01.446239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:01.446239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:01.446239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:01.446239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:01.446239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:01.446239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:01.446239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:01.448745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 255/539] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:01.457104 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a31f5f-844b-4b76-ac9f-1bff2635a486 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:01.538089 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bbf75-b9df-46b5-b25d-addac9e5e7ea None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:01.538742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bbf75-b9df-46b5-b25d-addac9e5e7ea None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:01.539245 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bbf75-b9df-46b5-b25d-addac9e5e7ea None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:01.541083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 256/540] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:01.546478 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489947e-48cb-449a-869f-84f9de544ef0 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:01.547008 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489947e-48cb-449a-869f-84f9de544ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:01.547492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489947e-48cb-449a-869f-84f9de544ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:01.580402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2489947e-48cb-449a-869f-84f9de544ef0 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:01.580402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2489947e-48cb-449a-869f-84f9de544ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:01.590345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:01.596725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a31f5f-844b-4b76-ac9f-1bff2635a486 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:01.636622 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da92c3-d11f-4b86-a31e-557af4553a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:01.637687 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da92c3-d11f-4b86-a31e-557af4553a42 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:01.638177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da92c3-d11f-4b86-a31e-557af4553a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:01.638703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da92c3-d11f-4b86-a31e-557af4553a42 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:01.639692 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da92c3-d11f-4b86-a31e-557af4553a42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:01.640234 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da92c3-d11f-4b86-a31e-557af4553a42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:01.642625 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da92c3-d11f-4b86-a31e-557af4553a42 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:01.655544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 285/541] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:01.661762 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da92c3-d11f-4b86-a31e-557af4553a42 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:01.683647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 257/542] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:05:01.707609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489947e-48cb-449a-869f-84f9de544ef0 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:01.772341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:01.835824 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489947e-48cb-449a-869f-84f9de544ef0 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:01.875034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e415686-c036-4179-ab75-19156cf4f6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:01.875840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e415686-c036-4179-ab75-19156cf4f6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:01.876692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e415686-c036-4179-ab75-19156cf4f6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:01.876966 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e415686-c036-4179-ab75-19156cf4f6e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:01.888040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e415686-c036-4179-ab75-19156cf4f6e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-7e415686-c036-4179-ab75-19156cf4f6e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:01.899678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:01.900653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:01.901450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:01.901450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:01.901450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:01.901450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:01.901450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:01.901450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:01.901450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:01.901450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:01.901450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:01.901450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:01.901450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:01.901450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:01.902065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 258/543] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:01.908441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e415686-c036-4179-ab75-19156cf4f6e7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:01.938317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da92c3-d11f-4b86-a31e-557af4553a42 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:01.997302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f5310-86fb-44ae-80fb-01735e7dc6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:01.998319 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f5310-86fb-44ae-80fb-01735e7dc6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:01.998808 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f5310-86fb-44ae-80fb-01735e7dc6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:01.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f5310-86fb-44ae-80fb-01735e7dc6e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:02.000651 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f5310-86fb-44ae-80fb-01735e7dc6e2 None admin] RBAC: Adding query filter params (role.id=feef3a85c1c0446590c2671a9f266cf4, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=bf41e7a4968e4ab9bce98f6e1c050b4c) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:02.001631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f5310-86fb-44ae-80fb-01735e7dc6e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:02.003213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f5310-86fb-44ae-80fb-01735e7dc6e2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:02.016050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 286/544] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:01 2022] GET /identity/v3/role_assignments?user.id=bf41e7a4968e4ab9bce98f6e1c050b4c&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=feef3a85c1c0446590c2671a9f266cf4 => generated 259 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:02.016050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e0f21-99a7-46a0-9c77-3677014decb1 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:02.016050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e0f21-99a7-46a0-9c77-3677014decb1 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:02.016050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e0f21-99a7-46a0-9c77-3677014decb1 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:02.016050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 287/545] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:02.035364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50ff3c-548a-42a3-a799-1dc491e56658 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:02.036285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50ff3c-548a-42a3-a799-1dc491e56658 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:02.036798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50ff3c-548a-42a3-a799-1dc491e56658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:02.061788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-aa50ff3c-548a-42a3-a799-1dc491e56658 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:02.064879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-aa50ff3c-548a-42a3-a799-1dc491e56658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:02.072874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:02.082742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e415686-c036-4179-ab75-19156cf4f6e7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:02.101895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:02.141512 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2afab-9557-4b32-b17b-76e22863bd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:02.143096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2afab-9557-4b32-b17b-76e22863bd9a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:02.143426 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2afab-9557-4b32-b17b-76e22863bd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:02.143709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2afab-9557-4b32-b17b-76e22863bd9a None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:02.149586 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2afab-9557-4b32-b17b-76e22863bd9a None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:02.149911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2afab-9557-4b32-b17b-76e22863bd9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:02.151353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2afab-9557-4b32-b17b-76e22863bd9a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:02.168248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 259/546] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:05:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:02.175729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2afab-9557-4b32-b17b-76e22863bd9a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:02.202994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 288/547] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:05:02.225466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50ff3c-548a-42a3-a799-1dc491e56658 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:02.294414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2afab-9557-4b32-b17b-76e22863bd9a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:02.331634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2ebc2-2702-4c2a-9f8f-45521fc50ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:02.332471 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2ebc2-2702-4c2a-9f8f-45521fc50ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:02.332875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2ebc2-2702-4c2a-9f8f-45521fc50ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:02.333156 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2ebc2-2702-4c2a-9f8f-45521fc50ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:02.344417 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2ebc2-2702-4c2a-9f8f-45521fc50ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:02.346030 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2ebc2-2702-4c2a-9f8f-45521fc50ea7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-63d2ebc2-2702-4c2a-9f8f-45521fc50ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:02.364617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:02.365593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:02.366457 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:02.366457 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:02.366457 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:02.366457 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:02.366457 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 260/548] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:02.371578 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2ebc2-2702-4c2a-9f8f-45521fc50ea7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:02.404376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:02.445534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50ff3c-548a-42a3-a799-1dc491e56658 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:02.486038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512b6b5-dd00-4ad9-a394-7b065513e63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:02.486852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512b6b5-dd00-4ad9-a394-7b065513e63e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:02.487135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512b6b5-dd00-4ad9-a394-7b065513e63e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:02.487411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512b6b5-dd00-4ad9-a394-7b065513e63e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:02.499283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512b6b5-dd00-4ad9-a394-7b065513e63e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-1512b6b5-dd00-4ad9-a394-7b065513e63e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:02.508534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:02.509609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:02.510418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:02.510418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:02.510418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:02.510418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:02.510418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:02.510418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:02.510418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:02.510418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:02.510418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:02.510418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:02.510418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:02.510418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:02.511052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 289/549] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:02.518025 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512b6b5-dd00-4ad9-a394-7b065513e63e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:02.543145 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:02.583574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2ebc2-2702-4c2a-9f8f-45521fc50ea7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:02.622188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a108478-88f9-4ba7-819e-dc022241540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:02.623069 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a108478-88f9-4ba7-819e-dc022241540b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:02.623383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a108478-88f9-4ba7-819e-dc022241540b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:02.623662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a108478-88f9-4ba7-819e-dc022241540b None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:02.624458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a108478-88f9-4ba7-819e-dc022241540b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:02.624768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a108478-88f9-4ba7-819e-dc022241540b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:02.626703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a108478-88f9-4ba7-819e-dc022241540b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:02.641740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 261/550] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:02.647861 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a108478-88f9-4ba7-819e-dc022241540b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:02.753975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512b6b5-dd00-4ad9-a394-7b065513e63e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:02.776446 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:02.780566 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a108478-88f9-4ba7-819e-dc022241540b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:02.818744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3644f-5819-488d-b8c7-905c2d161485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:02.819817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3644f-5819-488d-b8c7-905c2d161485 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:02.820139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3644f-5819-488d-b8c7-905c2d161485 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:02.820581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3644f-5819-488d-b8c7-905c2d161485 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:02.829089 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3644f-5819-488d-b8c7-905c2d161485 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:02.831117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3644f-5819-488d-b8c7-905c2d161485 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-71b3644f-5819-488d-b8c7-905c2d161485 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:02.847203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:02.848274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:02.849210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:02.849210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:02.849210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:02.849210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:02.849210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:02.849210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:02.849210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:02.849210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:02.849210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:05:02.849210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:02.849210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 262/551] 10.222.0.74 () {56 vars in 1093 bytes} [Thu Jul 14 10:05:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:02.855575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3644f-5819-488d-b8c7-905c2d161485 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:02.856704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cb75f-12f9-4818-9d20-cb451d9021e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:02.857388 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cb75f-12f9-4818-9d20-cb451d9021e8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:02.857667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cb75f-12f9-4818-9d20-cb451d9021e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:02.857941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cb75f-12f9-4818-9d20-cb451d9021e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:02.858798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cb75f-12f9-4818-9d20-cb451d9021e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:02.859204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cb75f-12f9-4818-9d20-cb451d9021e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:02.861141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cb75f-12f9-4818-9d20-cb451d9021e8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:02.880110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 290/552] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:05:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:02.885842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cb75f-12f9-4818-9d20-cb451d9021e8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:02.968639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3644f-5819-488d-b8c7-905c2d161485 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:03.007037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fee074-126c-4cdd-a261-e0f725eda78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:03.007846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fee074-126c-4cdd-a261-e0f725eda78f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:03.008182 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fee074-126c-4cdd-a261-e0f725eda78f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:03.008463 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fee074-126c-4cdd-a261-e0f725eda78f None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:03.009303 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fee074-126c-4cdd-a261-e0f725eda78f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:03.009615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fee074-126c-4cdd-a261-e0f725eda78f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:03.016018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fee074-126c-4cdd-a261-e0f725eda78f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:03.028016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:03.058004 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 263/553] 10.222.0.74 () {56 vars in 1133 bytes} [Thu Jul 14 10:05:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:03.069142 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fee074-126c-4cdd-a261-e0f725eda78f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:03.104713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:03.174192 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cb75f-12f9-4818-9d20-cb451d9021e8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:03.219225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fee074-126c-4cdd-a261-e0f725eda78f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:03.248418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e15cf-013c-4dd8-b0ed-4fd142656299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:03.249223 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e15cf-013c-4dd8-b0ed-4fd142656299 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:03.249503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e15cf-013c-4dd8-b0ed-4fd142656299 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:03.249774 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e15cf-013c-4dd8-b0ed-4fd142656299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:03.269911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a2332-e9e6-438d-91d4-5ebeb68e0d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:03.271215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a2332-e9e6-438d-91d4-5ebeb68e0d5e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:03.271673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a2332-e9e6-438d-91d4-5ebeb68e0d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:03.271975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a2332-e9e6-438d-91d4-5ebeb68e0d5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:03.275685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e15cf-013c-4dd8-b0ed-4fd142656299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:03.277281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e15cf-013c-4dd8-b0ed-4fd142656299 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:03.290677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a2332-e9e6-438d-91d4-5ebeb68e0d5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:03.292744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a2332-e9e6-438d-91d4-5ebeb68e0d5e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-486e15cf-013c-4dd8-b0ed-4fd142656299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:03.303852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:03.304801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:03.306106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:03.306106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:03.306106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:03.306106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:03.306106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 291/554] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:03.306568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea019f-05d2-4e73-b5c6-af7c885e399a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:03.306568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea019f-05d2-4e73-b5c6-af7c885e399a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:03.306897 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea019f-05d2-4e73-b5c6-af7c885e399a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:03.308357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 292/555] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:03.310553 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea019f-05d2-4e73-b5c6-af7c885e399a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-9b6a2332-e9e6-438d-91d4-5ebeb68e0d5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:03.319622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:03.320699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:03.322359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:03.322359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:03.322359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:03.322359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:03.322359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 264/556] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:03.324703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9f0ca-5844-4ccb-90f9-9a1369fbc31b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:03.324703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9f0ca-5844-4ccb-90f9-9a1369fbc31b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:03.324703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9f0ca-5844-4ccb-90f9-9a1369fbc31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:03.349025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-14f9f0ca-5844-4ccb-90f9-9a1369fbc31b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:03.350219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-14f9f0ca-5844-4ccb-90f9-9a1369fbc31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:03.394725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:03.425823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea019f-05d2-4e73-b5c6-af7c885e399a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:03.436835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 265/557] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:05:03.438148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9f0ca-5844-4ccb-90f9-9a1369fbc31b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:03.452620 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:03.464858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825ff9f-9719-40ba-8841-7be43bd4ed46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:03.465631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825ff9f-9719-40ba-8841-7be43bd4ed46 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:03.467286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825ff9f-9719-40ba-8841-7be43bd4ed46 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:03.467286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825ff9f-9719-40ba-8841-7be43bd4ed46 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:03.467286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825ff9f-9719-40ba-8841-7be43bd4ed46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:03.467286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825ff9f-9719-40ba-8841-7be43bd4ed46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:03.468847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825ff9f-9719-40ba-8841-7be43bd4ed46 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:03.481624 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 293/558] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:03.482482 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825ff9f-9719-40ba-8841-7be43bd4ed46 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:03.562356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9f0ca-5844-4ccb-90f9-9a1369fbc31b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:03.593596 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825ff9f-9719-40ba-8841-7be43bd4ed46 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:03.603288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e88d2-a28b-4186-9fab-f53e83c4a8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:03.603960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e88d2-a28b-4186-9fab-f53e83c4a8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:03.604267 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e88d2-a28b-4186-9fab-f53e83c4a8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:03.604540 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e88d2-a28b-4186-9fab-f53e83c4a8f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:03.605581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e88d2-a28b-4186-9fab-f53e83c4a8f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:03.605888 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e88d2-a28b-4186-9fab-f53e83c4a8f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:03.607265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e88d2-a28b-4186-9fab-f53e83c4a8f5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:03.620041 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 266/559] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:03.620041 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e88d2-a28b-4186-9fab-f53e83c4a8f5 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:03.634758 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e297a0-c16e-4b07-8d31-a01cbf3d34b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:03.635606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e297a0-c16e-4b07-8d31-a01cbf3d34b7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:03.635878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e297a0-c16e-4b07-8d31-a01cbf3d34b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:03.636181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e297a0-c16e-4b07-8d31-a01cbf3d34b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:03.646864 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e297a0-c16e-4b07-8d31-a01cbf3d34b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:03.653269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-64e297a0-c16e-4b07-8d31-a01cbf3d34b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:03.654666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:03.655630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:03.656508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:03.656508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:03.656508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:03.656508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:03.656508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:03.656508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:03.656508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:03.656508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:03.656508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:03.656508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:03.656508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:03.656508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:03.656508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 294/560] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:03.657615 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a04d9b-0b35-4b1c-b9ab-7b7299082b41 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:03.657919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a04d9b-0b35-4b1c-b9ab-7b7299082b41 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:03.658188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a04d9b-0b35-4b1c-b9ab-7b7299082b41 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:03.659668 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 295/561] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:03.660138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a04d9b-0b35-4b1c-b9ab-7b7299082b41 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:03.716513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:03.737818 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e88d2-a28b-4186-9fab-f53e83c4a8f5 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:03.775342 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c8d97-a5a6-4bd6-b116-0c1cc12b0eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:03.776188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8d97-a5a6-4bd6-b116-0c1cc12b0eec None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:03.776477 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8d97-a5a6-4bd6-b116-0c1cc12b0eec None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:03.777017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8d97-a5a6-4bd6-b116-0c1cc12b0eec None admin] PATH_INFO: `/v3/users/swift` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:03.777197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a04d9b-0b35-4b1c-b9ab-7b7299082b41 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:03.784609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c8d97-a5a6-4bd6-b116-0c1cc12b0eec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:03.786326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c8d97-a5a6-4bd6-b116-0c1cc12b0eec None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-2f2c8d97-a5a6-4bd6-b116-0c1cc12b0eec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:03.800929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:03.802005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:03.802986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:03.802986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:03.802986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:03.802986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:03.802986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:03.802986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:03.802986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:03.802986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:03.802986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:05:03.802986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:03.802986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 267/562] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:05:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:03.803624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957b632-3ba7-48ff-91ad-adf02d7d180b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:03.803702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957b632-3ba7-48ff-91ad-adf02d7d180b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:03.803916 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957b632-3ba7-48ff-91ad-adf02d7d180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:03.820180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a84fa-66b2-45ec-8287-0776cc370ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:03.821113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a84fa-66b2-45ec-8287-0776cc370ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:03.821429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a84fa-66b2-45ec-8287-0776cc370ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:03.821779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a84fa-66b2-45ec-8287-0776cc370ee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:03.821987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6957b632-3ba7-48ff-91ad-adf02d7d180b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:03.823189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6957b632-3ba7-48ff-91ad-adf02d7d180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:03.829147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a84fa-66b2-45ec-8287-0776cc370ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:03.830686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a84fa-66b2-45ec-8287-0776cc370ee8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-331a84fa-66b2-45ec-8287-0776cc370ee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:03.845051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:03.845959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:03.846870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:03.846870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:03.846870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:03.846870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:03.846870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:03.846870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:03.846870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:03.846870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:03.851070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 296/563] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:03.851895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a84fa-66b2-45ec-8287-0776cc370ee8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:03.899319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 268/564] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:05:03.900211 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957b632-3ba7-48ff-91ad-adf02d7d180b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:03.925234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:03.969525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a84fa-66b2-45ec-8287-0776cc370ee8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:03.972820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:04.005064 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397af6ed-ac6b-4342-8838-336da78339f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:04.005742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af6ed-ac6b-4342-8838-336da78339f2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:04.006032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af6ed-ac6b-4342-8838-336da78339f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:04.006311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af6ed-ac6b-4342-8838-336da78339f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:04.007059 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397af6ed-ac6b-4342-8838-336da78339f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:04.007366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397af6ed-ac6b-4342-8838-336da78339f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:04.008771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397af6ed-ac6b-4342-8838-336da78339f2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:04.009656 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957b632-3ba7-48ff-91ad-adf02d7d180b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:04.022834 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 297/565] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:05:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:04.022834 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397af6ed-ac6b-4342-8838-336da78339f2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:04.046769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7d0b3-52f5-4bd8-bdd9-6e7c60f0474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:04.047445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7d0b3-52f5-4bd8-bdd9-6e7c60f0474f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:04.047730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7d0b3-52f5-4bd8-bdd9-6e7c60f0474f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:04.048584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7d0b3-52f5-4bd8-bdd9-6e7c60f0474f None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:04.049437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7d0b3-52f5-4bd8-bdd9-6e7c60f0474f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:04.049745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7d0b3-52f5-4bd8-bdd9-6e7c60f0474f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:04.051181 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7d0b3-52f5-4bd8-bdd9-6e7c60f0474f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:04.069581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 269/566] 10.222.0.74 () {56 vars in 1135 bytes} [Thu Jul 14 10:05:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:04.070415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7d0b3-52f5-4bd8-bdd9-6e7c60f0474f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:04.145964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397af6ed-ac6b-4342-8838-336da78339f2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:04.156420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:04.175790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7d0b3-52f5-4bd8-bdd9-6e7c60f0474f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:04.182468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f029-a2b8-4a16-b139-10bf5862d3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:04.183136 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f029-a2b8-4a16-b139-10bf5862d3cb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:04.183536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f029-a2b8-4a16-b139-10bf5862d3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:04.183719 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f029-a2b8-4a16-b139-10bf5862d3cb None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:04.184500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974f029-a2b8-4a16-b139-10bf5862d3cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:04.184862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974f029-a2b8-4a16-b139-10bf5862d3cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:04.186317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974f029-a2b8-4a16-b139-10bf5862d3cb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:04.199212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 298/567] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:04.199920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f029-a2b8-4a16-b139-10bf5862d3cb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:04.217504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ca573-7bc6-4934-8358-30d981d3b770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:04.218314 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ca573-7bc6-4934-8358-30d981d3b770 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:04.218599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ca573-7bc6-4934-8358-30d981d3b770 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:04.218873 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ca573-7bc6-4934-8358-30d981d3b770 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:04.228629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:04.229251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ca573-7bc6-4934-8358-30d981d3b770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-705ca573-7bc6-4934-8358-30d981d3b770 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:04.237019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:04.238068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:04.238942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:04.238942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:04.238942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:04.238942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:04.238942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:04.238942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:04.238942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:04.238942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:04.238942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:04.238942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:04.238942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:04.238942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:04.243026 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 270/568] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:04.244632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ca573-7bc6-4934-8358-30d981d3b770 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:04.303638 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f029-a2b8-4a16-b139-10bf5862d3cb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:04.338083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756a1f3-6ec6-4c4f-8a59-5bcd82529e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:04.338883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756a1f3-6ec6-4c4f-8a59-5bcd82529e51 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:04.339167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756a1f3-6ec6-4c4f-8a59-5bcd82529e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:04.339450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756a1f3-6ec6-4c4f-8a59-5bcd82529e51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:04.343913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ca573-7bc6-4934-8358-30d981d3b770 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:04.349606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756a1f3-6ec6-4c4f-8a59-5bcd82529e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:04.351056 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756a1f3-6ec6-4c4f-8a59-5bcd82529e51 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-2756a1f3-6ec6-4c4f-8a59-5bcd82529e51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:04.368478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:04.369440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:04.370336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:04.370336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:04.370336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:04.370336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:04.370336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 299/569] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:04.370625 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756a1f3-6ec6-4c4f-8a59-5bcd82529e51 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:04.381140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cf311-ad02-496a-a79a-1ce7c8cef968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:04.381786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cf311-ad02-496a-a79a-1ce7c8cef968 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:04.382066 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cf311-ad02-496a-a79a-1ce7c8cef968 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:04.382347 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cf311-ad02-496a-a79a-1ce7c8cef968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:04.392664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:04.448400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445cf311-ad02-496a-a79a-1ce7c8cef968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:04.449616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:04.449865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445cf311-ad02-496a-a79a-1ce7c8cef968 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:04.470589 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756a1f3-6ec6-4c4f-8a59-5bcd82529e51 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:04.505290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b845f-6400-4bea-8db5-f32f7e1eb187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:04.506108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b845f-6400-4bea-8db5-f32f7e1eb187 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:04.506391 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b845f-6400-4bea-8db5-f32f7e1eb187 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:04.506662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b845f-6400-4bea-8db5-f32f7e1eb187 None admin] PATH_INFO: `/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/2a0626754b40449ba2346d05c5c90a35/roles/feef3a85c1c0446590c2671a9f266cf4` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:04.521670 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b845f-6400-4bea-8db5-f32f7e1eb187 None admin] RBAC: Authorizing `identity:create_grant(project_id=795b6593e7b74eeda9929aba07cbaa0e, user_id=2a0626754b40449ba2346d05c5c90a35, role_id=feef3a85c1c0446590c2671a9f266cf4)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:04.523102 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b845f-6400-4bea-8db5-f32f7e1eb187 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:04.549719 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 271/570] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:05:04.550584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cf311-ad02-496a-a79a-1ce7c8cef968 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:04.585080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 300/571] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:05:04 2022] PUT /identity/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/2a0626754b40449ba2346d05c5c90a35/roles/feef3a85c1c0446590c2671a9f266cf4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:05:04.586360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189618c-df1c-461f-8923-7d36a715ca79 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:04.586649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189618c-df1c-461f-8923-7d36a715ca79 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:04.586922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189618c-df1c-461f-8923-7d36a715ca79 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:04.588236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 301/572] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:04.592186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189618c-df1c-461f-8923-7d36a715ca79 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:04.604672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:04.688134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cf311-ad02-496a-a79a-1ce7c8cef968 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:04.727156 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc4486-3827-40f6-a23e-00c33d14b686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:04.728173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4486-3827-40f6-a23e-00c33d14b686 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:04.728611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4486-3827-40f6-a23e-00c33d14b686 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:04.729037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4486-3827-40f6-a23e-00c33d14b686 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:04.729152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189618c-df1c-461f-8923-7d36a715ca79 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:04.730049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc4486-3827-40f6-a23e-00c33d14b686 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:04.730530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc4486-3827-40f6-a23e-00c33d14b686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:04.732148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc4486-3827-40f6-a23e-00c33d14b686 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:04.741447 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 272/573] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:05:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:04.742518 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc4486-3827-40f6-a23e-00c33d14b686 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:04.766052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:04.775257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c17b46-a586-43e6-b471-9a3b38008874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:04.775938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c17b46-a586-43e6-b471-9a3b38008874 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:04.776257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c17b46-a586-43e6-b471-9a3b38008874 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:04.776798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c17b46-a586-43e6-b471-9a3b38008874 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:04.777261 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c17b46-a586-43e6-b471-9a3b38008874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:04.777570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c17b46-a586-43e6-b471-9a3b38008874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:04.778942 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c17b46-a586-43e6-b471-9a3b38008874 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:04.793323 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 302/574] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:04.795203 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de15681-0ba6-4c39-97ba-f42b76fb6c70 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:04.795601 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de15681-0ba6-4c39-97ba-f42b76fb6c70 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:04.796073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de15681-0ba6-4c39-97ba-f42b76fb6c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:04.813429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2de15681-0ba6-4c39-97ba-f42b76fb6c70 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:04.814685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2de15681-0ba6-4c39-97ba-f42b76fb6c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:04.859768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc4486-3827-40f6-a23e-00c33d14b686 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:04.861870 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:04.890744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 303/575] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:05:04.891581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de15681-0ba6-4c39-97ba-f42b76fb6c70 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:04.902136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abd354-ce09-4be3-ad39-4975e6890af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:04.903219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd354-ce09-4be3-ad39-4975e6890af0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:04.903705 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd354-ce09-4be3-ad39-4975e6890af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:04.904210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd354-ce09-4be3-ad39-4975e6890af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:04.915803 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abd354-ce09-4be3-ad39-4975e6890af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:04.917821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abd354-ce09-4be3-ad39-4975e6890af0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-79abd354-ce09-4be3-ad39-4975e6890af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:04.935072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:04.936048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:04.936961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:04.936961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:04.936961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:04.936961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:04.941391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 273/576] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:04.942257 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abd354-ce09-4be3-ad39-4975e6890af0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:05.011769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de15681-0ba6-4c39-97ba-f42b76fb6c70 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:05.033607 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:05.050574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abd354-ce09-4be3-ad39-4975e6890af0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:05.054661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d3b5c-6813-4f9d-b082-ba978463b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:05.055566 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d3b5c-6813-4f9d-b082-ba978463b291 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:05.055792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d3b5c-6813-4f9d-b082-ba978463b291 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:05.056102 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d3b5c-6813-4f9d-b082-ba978463b291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:05.071505 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d3b5c-6813-4f9d-b082-ba978463b291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:05.073016 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d3b5c-6813-4f9d-b082-ba978463b291 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:05.090025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bbbb0-7c3b-4f6b-ad11-7183bb469675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:05.090814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bbbb0-7c3b-4f6b-ad11-7183bb469675 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:05.091092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bbbb0-7c3b-4f6b-ad11-7183bb469675 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:05.091359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bbbb0-7c3b-4f6b-ad11-7183bb469675 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-4f9d3b5c-6813-4f9d-b082-ba978463b291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:05.093186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:05.094037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:05.095477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:05.095477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:05.095477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:05.095477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:05.095477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 304/577] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:05.095781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d3b5c-6813-4f9d-b082-ba978463b291 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:05.107030 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bbbb0-7c3b-4f6b-ad11-7183bb469675 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:05.109260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bbbb0-7c3b-4f6b-ad11-7183bb469675 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-ff4bbbb0-7c3b-4f6b-ad11-7183bb469675 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:05.125300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:05.126268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:05.127976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:05.127976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:05.127976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:05.127976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:05.127976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:05.127976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:05.127976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:05.127976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:05.127976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:05:05.127976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:05.127976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 274/578] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:05:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:05.127976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bbbb0-7c3b-4f6b-ad11-7183bb469675 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:05.147137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:05.206796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d3b5c-6813-4f9d-b082-ba978463b291 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:05.233469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bbbb0-7c3b-4f6b-ad11-7183bb469675 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:05.244171 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9ad81-0fd0-48c8-9bb7-81ca7ea2e9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:05.245251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9ad81-0fd0-48c8-9bb7-81ca7ea2e9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:05.245694 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9ad81-0fd0-48c8-9bb7-81ca7ea2e9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:05.246221 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9ad81-0fd0-48c8-9bb7-81ca7ea2e9e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:05.257922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9ad81-0fd0-48c8-9bb7-81ca7ea2e9e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-f3e9ad81-0fd0-48c8-9bb7-81ca7ea2e9e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:05.267306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:05.268461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:05.269533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:05.269533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:05.269533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:05.269533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:05.269533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:05.269533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:05.269533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:05.269533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:05.269533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:05.269533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:05.269533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:05.269533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:05.270339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38eb003-28f3-411a-bdeb-8e3e5805e4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:05.270339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eb003-28f3-411a-bdeb-8e3e5805e4ee None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:05.270339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eb003-28f3-411a-bdeb-8e3e5805e4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:05.270339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eb003-28f3-411a-bdeb-8e3e5805e4ee None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:05.270734 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38eb003-28f3-411a-bdeb-8e3e5805e4ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:05.270734 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38eb003-28f3-411a-bdeb-8e3e5805e4ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:05.270884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38eb003-28f3-411a-bdeb-8e3e5805e4ee None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:05.272437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 305/579] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:05.273490 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9ad81-0fd0-48c8-9bb7-81ca7ea2e9e8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:05.289736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 275/580] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:05.290839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38eb003-28f3-411a-bdeb-8e3e5805e4ee None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:05.312502 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:05.366348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:05.386798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9ad81-0fd0-48c8-9bb7-81ca7ea2e9e8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:05.390906 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38eb003-28f3-411a-bdeb-8e3e5805e4ee None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:05.426629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f165aa-dcbb-47cb-96da-b4b01e982557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:05.427156 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da330d2-ae5b-44ca-889b-054b305b038a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:05.427345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f165aa-dcbb-47cb-96da-b4b01e982557 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:05.427577 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f165aa-dcbb-47cb-96da-b4b01e982557 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:05.427847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f165aa-dcbb-47cb-96da-b4b01e982557 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:05.427946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da330d2-ae5b-44ca-889b-054b305b038a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:05.428228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da330d2-ae5b-44ca-889b-054b305b038a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:05.428499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da330d2-ae5b-44ca-889b-054b305b038a None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:05.428594 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f165aa-dcbb-47cb-96da-b4b01e982557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:05.428887 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f165aa-dcbb-47cb-96da-b4b01e982557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:05.429320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da330d2-ae5b-44ca-889b-054b305b038a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:05.429623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da330d2-ae5b-44ca-889b-054b305b038a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:05.430250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f165aa-dcbb-47cb-96da-b4b01e982557 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:05.431018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da330d2-ae5b-44ca-889b-054b305b038a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:05.446695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 306/581] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:05.446695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f165aa-dcbb-47cb-96da-b4b01e982557 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:05.452071 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 276/582] 10.222.0.74 () {56 vars in 1137 bytes} [Thu Jul 14 10:05:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:05.456958 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da330d2-ae5b-44ca-889b-054b305b038a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:05.540045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:05.549640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f165aa-dcbb-47cb-96da-b4b01e982557 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:05.561284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da330d2-ae5b-44ca-889b-054b305b038a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:05.585597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bf5a1-7aa8-40ef-bfd8-558af79ba03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:05.586270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf5a1-7aa8-40ef-bfd8-558af79ba03c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:05.586560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf5a1-7aa8-40ef-bfd8-558af79ba03c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:05.586817 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf5a1-7aa8-40ef-bfd8-558af79ba03c None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:05.587554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bf5a1-7aa8-40ef-bfd8-558af79ba03c None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:05.587856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bf5a1-7aa8-40ef-bfd8-558af79ba03c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:05.589343 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bf5a1-7aa8-40ef-bfd8-558af79ba03c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:05.594194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:05.602022 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 307/583] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:05:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:05.602022 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bf5a1-7aa8-40ef-bfd8-558af79ba03c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:05.605980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f7323-d822-4d09-85d8-817738e51f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:05.605980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f7323-d822-4d09-85d8-817738e51f21 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:05.605980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f7323-d822-4d09-85d8-817738e51f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:05.605980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f7323-d822-4d09-85d8-817738e51f21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:05.613264 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f7323-d822-4d09-85d8-817738e51f21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:05.614764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f7323-d822-4d09-85d8-817738e51f21 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-865f7323-d822-4d09-85d8-817738e51f21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:05.629394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:05.630326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:05.631254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:05.631254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:05.631254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:05.631254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:05.631254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:05.631254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:05.631254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:05.631254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:05.638220 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 277/584] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:05.638220 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f7323-d822-4d09-85d8-817738e51f21 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:05.714030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bf5a1-7aa8-40ef-bfd8-558af79ba03c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:05.750915 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f7323-d822-4d09-85d8-817738e51f21 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:05.751281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b2ba4-7617-4576-85ea-481d1de15261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:05.752113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b2ba4-7617-4576-85ea-481d1de15261 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:05.752504 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b2ba4-7617-4576-85ea-481d1de15261 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:05.752778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b2ba4-7617-4576-85ea-481d1de15261 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:05.760505 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b2ba4-7617-4576-85ea-481d1de15261 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:05.761934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b2ba4-7617-4576-85ea-481d1de15261 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-b92b2ba4-7617-4576-85ea-481d1de15261 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:05.777324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:05.778307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:05.779248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:05.779248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:05.779248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:05.779248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:05.779248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:05.779248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:05.779248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:05.779248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:05.779248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:05:05.779248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:05.779248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 308/585] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:05:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:05.779836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b2ba4-7617-4576-85ea-481d1de15261 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:05.791581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9778ad-5bf5-4aa2-9d23-b890c0da051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:05.792406 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9778ad-5bf5-4aa2-9d23-b890c0da051d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:05.792686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9778ad-5bf5-4aa2-9d23-b890c0da051d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:05.793027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9778ad-5bf5-4aa2-9d23-b890c0da051d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:05.797276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:05.806958 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9778ad-5bf5-4aa2-9d23-b890c0da051d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:05.808435 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9778ad-5bf5-4aa2-9d23-b890c0da051d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-6d9778ad-5bf5-4aa2-9d23-b890c0da051d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:05.825714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:05.826639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:05.827568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:05.827568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:05.827568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:05.827568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:05.827568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 278/586] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:05.827870 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9778ad-5bf5-4aa2-9d23-b890c0da051d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:05.877914 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:05.893685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b2ba4-7617-4576-85ea-481d1de15261 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:05.930084 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d12f40-b7b4-4e66-8b74-3c24099040a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:05.930879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d12f40-b7b4-4e66-8b74-3c24099040a3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:05.931162 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d12f40-b7b4-4e66-8b74-3c24099040a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:05.931423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d12f40-b7b4-4e66-8b74-3c24099040a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:05.936320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9778ad-5bf5-4aa2-9d23-b890c0da051d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:05.943115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d12f40-b7b4-4e66-8b74-3c24099040a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:05.944592 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d12f40-b7b4-4e66-8b74-3c24099040a3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-37d12f40-b7b4-4e66-8b74-3c24099040a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:05.962561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:05.963441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:05.964376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:05.964376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:05.964376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:05.964376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:05.964376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 309/587] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:05.964665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d12f40-b7b4-4e66-8b74-3c24099040a3 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:05.978123 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fe967-83b5-4bec-b3a9-1b44e8c04c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:05.978796 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fe967-83b5-4bec-b3a9-1b44e8c04c16 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:05.979085 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fe967-83b5-4bec-b3a9-1b44e8c04c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:05.979366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fe967-83b5-4bec-b3a9-1b44e8c04c16 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:05.980180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fe967-83b5-4bec-b3a9-1b44e8c04c16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:05.980497 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fe967-83b5-4bec-b3a9-1b44e8c04c16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:05.981932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fe967-83b5-4bec-b3a9-1b44e8c04c16 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:05.999725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 279/588] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:05.999725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fe967-83b5-4bec-b3a9-1b44e8c04c16 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:06.031577 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:06.081701 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d12f40-b7b4-4e66-8b74-3c24099040a3 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:06.108079 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fe967-83b5-4bec-b3a9-1b44e8c04c16 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:06.111687 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:06.119425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211bc61-b70a-4744-9520-ba43b1ab91af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:06.120417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211bc61-b70a-4744-9520-ba43b1ab91af None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:06.121123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211bc61-b70a-4744-9520-ba43b1ab91af None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:06.121826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211bc61-b70a-4744-9520-ba43b1ab91af None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:06.122819 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211bc61-b70a-4744-9520-ba43b1ab91af None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:06.124123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211bc61-b70a-4744-9520-ba43b1ab91af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:06.125487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211bc61-b70a-4744-9520-ba43b1ab91af None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:06.144886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bf51d-4b33-4666-8d14-708cc55139e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:06.145543 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bf51d-4b33-4666-8d14-708cc55139e7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:06.145833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bf51d-4b33-4666-8d14-708cc55139e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:06.146112 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bf51d-4b33-4666-8d14-708cc55139e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:06.146835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bf51d-4b33-4666-8d14-708cc55139e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:06.147145 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bf51d-4b33-4666-8d14-708cc55139e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:06.152281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 310/589] 10.222.0.74 () {56 vars in 1137 bytes} [Thu Jul 14 10:05:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:06.152424 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bf51d-4b33-4666-8d14-708cc55139e7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:06.152532 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211bc61-b70a-4744-9520-ba43b1ab91af None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:06.160205 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 280/590] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:06.164894 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bf51d-4b33-4666-8d14-708cc55139e7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:06.262508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211bc61-b70a-4744-9520-ba43b1ab91af None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:06.271775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bf51d-4b33-4666-8d14-708cc55139e7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:06.285395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:06.297333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7cf79-4f29-419e-a5c3-d30aa76a7a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:06.298036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7cf79-4f29-419e-a5c3-d30aa76a7a4e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:06.298317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7cf79-4f29-419e-a5c3-d30aa76a7a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:06.298589 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7cf79-4f29-419e-a5c3-d30aa76a7a4e None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:06.299316 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7cf79-4f29-419e-a5c3-d30aa76a7a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:06.301355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7cf79-4f29-419e-a5c3-d30aa76a7a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:06.301355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7cf79-4f29-419e-a5c3-d30aa76a7a4e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:06.309601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5028d7-5f8f-48d4-a21a-7f4482ad1569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:06.310318 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5028d7-5f8f-48d4-a21a-7f4482ad1569 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:06.310550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5028d7-5f8f-48d4-a21a-7f4482ad1569 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:06.310824 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5028d7-5f8f-48d4-a21a-7f4482ad1569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:06.311659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5028d7-5f8f-48d4-a21a-7f4482ad1569 None admin] RBAC: Adding query filter params (role.id=feef3a85c1c0446590c2671a9f266cf4, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=323279b7ad0c418b848d6d7ae26ec5d2) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:06.311974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5028d7-5f8f-48d4-a21a-7f4482ad1569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:06.318123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 311/591] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:06.318296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5028d7-5f8f-48d4-a21a-7f4482ad1569 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:06.318395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7cf79-4f29-419e-a5c3-d30aa76a7a4e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:06.332033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 281/592] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:06 2022] GET /identity/v3/role_assignments?user.id=323279b7ad0c418b848d6d7ae26ec5d2&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=feef3a85c1c0446590c2671a9f266cf4 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:06.332033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5028d7-5f8f-48d4-a21a-7f4482ad1569 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:06.359701 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:06.453856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5028d7-5f8f-48d4-a21a-7f4482ad1569 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:06.464021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7cf79-4f29-419e-a5c3-d30aa76a7a4e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:06.499642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74c661-1f3c-41cc-90d7-397b834c162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:06.500478 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74c661-1f3c-41cc-90d7-397b834c162e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:06.500758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74c661-1f3c-41cc-90d7-397b834c162e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:06.501582 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74c661-1f3c-41cc-90d7-397b834c162e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:06.503303 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b9093-aa4e-49e6-8c31-e3e99863639f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:06.504324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b9093-aa4e-49e6-8c31-e3e99863639f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:06.504758 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b9093-aa4e-49e6-8c31-e3e99863639f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:06.505181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b9093-aa4e-49e6-8c31-e3e99863639f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:06.509202 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74c661-1f3c-41cc-90d7-397b834c162e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:06.510658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74c661-1f3c-41cc-90d7-397b834c162e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:06.516759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b9093-aa4e-49e6-8c31-e3e99863639f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:06.518455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b9093-aa4e-49e6-8c31-e3e99863639f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-df74c661-1f3c-41cc-90d7-397b834c162e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:06.527723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:06.528760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:06.529666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:06.529666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:06.529666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:06.529666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:06.529666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:06.529666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:06.529666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:06.529666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:06.532060 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 282/593] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:06.533605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74c661-1f3c-41cc-90d7-397b834c162e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-030b9093-aa4e-49e6-8c31-e3e99863639f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:06.544816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:06.545730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:06.546667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:06.546667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:06.546667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:06.546667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:06.553682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 312/594] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:06.554787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b9093-aa4e-49e6-8c31-e3e99863639f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:06.600383 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:06.643710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:06.656446 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74c661-1f3c-41cc-90d7-397b834c162e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:06.678928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b9093-aa4e-49e6-8c31-e3e99863639f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:06.692710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178ddf2-2f15-4e64-869d-0a80ab09b19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:06.693502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178ddf2-2f15-4e64-869d-0a80ab09b19e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:06.693822 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178ddf2-2f15-4e64-869d-0a80ab09b19e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:06.694100 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178ddf2-2f15-4e64-869d-0a80ab09b19e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:06.701397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178ddf2-2f15-4e64-869d-0a80ab09b19e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:06.702839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178ddf2-2f15-4e64-869d-0a80ab09b19e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-d178ddf2-2f15-4e64-869d-0a80ab09b19e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:06.718014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:06.718985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:06.721025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:06.721025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:06.721025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:06.721025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:06.721025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:06.721025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:06.721025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:06.721025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:06.721025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:05:06.721025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:06.721025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 283/595] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:06.721025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178ddf2-2f15-4e64-869d-0a80ab09b19e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:06.725836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d2acb-7790-4611-b2f2-d9803cc69e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:06.726542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d2acb-7790-4611-b2f2-d9803cc69e8b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:06.726831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d2acb-7790-4611-b2f2-d9803cc69e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:06.727105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d2acb-7790-4611-b2f2-d9803cc69e8b None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:06.727895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d2acb-7790-4611-b2f2-d9803cc69e8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:06.728230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d2acb-7790-4611-b2f2-d9803cc69e8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:06.729676 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d2acb-7790-4611-b2f2-d9803cc69e8b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:06.743449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 313/596] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:06.745704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478caa15-edfa-46fa-865c-592b05c45fe5 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:06.746203 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478caa15-edfa-46fa-865c-592b05c45fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:06.746817 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478caa15-edfa-46fa-865c-592b05c45fe5 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:06.752821 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 314/597] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:06.753242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478caa15-edfa-46fa-865c-592b05c45fe5 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:06.833649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178ddf2-2f15-4e64-869d-0a80ab09b19e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:06.857920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:06.867109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478caa15-edfa-46fa-865c-592b05c45fe5 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:06.869498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb4ca1-bdd9-4510-aa9d-3e1b6708ebfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:06.870170 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb4ca1-bdd9-4510-aa9d-3e1b6708ebfb None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:06.870455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb4ca1-bdd9-4510-aa9d-3e1b6708ebfb None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:06.870736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb4ca1-bdd9-4510-aa9d-3e1b6708ebfb None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:06.871462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb4ca1-bdd9-4510-aa9d-3e1b6708ebfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:06.871770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb4ca1-bdd9-4510-aa9d-3e1b6708ebfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:06.873182 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb4ca1-bdd9-4510-aa9d-3e1b6708ebfb None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:06.889664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 284/598] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:06.889664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb4ca1-bdd9-4510-aa9d-3e1b6708ebfb None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:06.902069 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:06.905778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d439df-9526-4a4e-b10a-49e96907e405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:06.906459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d439df-9526-4a4e-b10a-49e96907e405 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:06.906745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d439df-9526-4a4e-b10a-49e96907e405 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:06.907022 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d439df-9526-4a4e-b10a-49e96907e405 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:06.908443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d439df-9526-4a4e-b10a-49e96907e405 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:06.908758 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d439df-9526-4a4e-b10a-49e96907e405 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:06.910194 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d439df-9526-4a4e-b10a-49e96907e405 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:06.934273 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 315/599] 10.222.0.74 () {56 vars in 1139 bytes} [Thu Jul 14 10:05:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:06.934273 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330de9-9092-4376-a585-a0ed013b1885 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:06.934273 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330de9-9092-4376-a585-a0ed013b1885 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:06.934273 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330de9-9092-4376-a585-a0ed013b1885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:06.948409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1e330de9-9092-4376-a585-a0ed013b1885 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:06.949608 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1e330de9-9092-4376-a585-a0ed013b1885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:07.003741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb4ca1-bdd9-4510-aa9d-3e1b6708ebfb None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:07.028058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 316/600] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:05:07.028058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e330de9-9092-4376-a585-a0ed013b1885 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:07.054548 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8ef8c-fe2d-4ef7-bb2f-bdcb162641c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:07.058222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8ef8c-fe2d-4ef7-bb2f-bdcb162641c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:07.058222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8ef8c-fe2d-4ef7-bb2f-bdcb162641c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:07.058222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8ef8c-fe2d-4ef7-bb2f-bdcb162641c5 None admin] PATH_INFO: `/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/12abc4b2a8d348d992e0bb00a1218929/roles/feef3a85c1c0446590c2671a9f266cf4` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:07.075892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8ef8c-fe2d-4ef7-bb2f-bdcb162641c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=795b6593e7b74eeda9929aba07cbaa0e, user_id=12abc4b2a8d348d992e0bb00a1218929, role_id=feef3a85c1c0446590c2671a9f266cf4)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:07.077488 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8ef8c-fe2d-4ef7-bb2f-bdcb162641c5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:07.119427 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:07.137347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e330de9-9092-4376-a585-a0ed013b1885 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:07.145647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 285/601] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:05:06 2022] PUT /identity/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/12abc4b2a8d348d992e0bb00a1218929/roles/feef3a85c1c0446590c2671a9f266cf4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:05:07.146724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8ef8c-fe2d-4ef7-bb2f-bdcb162641c5 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:07.185879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9cda3-ba5f-43c3-bbf2-144e60731eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:07.187125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9cda3-ba5f-43c3-bbf2-144e60731eca None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:07.187636 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9cda3-ba5f-43c3-bbf2-144e60731eca None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:07.188152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9cda3-ba5f-43c3-bbf2-144e60731eca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:07.197176 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9cda3-ba5f-43c3-bbf2-144e60731eca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:07.199334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9cda3-ba5f-43c3-bbf2-144e60731eca None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:07.213761 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-ede9cda3-ba5f-43c3-bbf2-144e60731eca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:07.224118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:07.226965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:07.228070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:07.228070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:07.228070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:07.228070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:07.228070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:07.228070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:07.228070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:07.228070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:07.228070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 317/602] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:07.229014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9cda3-ba5f-43c3-bbf2-144e60731eca None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:07.268992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8ef8c-fe2d-4ef7-bb2f-bdcb162641c5 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:07.330058 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a983a6-4f29-46f7-a50c-4e279c40b06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:07.331175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a983a6-4f29-46f7-a50c-4e279c40b06f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:07.331461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a983a6-4f29-46f7-a50c-4e279c40b06f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:07.331742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a983a6-4f29-46f7-a50c-4e279c40b06f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:07.343376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a983a6-4f29-46f7-a50c-4e279c40b06f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:07.344957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a983a6-4f29-46f7-a50c-4e279c40b06f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:07.355645 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9cda3-ba5f-43c3-bbf2-144e60731eca None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-08a983a6-4f29-46f7-a50c-4e279c40b06f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:07.368140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:07.369072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:07.370031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:07.370031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:07.370031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:07.370031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:07.370031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 286/603] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:07.370527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a983a6-4f29-46f7-a50c-4e279c40b06f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:07.404206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75269589-d677-4578-986c-853e3c3975ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:07.405255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75269589-d677-4578-986c-853e3c3975ab None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:07.405724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75269589-d677-4578-986c-853e3c3975ab None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:07.406198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75269589-d677-4578-986c-853e3c3975ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:07.417299 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75269589-d677-4578-986c-853e3c3975ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-75269589-d677-4578-986c-853e3c3975ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:07.425925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:07.426885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:07.427728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:07.427728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:07.427728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:07.427728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:07.427728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:07.427728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:07.427728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:07.427728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:07.427728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:07.427728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:07.427728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:07.427728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:07.430240 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 318/604] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:07.431394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75269589-d677-4578-986c-853e3c3975ab None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:07.436357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:07.503165 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a983a6-4f29-46f7-a50c-4e279c40b06f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:07.517003 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:07.543441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75269589-d677-4578-986c-853e3c3975ab None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:07.549318 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5b552-f109-438b-9e52-54c73af13171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:07.549998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5b552-f109-438b-9e52-54c73af13171 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:07.550282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5b552-f109-438b-9e52-54c73af13171 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:07.550558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5b552-f109-438b-9e52-54c73af13171 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:07.551350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5b552-f109-438b-9e52-54c73af13171 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:07.551663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5b552-f109-438b-9e52-54c73af13171 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:07.553638 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5b552-f109-438b-9e52-54c73af13171 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:07.575010 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 287/605] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:07.575010 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5b552-f109-438b-9e52-54c73af13171 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:07.597816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b6d75-11d7-4035-98f7-b9028707eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:07.598575 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b6d75-11d7-4035-98f7-b9028707eada None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:07.598897 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b6d75-11d7-4035-98f7-b9028707eada None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:07.599550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b6d75-11d7-4035-98f7-b9028707eada None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:07.600603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b6d75-11d7-4035-98f7-b9028707eada None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:07.600918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b6d75-11d7-4035-98f7-b9028707eada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:07.602579 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b6d75-11d7-4035-98f7-b9028707eada None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:07.621037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 319/606] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:07.621808 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b6d75-11d7-4035-98f7-b9028707eada None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:07.681134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5b552-f109-438b-9e52-54c73af13171 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:07.690502 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:07.717097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23a0d5-99f1-49d3-a630-93448ea03092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:07.717774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23a0d5-99f1-49d3-a630-93448ea03092 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:07.718083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23a0d5-99f1-49d3-a630-93448ea03092 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:07.718357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23a0d5-99f1-49d3-a630-93448ea03092 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:07.719138 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23a0d5-99f1-49d3-a630-93448ea03092 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:07.720077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23a0d5-99f1-49d3-a630-93448ea03092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:07.721919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23a0d5-99f1-49d3-a630-93448ea03092 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:07.733116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 288/607] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:05:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:07.734034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23a0d5-99f1-49d3-a630-93448ea03092 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:07.734248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b6d75-11d7-4035-98f7-b9028707eada None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:07.771818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e5606-9004-426e-9a08-6653261c0cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:07.772661 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:07.773838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e5606-9004-426e-9a08-6653261c0cde None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:07.774273 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e5606-9004-426e-9a08-6653261c0cde None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:07.774696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e5606-9004-426e-9a08-6653261c0cde None admin] PATH_INFO: `/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/397a66eb12254a65bf05bc9fff9a868e/roles/feef3a85c1c0446590c2671a9f266cf4` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:07.791070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e5606-9004-426e-9a08-6653261c0cde None admin] RBAC: Authorizing `identity:create_grant(project_id=795b6593e7b74eeda9929aba07cbaa0e, user_id=397a66eb12254a65bf05bc9fff9a868e, role_id=feef3a85c1c0446590c2671a9f266cf4)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:07.792747 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e5606-9004-426e-9a08-6653261c0cde None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:07.848355 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23a0d5-99f1-49d3-a630-93448ea03092 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:07.887884 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 320/608] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:05:07 2022] PUT /identity/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/397a66eb12254a65bf05bc9fff9a868e/roles/feef3a85c1c0446590c2671a9f266cf4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:05:07.888417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e5606-9004-426e-9a08-6653261c0cde None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:07.890997 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855c270-c1f9-43f2-a8bc-faf77c2b64ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:07.894954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855c270-c1f9-43f2-a8bc-faf77c2b64ad None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:07.894954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855c270-c1f9-43f2-a8bc-faf77c2b64ad None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:07.894954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855c270-c1f9-43f2-a8bc-faf77c2b64ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:07.909514 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855c270-c1f9-43f2-a8bc-faf77c2b64ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:07.911837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855c270-c1f9-43f2-a8bc-faf77c2b64ad None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-b855c270-c1f9-43f2-a8bc-faf77c2b64ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:07.941313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:07.942387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:07.943309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:07.943309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:07.943309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:07.943309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:07.943309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:07.943309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:07.943309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:07.943309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:07.954245 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 289/609] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:07.967225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855c270-c1f9-43f2-a8bc-faf77c2b64ad None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:08.030089 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e5606-9004-426e-9a08-6653261c0cde None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:08.047561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:08.083237 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be2a34-26c9-43b4-8858-69e854d1c6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:08.084701 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be2a34-26c9-43b4-8858-69e854d1c6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:08.085578 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be2a34-26c9-43b4-8858-69e854d1c6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:08.086312 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be2a34-26c9-43b4-8858-69e854d1c6c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:08.102734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be2a34-26c9-43b4-8858-69e854d1c6c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:08.104617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be2a34-26c9-43b4-8858-69e854d1c6c5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:08.126090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-f8be2a34-26c9-43b4-8858-69e854d1c6c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:08.127095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:08.127959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:08.130049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:08.130049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:08.130049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:08.130049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:08.130049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 321/610] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:08.133892 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be2a34-26c9-43b4-8858-69e854d1c6c5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:08.146358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855c270-c1f9-43f2-a8bc-faf77c2b64ad None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:08.190369 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bf904-d2da-4122-94d5-29e536ea3bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:08.191479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bf904-d2da-4122-94d5-29e536ea3bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:08.191865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bf904-d2da-4122-94d5-29e536ea3bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:08.192642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bf904-d2da-4122-94d5-29e536ea3bf3 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:08.193548 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bf904-d2da-4122-94d5-29e536ea3bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:08.193967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bf904-d2da-4122-94d5-29e536ea3bf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:08.196113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bf904-d2da-4122-94d5-29e536ea3bf3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:08.212212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 290/611] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:08.221144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bf904-d2da-4122-94d5-29e536ea3bf3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:08.255211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be2a34-26c9-43b4-8858-69e854d1c6c5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:08.303463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90591d23-d124-44df-a464-d1f34e92d9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:08.304173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591d23-d124-44df-a464-d1f34e92d9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:08.304460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591d23-d124-44df-a464-d1f34e92d9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:08.304733 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591d23-d124-44df-a464-d1f34e92d9a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:08.305471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90591d23-d124-44df-a464-d1f34e92d9a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:08.305780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90591d23-d124-44df-a464-d1f34e92d9a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:08.307262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90591d23-d124-44df-a464-d1f34e92d9a0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:08.328249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 322/612] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:08.334449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90591d23-d124-44df-a464-d1f34e92d9a0 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:08.369859 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bf904-d2da-4122-94d5-29e536ea3bf3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:08.382696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:08.416295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198272d5-7f15-4c2f-9a16-84d99519223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:08.417245 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198272d5-7f15-4c2f-9a16-84d99519223a None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:08.417628 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198272d5-7f15-4c2f-9a16-84d99519223a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:08.418048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198272d5-7f15-4c2f-9a16-84d99519223a None admin] PATH_INFO: `/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/bf41e7a4968e4ab9bce98f6e1c050b4c/roles/feef3a85c1c0446590c2671a9f266cf4` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:08.446414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198272d5-7f15-4c2f-9a16-84d99519223a None admin] RBAC: Authorizing `identity:create_grant(project_id=795b6593e7b74eeda9929aba07cbaa0e, user_id=bf41e7a4968e4ab9bce98f6e1c050b4c, role_id=feef3a85c1c0446590c2671a9f266cf4)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:08.448958 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198272d5-7f15-4c2f-9a16-84d99519223a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:08.495854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90591d23-d124-44df-a464-d1f34e92d9a0 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:08.510694 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 291/613] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:05:08 2022] PUT /identity/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/bf41e7a4968e4ab9bce98f6e1c050b4c/roles/feef3a85c1c0446590c2671a9f266cf4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:05:08.522063 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbbbd6-a186-445c-a152-f0b70e34744f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:08.522531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbbbd6-a186-445c-a152-f0b70e34744f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:08.522908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbbbd6-a186-445c-a152-f0b70e34744f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:08.524598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 292/614] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:08 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:08.538987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895eb1e3-47f4-44e6-a840-7e09d57bdde0 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:08.539420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895eb1e3-47f4-44e6-a840-7e09d57bdde0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:08.539799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895eb1e3-47f4-44e6-a840-7e09d57bdde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:08.551595 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bc865-d60a-469f-8386-ac7ac4b2f386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:08.552361 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:08.552584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc865-d60a-469f-8386-ac7ac4b2f386 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:08.552867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc865-d60a-469f-8386-ac7ac4b2f386 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:08.553139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc865-d60a-469f-8386-ac7ac4b2f386 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:08.574359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bc865-d60a-469f-8386-ac7ac4b2f386 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:08.576982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-895eb1e3-47f4-44e6-a840-7e09d57bdde0 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:08.577812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bc865-d60a-469f-8386-ac7ac4b2f386 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:08.579905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-895eb1e3-47f4-44e6-a840-7e09d57bdde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-3f0bc865-d60a-469f-8386-ac7ac4b2f386 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:08.607560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:08.608612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:08.609671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:08.609671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:08.609671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:08.609671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:08.609671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:08.609671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:08.609671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:08.609671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:08.609671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:05:08.609671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:08.610984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 323/615] 10.222.0.74 () {56 vars in 1093 bytes} [Thu Jul 14 10:05:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:08.616622 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bc865-d60a-469f-8386-ac7ac4b2f386 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:08.708859 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 293/616] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:05:08.736398 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895eb1e3-47f4-44e6-a840-7e09d57bdde0 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:08.767584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:08.783711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bc865-d60a-469f-8386-ac7ac4b2f386 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:08.826372 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ed6d0-f5a9-4945-b4b1-f1a1ce8d8635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:08.827071 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ed6d0-f5a9-4945-b4b1-f1a1ce8d8635 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:08.827358 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ed6d0-f5a9-4945-b4b1-f1a1ce8d8635 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:08.827637 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ed6d0-f5a9-4945-b4b1-f1a1ce8d8635 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:08.828523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ed6d0-f5a9-4945-b4b1-f1a1ce8d8635 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:08.828833 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ed6d0-f5a9-4945-b4b1-f1a1ce8d8635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:08.830829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ed6d0-f5a9-4945-b4b1-f1a1ce8d8635 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:08.872560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 324/617] 10.222.0.74 () {56 vars in 1133 bytes} [Thu Jul 14 10:05:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:08.875025 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ed6d0-f5a9-4945-b4b1-f1a1ce8d8635 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:08.921375 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895eb1e3-47f4-44e6-a840-7e09d57bdde0 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:08.958672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2c024-ab6a-4c1a-aa9b-debbb3c46f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:08.959531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2c024-ab6a-4c1a-aa9b-debbb3c46f17 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:08.959762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2c024-ab6a-4c1a-aa9b-debbb3c46f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:08.960209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2c024-ab6a-4c1a-aa9b-debbb3c46f17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:08.968344 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:08.972535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2c024-ab6a-4c1a-aa9b-debbb3c46f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-73a2c024-ab6a-4c1a-aa9b-debbb3c46f17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:08.986326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:08.987285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:08.988790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:08.988790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:08.988790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:08.988790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:08.988790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:08.988790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:08.988790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:08.988790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:08.988790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:08.988790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:08.988790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:08.988790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:08.988790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 294/618] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:08.993666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2c024-ab6a-4c1a-aa9b-debbb3c46f17 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:09.118350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2c024-ab6a-4c1a-aa9b-debbb3c46f17 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:09.155595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086b413-c3fe-47da-80b0-cb9e1b07502f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:09.156319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086b413-c3fe-47da-80b0-cb9e1b07502f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:09.156605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086b413-c3fe-47da-80b0-cb9e1b07502f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:09.156884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086b413-c3fe-47da-80b0-cb9e1b07502f None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:09.157831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086b413-c3fe-47da-80b0-cb9e1b07502f None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:09.158182 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086b413-c3fe-47da-80b0-cb9e1b07502f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:09.159690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086b413-c3fe-47da-80b0-cb9e1b07502f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:09.160816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ed6d0-f5a9-4945-b4b1-f1a1ce8d8635 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:09.169862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 295/619] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:05:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:09.180978 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086b413-c3fe-47da-80b0-cb9e1b07502f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:09.205552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f89cab-5384-4377-8765-a76b5089ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:09.206523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f89cab-5384-4377-8765-a76b5089ef33 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:09.206948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f89cab-5384-4377-8765-a76b5089ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:09.207362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f89cab-5384-4377-8765-a76b5089ef33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:09.220758 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:09.281578 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f89cab-5384-4377-8765-a76b5089ef33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:09.283385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f89cab-5384-4377-8765-a76b5089ef33 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:09.284396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:09.365719 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086b413-c3fe-47da-80b0-cb9e1b07502f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:09.391173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 325/620] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:05:09.396672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f89cab-5384-4377-8765-a76b5089ef33 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:09.417027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea98c60-5055-45dd-a244-b1e0b42df7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:09.417969 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea98c60-5055-45dd-a244-b1e0b42df7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:09.418366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea98c60-5055-45dd-a244-b1e0b42df7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:09.418739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea98c60-5055-45dd-a244-b1e0b42df7a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:09.429777 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea98c60-5055-45dd-a244-b1e0b42df7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:09.431423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea98c60-5055-45dd-a244-b1e0b42df7a0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:09.442954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-dea98c60-5055-45dd-a244-b1e0b42df7a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:09.449756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:09.450831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:09.452049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:09.452049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:09.452049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:09.452049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:09.453539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 296/621] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:09.455437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725909-64d4-4a43-8e11-46fdc23f4d46 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:09.455786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725909-64d4-4a43-8e11-46fdc23f4d46 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:09.456154 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725909-64d4-4a43-8e11-46fdc23f4d46 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:09.457974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 297/622] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:09.459045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec725909-64d4-4a43-8e11-46fdc23f4d46 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:09.508027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f89cab-5384-4377-8765-a76b5089ef33 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:09.545828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca10946-b05a-4266-8ec2-77d417a7fb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:09.547219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca10946-b05a-4266-8ec2-77d417a7fb41 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:09.547703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca10946-b05a-4266-8ec2-77d417a7fb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:09.548400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca10946-b05a-4266-8ec2-77d417a7fb41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:09.562481 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca10946-b05a-4266-8ec2-77d417a7fb41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:09.565346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca10946-b05a-4266-8ec2-77d417a7fb41 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:09.567770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec725909-64d4-4a43-8e11-46fdc23f4d46 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:09.575549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-6ca10946-b05a-4266-8ec2-77d417a7fb41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:09.589266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:09.590429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:09.591544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:09.591544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:09.591544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:09.591544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:09.597792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 326/623] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:09.597792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3358219-06bb-43f8-8d26-348af47eb6e6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:09.597792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3358219-06bb-43f8-8d26-348af47eb6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:09.597792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3358219-06bb-43f8-8d26-348af47eb6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:09.612432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310aab0-8fa0-4a35-b573-ff2b36438c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:09.613178 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310aab0-8fa0-4a35-b573-ff2b36438c3a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:09.613810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310aab0-8fa0-4a35-b573-ff2b36438c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:09.614406 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310aab0-8fa0-4a35-b573-ff2b36438c3a None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:09.619819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310aab0-8fa0-4a35-b573-ff2b36438c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:09.619819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310aab0-8fa0-4a35-b573-ff2b36438c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:09.619819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310aab0-8fa0-4a35-b573-ff2b36438c3a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:09.620096 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e3358219-06bb-43f8-8d26-348af47eb6e6 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:09.620932 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e3358219-06bb-43f8-8d26-348af47eb6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:09.630858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 298/624] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:09.631961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310aab0-8fa0-4a35-b573-ff2b36438c3a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:09.702236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 327/625] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:05:09.703490 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3358219-06bb-43f8-8d26-348af47eb6e6 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:09.729184 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:09.762706 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310aab0-8fa0-4a35-b573-ff2b36438c3a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:09.803271 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537170d-883a-4348-9311-880defc5b1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:09.803935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537170d-883a-4348-9311-880defc5b1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:09.804225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537170d-883a-4348-9311-880defc5b1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:09.804497 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537170d-883a-4348-9311-880defc5b1e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:09.805213 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537170d-883a-4348-9311-880defc5b1e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:09.805512 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537170d-883a-4348-9311-880defc5b1e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:09.806871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537170d-883a-4348-9311-880defc5b1e9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:09.810117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3358219-06bb-43f8-8d26-348af47eb6e6 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:09.824090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 299/626] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:09.824959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537170d-883a-4348-9311-880defc5b1e9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:09.848111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a766da3-98df-4783-a0d6-040e248a7a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:09.849299 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a766da3-98df-4783-a0d6-040e248a7a83 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:09.849788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a766da3-98df-4783-a0d6-040e248a7a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:09.850263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a766da3-98df-4783-a0d6-040e248a7a83 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:09.852778 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:09.858506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a766da3-98df-4783-a0d6-040e248a7a83 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:09.860855 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a766da3-98df-4783-a0d6-040e248a7a83 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-5a766da3-98df-4783-a0d6-040e248a7a83 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:09.876914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:09.879730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:09.880737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:09.880737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:09.880737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:09.880737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:09.880737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:09.880737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:09.880737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:09.880737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:09.880737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:05:09.880737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:09.880737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 328/627] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:05:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:09.882584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a766da3-98df-4783-a0d6-040e248a7a83 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:09.929038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537170d-883a-4348-9311-880defc5b1e9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:09.971282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455a026-8e8c-4d04-b0c1-8c37feb0eb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:09.972446 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455a026-8e8c-4d04-b0c1-8c37feb0eb0e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:09.972756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455a026-8e8c-4d04-b0c1-8c37feb0eb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:09.973086 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455a026-8e8c-4d04-b0c1-8c37feb0eb0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:09.979240 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:09.992182 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455a026-8e8c-4d04-b0c1-8c37feb0eb0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:09.997822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a766da3-98df-4783-a0d6-040e248a7a83 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-b455a026-8e8c-4d04-b0c1-8c37feb0eb0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:10.003362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:10.006301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:10.007209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:10.007209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:10.007209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:10.007209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:10.007209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:10.007209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:10.007209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:10.007209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:10.007209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:10.007209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:10.007209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:10.007209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:10.007209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 300/628] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:10.007209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455a026-8e8c-4d04-b0c1-8c37feb0eb0e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:10.043924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251061c0-a5da-46ab-b524-f92490875aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:10.045349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251061c0-a5da-46ab-b524-f92490875aef None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:10.046009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251061c0-a5da-46ab-b524-f92490875aef None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:10.046481 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251061c0-a5da-46ab-b524-f92490875aef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:10.061518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251061c0-a5da-46ab-b524-f92490875aef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:10.062987 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251061c0-a5da-46ab-b524-f92490875aef None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-251061c0-a5da-46ab-b524-f92490875aef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:10.083874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:10.084900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:10.085816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:10.085816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:10.085816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:10.085816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:10.085816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:10.085816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:10.085816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:10.085816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:10.089924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 329/629] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:10.090617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251061c0-a5da-46ab-b524-f92490875aef None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:10.121295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:10.137234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455a026-8e8c-4d04-b0c1-8c37feb0eb0e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:10.173401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9fef4-b3e2-42b9-b553-543defb805ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:10.174278 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9fef4-b3e2-42b9-b553-543defb805ae None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:10.174648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9fef4-b3e2-42b9-b553-543defb805ae None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:10.175024 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9fef4-b3e2-42b9-b553-543defb805ae None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:10.176055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9fef4-b3e2-42b9-b553-543defb805ae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:10.176469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9fef4-b3e2-42b9-b553-543defb805ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:10.178051 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9fef4-b3e2-42b9-b553-543defb805ae None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:10.196686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 301/630] 10.222.0.74 () {56 vars in 1135 bytes} [Thu Jul 14 10:05:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:10.197199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251061c0-a5da-46ab-b524-f92490875aef None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:10.197771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9fef4-b3e2-42b9-b553-543defb805ae None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:10.232927 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86248486-4982-4b25-b324-e6af58243127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:10.233903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86248486-4982-4b25-b324-e6af58243127 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:10.234394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86248486-4982-4b25-b324-e6af58243127 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:10.234853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86248486-4982-4b25-b324-e6af58243127 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:10.236362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86248486-4982-4b25-b324-e6af58243127 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:10.236864 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86248486-4982-4b25-b324-e6af58243127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:10.238507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86248486-4982-4b25-b324-e6af58243127 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:10.247450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 330/631] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:05:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:10.248749 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86248486-4982-4b25-b324-e6af58243127 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:10.278259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:10.300506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9fef4-b3e2-42b9-b553-543defb805ae None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:10.338687 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddfde6-e3a5-4422-bd98-e9d06143b351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:10.339353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddfde6-e3a5-4422-bd98-e9d06143b351 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:10.339634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddfde6-e3a5-4422-bd98-e9d06143b351 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:10.339905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddfde6-e3a5-4422-bd98-e9d06143b351 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:10.340719 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddfde6-e3a5-4422-bd98-e9d06143b351 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:10.341024 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddfde6-e3a5-4422-bd98-e9d06143b351 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:10.342452 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddfde6-e3a5-4422-bd98-e9d06143b351 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:10.354045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86248486-4982-4b25-b324-e6af58243127 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:10.357065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 302/632] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:10.358314 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddfde6-e3a5-4422-bd98-e9d06143b351 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:10.363021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:10.389752 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38478ed2-7722-4ff7-aa2d-57036c62c419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:10.390545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38478ed2-7722-4ff7-aa2d-57036c62c419 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:10.390825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38478ed2-7722-4ff7-aa2d-57036c62c419 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:10.391097 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38478ed2-7722-4ff7-aa2d-57036c62c419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:10.401776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38478ed2-7722-4ff7-aa2d-57036c62c419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:10.403219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38478ed2-7722-4ff7-aa2d-57036c62c419 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-38478ed2-7722-4ff7-aa2d-57036c62c419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:10.420513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:10.421439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:10.422338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:10.422338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:10.422338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:10.422338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:10.422338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 331/633] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:10.423596 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213e3cb-fedb-4170-a7f1-a4a7233d9276 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:10.423596 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213e3cb-fedb-4170-a7f1-a4a7233d9276 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:10.423849 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213e3cb-fedb-4170-a7f1-a4a7233d9276 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:10.428126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 332/634] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:10.428126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213e3cb-fedb-4170-a7f1-a4a7233d9276 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:10.473780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddfde6-e3a5-4422-bd98-e9d06143b351 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:10.491593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:10.509799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9551f4a-73ef-4a12-8108-b38fe4ed023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:10.510603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9551f4a-73ef-4a12-8108-b38fe4ed023a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:10.510884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9551f4a-73ef-4a12-8108-b38fe4ed023a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:10.511159 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9551f4a-73ef-4a12-8108-b38fe4ed023a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:10.522496 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9551f4a-73ef-4a12-8108-b38fe4ed023a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:10.523959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9551f4a-73ef-4a12-8108-b38fe4ed023a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:10.540399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213e3cb-fedb-4170-a7f1-a4a7233d9276 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-f9551f4a-73ef-4a12-8108-b38fe4ed023a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:10.541389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:10.542479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:10.543403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:10.543403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:10.543403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:10.543403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:10.543403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 303/635] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:10.543403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9551f4a-73ef-4a12-8108-b38fe4ed023a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:10.590442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12e11a-3a26-4756-abd6-a455706e0394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:10.591029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12e11a-3a26-4756-abd6-a455706e0394 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:10.591312 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12e11a-3a26-4756-abd6-a455706e0394 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:10.591591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12e11a-3a26-4756-abd6-a455706e0394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:10.592468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12e11a-3a26-4756-abd6-a455706e0394 None admin] RBAC: Adding query filter params (role.id=feef3a85c1c0446590c2671a9f266cf4, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=2a0626754b40449ba2346d05c5c90a35) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:10.592780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12e11a-3a26-4756-abd6-a455706e0394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:10.594233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12e11a-3a26-4756-abd6-a455706e0394 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:10.612030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 333/636] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:10 2022] GET /identity/v3/role_assignments?user.id=2a0626754b40449ba2346d05c5c90a35&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=feef3a85c1c0446590c2671a9f266cf4 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:10.612030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f343642-0c7c-44fc-8f82-48e4ed14c8e6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:10.612030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f343642-0c7c-44fc-8f82-48e4ed14c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:10.612030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f343642-0c7c-44fc-8f82-48e4ed14c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:10.620892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:10.635433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3f343642-0c7c-44fc-8f82-48e4ed14c8e6 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:10.637017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3f343642-0c7c-44fc-8f82-48e4ed14c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:10.680726 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9551f4a-73ef-4a12-8108-b38fe4ed023a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:10.727076 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade61b-1bf0-46be-a725-e9f1eb3be8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:10.727848 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade61b-1bf0-46be-a725-e9f1eb3be8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:10.728169 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade61b-1bf0-46be-a725-e9f1eb3be8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:10.728447 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade61b-1bf0-46be-a725-e9f1eb3be8c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:10.729197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ade61b-1bf0-46be-a725-e9f1eb3be8c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:10.729694 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ade61b-1bf0-46be-a725-e9f1eb3be8c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:10.731523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ade61b-1bf0-46be-a725-e9f1eb3be8c8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:10.739848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 334/637] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:05:10.741172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f343642-0c7c-44fc-8f82-48e4ed14c8e6 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:10.755918 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 304/638] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:10.762797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade61b-1bf0-46be-a725-e9f1eb3be8c8 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:10.814254 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:10.875848 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade61b-1bf0-46be-a725-e9f1eb3be8c8 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:10.876099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f343642-0c7c-44fc-8f82-48e4ed14c8e6 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:10.905611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:10.920894 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eede69-7da6-4eb2-80f7-0e810f222330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:10.921229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf439823-e8bd-4f63-841c-c4afe796e94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:10.921700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eede69-7da6-4eb2-80f7-0e810f222330 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:10.921887 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439823-e8bd-4f63-841c-c4afe796e94a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:10.921997 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eede69-7da6-4eb2-80f7-0e810f222330 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:10.922158 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439823-e8bd-4f63-841c-c4afe796e94a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:10.922268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eede69-7da6-4eb2-80f7-0e810f222330 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:10.922427 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439823-e8bd-4f63-841c-c4afe796e94a None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:10.924027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf439823-e8bd-4f63-841c-c4afe796e94a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:10.924153 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf439823-e8bd-4f63-841c-c4afe796e94a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:10.925542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf439823-e8bd-4f63-841c-c4afe796e94a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:10.929928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eede69-7da6-4eb2-80f7-0e810f222330 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:10.931365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eede69-7da6-4eb2-80f7-0e810f222330 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:10.938506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 335/639] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:10.939134 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf439823-e8bd-4f63-841c-c4afe796e94a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-c5eede69-7da6-4eb2-80f7-0e810f222330 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:10.946093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:10.947174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:10.948377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:10.948377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:10.948377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:10.948377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:10.948377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:10.948377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:10.948377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:10.948377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:10.948377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 305/640] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:10.949974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51738ccb-6f74-4e88-99af-8300bef7a890 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:10.949974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51738ccb-6f74-4e88-99af-8300bef7a890 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:10.949974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51738ccb-6f74-4e88-99af-8300bef7a890 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:10.951064 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 306/641] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:10.951766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51738ccb-6f74-4e88-99af-8300bef7a890 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:11.046817 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf439823-e8bd-4f63-841c-c4afe796e94a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:11.063797 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:11.073114 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51738ccb-6f74-4e88-99af-8300bef7a890 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:11.086620 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6093f-bcb9-43c0-9612-feac217b3d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:11.087430 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6093f-bcb9-43c0-9612-feac217b3d7b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:11.087713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6093f-bcb9-43c0-9612-feac217b3d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:11.088012 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6093f-bcb9-43c0-9612-feac217b3d7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:11.099773 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6093f-bcb9-43c0-9612-feac217b3d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-2dc6093f-bcb9-43c0-9612-feac217b3d7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:11.108028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:11.109051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:11.109933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:11.109933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:11.109933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:11.109933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:11.109933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:11.109933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:11.109933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:11.109933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:11.109933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:11.109933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:11.109933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:11.109933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:11.109933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 336/642] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:11.111272 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6093f-bcb9-43c0-9612-feac217b3d7b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:11.113487 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31da6b-322a-4053-836b-70aff00c4df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:11.114292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31da6b-322a-4053-836b-70aff00c4df0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:11.114574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31da6b-322a-4053-836b-70aff00c4df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:11.114849 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31da6b-322a-4053-836b-70aff00c4df0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:11.124778 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31da6b-322a-4053-836b-70aff00c4df0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:11.126671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31da6b-322a-4053-836b-70aff00c4df0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3e31da6b-322a-4053-836b-70aff00c4df0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:11.141130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:11.142662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:11.144404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:11.144404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:11.144404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:11.144404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:11.144404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:11.144404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:11.144404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:11.144404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:11.144404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:05:11.144404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:11.144404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 307/643] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:05:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:11.144404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3debf8b-690f-47aa-941b-67c73d9d543c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:11.144404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3debf8b-690f-47aa-941b-67c73d9d543c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:11.145227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3debf8b-690f-47aa-941b-67c73d9d543c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:11.162165 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b3debf8b-690f-47aa-941b-67c73d9d543c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:11.163848 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b3debf8b-690f-47aa-941b-67c73d9d543c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:11.197958 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:11.227448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6093f-bcb9-43c0-9612-feac217b3d7b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:11.242353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 308/644] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:05:11.244172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3debf8b-690f-47aa-941b-67c73d9d543c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:11.273723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0803051-34d7-4a56-b55d-756277751eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:11.274398 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0803051-34d7-4a56-b55d-756277751eba None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:11.274680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0803051-34d7-4a56-b55d-756277751eba None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:11.274999 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0803051-34d7-4a56-b55d-756277751eba None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:11.275737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0803051-34d7-4a56-b55d-756277751eba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:11.276080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0803051-34d7-4a56-b55d-756277751eba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:11.277510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0803051-34d7-4a56-b55d-756277751eba None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:11.294523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 337/645] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:11.294523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0803051-34d7-4a56-b55d-756277751eba None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:11.327224 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:11.356186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3debf8b-690f-47aa-941b-67c73d9d543c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:11.389817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de4fd8-124d-4c65-8539-b1fb65279d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:11.390416 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de4fd8-124d-4c65-8539-b1fb65279d25 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:11.390706 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de4fd8-124d-4c65-8539-b1fb65279d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:11.390983 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de4fd8-124d-4c65-8539-b1fb65279d25 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:11.392297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de4fd8-124d-4c65-8539-b1fb65279d25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:11.392607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de4fd8-124d-4c65-8539-b1fb65279d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:11.393975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de4fd8-124d-4c65-8539-b1fb65279d25 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:11.399151 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0803051-34d7-4a56-b55d-756277751eba None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:11.406470 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 309/646] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:05:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:11.406470 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de4fd8-124d-4c65-8539-b1fb65279d25 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:11.434883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:11.435815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7310424-29e5-4a7c-8b99-d07673b3e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:11.436533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7310424-29e5-4a7c-8b99-d07673b3e62f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:11.436819 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7310424-29e5-4a7c-8b99-d07673b3e62f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:11.437086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7310424-29e5-4a7c-8b99-d07673b3e62f None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:11.437919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7310424-29e5-4a7c-8b99-d07673b3e62f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:11.438255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7310424-29e5-4a7c-8b99-d07673b3e62f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:11.439699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7310424-29e5-4a7c-8b99-d07673b3e62f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:11.464256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 338/647] 10.222.0.74 () {56 vars in 1137 bytes} [Thu Jul 14 10:05:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:11.464256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7310424-29e5-4a7c-8b99-d07673b3e62f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:11.516121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de4fd8-124d-4c65-8539-b1fb65279d25 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:11.551791 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3e75c-43cc-4e58-943a-e92ed7ab1689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:11.552627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3e75c-43cc-4e58-943a-e92ed7ab1689 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:11.552907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3e75c-43cc-4e58-943a-e92ed7ab1689 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:11.553178 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3e75c-43cc-4e58-943a-e92ed7ab1689 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:11.555787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:11.565159 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3e75c-43cc-4e58-943a-e92ed7ab1689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:11.568137 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7310424-29e5-4a7c-8b99-d07673b3e62f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-65a3e75c-43cc-4e58-943a-e92ed7ab1689 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:11.573235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:11.574354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:11.581125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:11.581125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:11.581125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:11.581125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:11.581125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:11.581125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:11.581125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:11.581125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:11.581125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:11.581125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:11.581125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:11.581125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:11.581125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 310/648] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:11.581125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3e75c-43cc-4e58-943a-e92ed7ab1689 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:11.610310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138180bd-9ed9-4874-bc0e-50de3ca19b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:11.611302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138180bd-9ed9-4874-bc0e-50de3ca19b17 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:11.611648 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138180bd-9ed9-4874-bc0e-50de3ca19b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:11.611988 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138180bd-9ed9-4874-bc0e-50de3ca19b17 None admin] PATH_INFO: `/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/323279b7ad0c418b848d6d7ae26ec5d2/roles/feef3a85c1c0446590c2671a9f266cf4` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:11.627539 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138180bd-9ed9-4874-bc0e-50de3ca19b17 None admin] RBAC: Authorizing `identity:create_grant(project_id=795b6593e7b74eeda9929aba07cbaa0e, user_id=323279b7ad0c418b848d6d7ae26ec5d2, role_id=feef3a85c1c0446590c2671a9f266cf4)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:11.629217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138180bd-9ed9-4874-bc0e-50de3ca19b17 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:11.667974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:11.680083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3e75c-43cc-4e58-943a-e92ed7ab1689 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:11.712038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440fc53-c6fe-48ac-a191-f0dac237da6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:11.712831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440fc53-c6fe-48ac-a191-f0dac237da6a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:11.713116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440fc53-c6fe-48ac-a191-f0dac237da6a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:11.713393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440fc53-c6fe-48ac-a191-f0dac237da6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:11.725040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440fc53-c6fe-48ac-a191-f0dac237da6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:11.726544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440fc53-c6fe-48ac-a191-f0dac237da6a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:11.732367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 339/649] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:05:11 2022] PUT /identity/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/323279b7ad0c418b848d6d7ae26ec5d2/roles/feef3a85c1c0446590c2671a9f266cf4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:05:11.733419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138180bd-9ed9-4874-bc0e-50de3ca19b17 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-7440fc53-c6fe-48ac-a191-f0dac237da6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:11.746674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:11.747642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:11.749078 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:11.749078 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:11.749078 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:11.749078 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:11.752670 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 311/650] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:11.753431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440fc53-c6fe-48ac-a191-f0dac237da6a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:11.901389 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138180bd-9ed9-4874-bc0e-50de3ca19b17 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:11.901616 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440fc53-c6fe-48ac-a191-f0dac237da6a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:11.943907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fa145-3b4d-4c99-8d07-9933d13157aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:11.944574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fa145-3b4d-4c99-8d07-9933d13157aa None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:11.944859 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fa145-3b4d-4c99-8d07-9933d13157aa None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:11.945155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fa145-3b4d-4c99-8d07-9933d13157aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:11.946294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ac0e9-0a01-4560-a15f-ca6e4d6ed4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:11.946968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ac0e9-0a01-4560-a15f-ca6e4d6ed4dc None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:11.947251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ac0e9-0a01-4560-a15f-ca6e4d6ed4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:11.947525 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ac0e9-0a01-4560-a15f-ca6e4d6ed4dc None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:11.948740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ac0e9-0a01-4560-a15f-ca6e4d6ed4dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:11.951566 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ac0e9-0a01-4560-a15f-ca6e4d6ed4dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:11.953080 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ac0e9-0a01-4560-a15f-ca6e4d6ed4dc None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:11.958040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:11.972017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 312/651] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:05:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:11.972017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ac0e9-0a01-4560-a15f-ca6e4d6ed4dc None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:11.982246 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:12.024771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fa145-3b4d-4c99-8d07-9933d13157aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:12.026489 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fa145-3b4d-4c99-8d07-9933d13157aa None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:12.096034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ac0e9-0a01-4560-a15f-ca6e4d6ed4dc None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:12.133675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f7d8d-23c2-414b-9390-daedc424dd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:12.134339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f7d8d-23c2-414b-9390-daedc424dd61 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:12.134622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f7d8d-23c2-414b-9390-daedc424dd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:12.134898 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f7d8d-23c2-414b-9390-daedc424dd61 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:12.135891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f7d8d-23c2-414b-9390-daedc424dd61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:12.136233 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f7d8d-23c2-414b-9390-daedc424dd61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:12.137995 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f7d8d-23c2-414b-9390-daedc424dd61 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:12.160210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 313/653] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:12.160210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f7d8d-23c2-414b-9390-daedc424dd61 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:12.160706 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 340/653] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:05:12.164716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fa145-3b4d-4c99-8d07-9933d13157aa None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:12.216593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:12.230261 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:12.276849 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f7d8d-23c2-414b-9390-daedc424dd61 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:12.299494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fa145-3b4d-4c99-8d07-9933d13157aa None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:12.323316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfee889-fa42-4013-b5d4-03262a1e29bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:12.324533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfee889-fa42-4013-b5d4-03262a1e29bf None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:12.325105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfee889-fa42-4013-b5d4-03262a1e29bf None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:12.325623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfee889-fa42-4013-b5d4-03262a1e29bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:12.337734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320910a8-c81f-4f4b-b383-8bf00af9b9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:12.338544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320910a8-c81f-4f4b-b383-8bf00af9b9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:12.338755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfee889-fa42-4013-b5d4-03262a1e29bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:12.338857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320910a8-c81f-4f4b-b383-8bf00af9b9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:12.339092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320910a8-c81f-4f4b-b383-8bf00af9b9a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:12.340992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfee889-fa42-4013-b5d4-03262a1e29bf None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:12.349984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320910a8-c81f-4f4b-b383-8bf00af9b9a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:12.351438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320910a8-c81f-4f4b-b383-8bf00af9b9a4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3cfee889-fa42-4013-b5d4-03262a1e29bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:12.360632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:12.361609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:12.362520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:12.362520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:12.362520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:12.362520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:12.369223 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 314/654] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-320910a8-c81f-4f4b-b383-8bf00af9b9a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:12.369588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:12.370428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:12.371317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:12.371317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:12.371317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:12.371317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:12.372688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfee889-fa42-4013-b5d4-03262a1e29bf None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:12.375297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 341/655] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:12.376669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320910a8-c81f-4f4b-b383-8bf00af9b9a4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:12.473606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:12.482376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320910a8-c81f-4f4b-b383-8bf00af9b9a4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:12.485853 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfee889-fa42-4013-b5d4-03262a1e29bf None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:12.501627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:12.521188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d97675-9aa6-4d47-82b9-d01fea550d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:12.529602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d97675-9aa6-4d47-82b9-d01fea550d62 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:12.529602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d97675-9aa6-4d47-82b9-d01fea550d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:12.529602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d97675-9aa6-4d47-82b9-d01fea550d62 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:12.529602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d97675-9aa6-4d47-82b9-d01fea550d62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:12.529602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d97675-9aa6-4d47-82b9-d01fea550d62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:12.529602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d97675-9aa6-4d47-82b9-d01fea550d62 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:12.530043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f4bd6-7ac4-4d8f-a53b-94ebcdce1c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:12.530043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f4bd6-7ac4-4d8f-a53b-94ebcdce1c67 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:12.530043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f4bd6-7ac4-4d8f-a53b-94ebcdce1c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:12.530043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f4bd6-7ac4-4d8f-a53b-94ebcdce1c67 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:12.535286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f4bd6-7ac4-4d8f-a53b-94ebcdce1c67 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:12.537226 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f4bd6-7ac4-4d8f-a53b-94ebcdce1c67 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:12.542005 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 342/656] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:12.542005 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d97675-9aa6-4d47-82b9-d01fea550d62 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-f94f4bd6-7ac4-4d8f-a53b-94ebcdce1c67 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:12.559524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:12.560595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:12.561572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:12.561572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:12.561572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:12.561572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:12.561572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:12.561572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:12.561572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:12.561572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:12.561572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:05:12.561572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:12.569327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 315/657] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:05:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:12.570423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f4bd6-7ac4-4d8f-a53b-94ebcdce1c67 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:12.649101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d97675-9aa6-4d47-82b9-d01fea550d62 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:12.681258 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f4bd6-7ac4-4d8f-a53b-94ebcdce1c67 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:12.685243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4cc40-b557-4cc0-afb2-78890c5df39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:12.686000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4cc40-b557-4cc0-afb2-78890c5df39e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:12.686358 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4cc40-b557-4cc0-afb2-78890c5df39e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:12.686728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4cc40-b557-4cc0-afb2-78890c5df39e None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:12.687523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4cc40-b557-4cc0-afb2-78890c5df39e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:12.687905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4cc40-b557-4cc0-afb2-78890c5df39e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:12.689948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4cc40-b557-4cc0-afb2-78890c5df39e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:12.707533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 343/658] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:12.708542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4cc40-b557-4cc0-afb2-78890c5df39e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:12.723011 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3cfe9-c175-4053-9895-0c854ef27da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:12.724415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:12.724811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3cfe9-c175-4053-9895-0c854ef27da8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:12.726189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3cfe9-c175-4053-9895-0c854ef27da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:12.726664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3cfe9-c175-4053-9895-0c854ef27da8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:12.734739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3cfe9-c175-4053-9895-0c854ef27da8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:12.736606 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3cfe9-c175-4053-9895-0c854ef27da8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-a1e3cfe9-c175-4053-9895-0c854ef27da8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:12.753180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:12.754158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:12.755479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:12.755479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:12.755479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:12.755479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:12.755479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:12.755479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:12.755479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:12.755479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:12.755479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:05:12.755479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:12.762494 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 316/659] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:12.763590 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3cfe9-c175-4053-9895-0c854ef27da8 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:12.801523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:12.816982 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4cc40-b557-4cc0-afb2-78890c5df39e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:12.855295 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ae1ac-09e0-44a6-8a98-22b046bb6eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:12.856141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ae1ac-09e0-44a6-8a98-22b046bb6eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:12.856440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ae1ac-09e0-44a6-8a98-22b046bb6eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:12.856718 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ae1ac-09e0-44a6-8a98-22b046bb6eb8 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:12.857863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ae1ac-09e0-44a6-8a98-22b046bb6eb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:12.858825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ae1ac-09e0-44a6-8a98-22b046bb6eb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:12.861345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ae1ac-09e0-44a6-8a98-22b046bb6eb8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:12.872430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3cfe9-c175-4053-9895-0c854ef27da8 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:12.883436 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 344/660] 10.222.0.74 () {56 vars in 1137 bytes} [Thu Jul 14 10:05:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:12.884301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ae1ac-09e0-44a6-8a98-22b046bb6eb8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:12.915596 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a6035-1f0f-443d-bd61-3e1915876cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:12.916418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a6035-1f0f-443d-bd61-3e1915876cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:12.916703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a6035-1f0f-443d-bd61-3e1915876cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:12.916984 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a6035-1f0f-443d-bd61-3e1915876cd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:12.923906 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a6035-1f0f-443d-bd61-3e1915876cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:12.925405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a6035-1f0f-443d-bd61-3e1915876cd3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-2f1a6035-1f0f-443d-bd61-3e1915876cd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:12.939122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:12.940062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:12.941101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:12.941101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:12.941101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:12.941101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:12.941101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:12.941101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:12.941101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:12.941101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:12.941101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 317/661] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:12.941863 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458031e-3a49-4a86-a963-c84feb82a0f4 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:12.942148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458031e-3a49-4a86-a963-c84feb82a0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:12.942427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458031e-3a49-4a86-a963-c84feb82a0f4 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:12.943817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 318/662] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:12.948252 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458031e-3a49-4a86-a963-c84feb82a0f4 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:12.968655 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:13.003396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ae1ac-09e0-44a6-8a98-22b046bb6eb8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:13.040175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862f9f3-0bd9-48d1-93b2-e2667018ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:13.041062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862f9f3-0bd9-48d1-93b2-e2667018ddca None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:13.041510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862f9f3-0bd9-48d1-93b2-e2667018ddca None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:13.041994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862f9f3-0bd9-48d1-93b2-e2667018ddca None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:13.043009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862f9f3-0bd9-48d1-93b2-e2667018ddca None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:13.043463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862f9f3-0bd9-48d1-93b2-e2667018ddca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:13.045056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:13.045215 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862f9f3-0bd9-48d1-93b2-e2667018ddca None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:13.055096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458031e-3a49-4a86-a963-c84feb82a0f4 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:13.076500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 345/663] 10.222.0.74 () {56 vars in 1139 bytes} [Thu Jul 14 10:05:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:13.077112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862f9f3-0bd9-48d1-93b2-e2667018ddca None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:13.092180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb013d88-e349-467f-be17-cf33ae874b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:13.092833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013d88-e349-467f-be17-cf33ae874b37 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:13.093113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013d88-e349-467f-be17-cf33ae874b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:13.093387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013d88-e349-467f-be17-cf33ae874b37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:13.162945 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb013d88-e349-467f-be17-cf33ae874b37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:13.164426 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb013d88-e349-467f-be17-cf33ae874b37 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:13.180671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862f9f3-0bd9-48d1-93b2-e2667018ddca None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:13.209858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:13.218156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3b12f-3bb3-44fb-9b78-4615d2b96473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:13.218973 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3b12f-3bb3-44fb-9b78-4615d2b96473 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:13.219261 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3b12f-3bb3-44fb-9b78-4615d2b96473 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:13.220084 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3b12f-3bb3-44fb-9b78-4615d2b96473 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:13.225554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3b12f-3bb3-44fb-9b78-4615d2b96473 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:13.225554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3b12f-3bb3-44fb-9b78-4615d2b96473 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:13.225554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3b12f-3bb3-44fb-9b78-4615d2b96473 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:13.239285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 346/664] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:13.239285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb27edd-a544-40b8-8e4d-6dcba1832c1a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:13.239285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb27edd-a544-40b8-8e4d-6dcba1832c1a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:13.239285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb27edd-a544-40b8-8e4d-6dcba1832c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:13.255255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4cb27edd-a544-40b8-8e4d-6dcba1832c1a None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:13.256505 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4cb27edd-a544-40b8-8e4d-6dcba1832c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:13.265563 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:13.274151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 319/665] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:05:13.277090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb013d88-e349-467f-be17-cf33ae874b37 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:13.338492 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 347/666] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:05:13.339663 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb27edd-a544-40b8-8e4d-6dcba1832c1a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:13.397461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb013d88-e349-467f-be17-cf33ae874b37 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:13.433416 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e51279-a1e6-4ba8-831a-bb58444f8cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:13.434059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e51279-a1e6-4ba8-831a-bb58444f8cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:13.434447 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e51279-a1e6-4ba8-831a-bb58444f8cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:13.434721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e51279-a1e6-4ba8-831a-bb58444f8cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:13.450099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb27edd-a544-40b8-8e4d-6dcba1832c1a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:13.467128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:13.483273 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228a56c-af13-4dcd-85cd-74d9e666f585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:13.484150 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228a56c-af13-4dcd-85cd-74d9e666f585 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:13.501342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228a56c-af13-4dcd-85cd-74d9e666f585 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:13.501342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228a56c-af13-4dcd-85cd-74d9e666f585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:13.501342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228a56c-af13-4dcd-85cd-74d9e666f585 None admin] RBAC: Adding query filter params (role.id=feef3a85c1c0446590c2671a9f266cf4, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=12abc4b2a8d348d992e0bb00a1218929) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:13.501342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228a56c-af13-4dcd-85cd-74d9e666f585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:13.501342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228a56c-af13-4dcd-85cd-74d9e666f585 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:13.501852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 348/667] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:13 2022] GET /identity/v3/role_assignments?user.id=12abc4b2a8d348d992e0bb00a1218929&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=feef3a85c1c0446590c2671a9f266cf4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:13.501852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228a56c-af13-4dcd-85cd-74d9e666f585 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:13.512737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:13.522381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e51279-a1e6-4ba8-831a-bb58444f8cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:13.524165 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e51279-a1e6-4ba8-831a-bb58444f8cf3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:13.609403 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228a56c-af13-4dcd-85cd-74d9e666f585 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:13.642857 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 320/668] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:05:13.644350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e51279-a1e6-4ba8-831a-bb58444f8cf3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:13.651130 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc221c0-e2da-4403-b645-51bfb6511cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:13.651954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc221c0-e2da-4403-b645-51bfb6511cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:13.652269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc221c0-e2da-4403-b645-51bfb6511cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:13.652544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc221c0-e2da-4403-b645-51bfb6511cd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:13.667613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc221c0-e2da-4403-b645-51bfb6511cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:13.669175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc221c0-e2da-4403-b645-51bfb6511cd9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-8cc221c0-e2da-4403-b645-51bfb6511cd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:13.689345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:13.690370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:13.691278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:13.691278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:13.691278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:13.691278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:13.697565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 349/669] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:13.697565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc221c0-e2da-4403-b645-51bfb6511cd9 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:13.742186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:13.763162 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:13.770402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e51279-a1e6-4ba8-831a-bb58444f8cf3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:13.807840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f19a2-509d-4e40-82c1-0a77b3ab5be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:13.808821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f19a2-509d-4e40-82c1-0a77b3ab5be6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:13.809351 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f19a2-509d-4e40-82c1-0a77b3ab5be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:13.809729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f19a2-509d-4e40-82c1-0a77b3ab5be6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:13.832023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f19a2-509d-4e40-82c1-0a77b3ab5be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:13.832211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc221c0-e2da-4403-b645-51bfb6511cd9 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-ea4f19a2-509d-4e40-82c1-0a77b3ab5be6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:13.834809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:13.835883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:13.836785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:13.836785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:13.836785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:13.836785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:13.836785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:13.836785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:13.836785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:13.836785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:13.836785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:13.836785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:13.836785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:05:13.836785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:13.837448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 321/670] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:05:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:13.838430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f19a2-509d-4e40-82c1-0a77b3ab5be6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:13.870188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054cd82-6129-4eef-8005-8694e0d2f19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:13.870989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054cd82-6129-4eef-8005-8694e0d2f19d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:13.871275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054cd82-6129-4eef-8005-8694e0d2f19d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:13.871552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054cd82-6129-4eef-8005-8694e0d2f19d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:13.882090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054cd82-6129-4eef-8005-8694e0d2f19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:13.883548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054cd82-6129-4eef-8005-8694e0d2f19d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-9054cd82-6129-4eef-8005-8694e0d2f19d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:13.900717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:13.901664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:13.902591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:13.902591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:13.902591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:13.902591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:13.904144 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 350/671] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:13.905444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054cd82-6129-4eef-8005-8694e0d2f19d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:13.957336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f19a2-509d-4e40-82c1-0a77b3ab5be6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:13.993730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5c8b7-0874-4e03-a15a-2017fb5f5b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:13.994400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c8b7-0874-4e03-a15a-2017fb5f5b25 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:13.994685 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c8b7-0874-4e03-a15a-2017fb5f5b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:13.994960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c8b7-0874-4e03-a15a-2017fb5f5b25 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:13.995687 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5c8b7-0874-4e03-a15a-2017fb5f5b25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:13.996017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5c8b7-0874-4e03-a15a-2017fb5f5b25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:13.997389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5c8b7-0874-4e03-a15a-2017fb5f5b25 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:14.002170 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:14.010378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 322/672] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:14.013889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a819d4-d00f-4a94-a1cc-39ac0acc51ec None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:14.013889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a819d4-d00f-4a94-a1cc-39ac0acc51ec None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:14.013889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a819d4-d00f-4a94-a1cc-39ac0acc51ec None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:14.013889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 323/673] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:14.014412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a819d4-d00f-4a94-a1cc-39ac0acc51ec None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:14.023341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054cd82-6129-4eef-8005-8694e0d2f19d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:14.032909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:14.067521 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab75b59-285a-4d40-9558-023dcda4caf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:14.068393 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab75b59-285a-4d40-9558-023dcda4caf2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:14.068681 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab75b59-285a-4d40-9558-023dcda4caf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:14.068958 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab75b59-285a-4d40-9558-023dcda4caf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:14.069711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab75b59-285a-4d40-9558-023dcda4caf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:14.070017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab75b59-285a-4d40-9558-023dcda4caf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:14.071490 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab75b59-285a-4d40-9558-023dcda4caf2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:14.088841 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 351/674] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:05:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:14.088841 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab75b59-285a-4d40-9558-023dcda4caf2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:14.127424 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a819d4-d00f-4a94-a1cc-39ac0acc51ec None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:14.166307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e2bf8-2a40-4a5c-8dba-2cba2214208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:14.166973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2bf8-2a40-4a5c-8dba-2cba2214208d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:14.167258 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2bf8-2a40-4a5c-8dba-2cba2214208d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:14.167647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2bf8-2a40-4a5c-8dba-2cba2214208d None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:14.168524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e2bf8-2a40-4a5c-8dba-2cba2214208d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:14.168827 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e2bf8-2a40-4a5c-8dba-2cba2214208d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:14.170187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e2bf8-2a40-4a5c-8dba-2cba2214208d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:14.183765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 324/675] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:14.185085 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedb7dc-cd56-4f99-b2f1-37a02aebfc26 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:14.185373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedb7dc-cd56-4f99-b2f1-37a02aebfc26 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:14.185727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedb7dc-cd56-4f99-b2f1-37a02aebfc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:14.192412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab75b59-285a-4d40-9558-023dcda4caf2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:14.202006 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-fdedb7dc-cd56-4f99-b2f1-37a02aebfc26 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:14.203320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-fdedb7dc-cd56-4f99-b2f1-37a02aebfc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:14.231022 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c51429-2ee4-49c0-b495-c2fb6d23e828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:14.231821 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c51429-2ee4-49c0-b495-c2fb6d23e828 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:14.232133 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c51429-2ee4-49c0-b495-c2fb6d23e828 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:14.232408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c51429-2ee4-49c0-b495-c2fb6d23e828 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:14.240269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c51429-2ee4-49c0-b495-c2fb6d23e828 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:14.241764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c51429-2ee4-49c0-b495-c2fb6d23e828 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-36c51429-2ee4-49c0-b495-c2fb6d23e828 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:14.257440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:14.258360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:14.259250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:14.259250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:14.259250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:14.259250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:14.259250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:14.259250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:14.259250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:14.259250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:14.259250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 352/676] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:14.260428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c51429-2ee4-49c0-b495-c2fb6d23e828 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:14.271976 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:14.288023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 325/677] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:05:14.288023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedb7dc-cd56-4f99-b2f1-37a02aebfc26 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:14.288023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:14.373088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c51429-2ee4-49c0-b495-c2fb6d23e828 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:14.386721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedb7dc-cd56-4f99-b2f1-37a02aebfc26 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:14.411598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7adb6-6c6d-490e-8c8b-94134e74bfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:14.412428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7adb6-6c6d-490e-8c8b-94134e74bfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:14.412710 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7adb6-6c6d-490e-8c8b-94134e74bfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:14.413034 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7adb6-6c6d-490e-8c8b-94134e74bfb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:14.421847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5b1ef-c1bf-4bf4-a857-701632e09e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:14.422667 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b1ef-c1bf-4bf4-a857-701632e09e14 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:14.422951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b1ef-c1bf-4bf4-a857-701632e09e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:14.423229 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b1ef-c1bf-4bf4-a857-701632e09e14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:14.424318 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7adb6-6c6d-490e-8c8b-94134e74bfb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:14.426206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7adb6-6c6d-490e-8c8b-94134e74bfb4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:14.429864 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5b1ef-c1bf-4bf4-a857-701632e09e14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:14.431294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5b1ef-c1bf-4bf4-a857-701632e09e14 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-41c7adb6-6c6d-490e-8c8b-94134e74bfb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:14.444723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:14.445779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:14.446889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:14.446889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:14.446889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:14.446889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-10a5b1ef-c1bf-4bf4-a857-701632e09e14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:14.447146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:14.448151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:14.449305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:14.449305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:14.449305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:14.449305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:14.449305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:14.449305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:14.449305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:14.449305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:14.450803 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 326/678] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:14.451476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 353/679] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:14.451634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5b1ef-c1bf-4bf4-a857-701632e09e14 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:14.452688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7adb6-6c6d-490e-8c8b-94134e74bfb4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:14.519350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:14.520786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:14.560651 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7adb6-6c6d-490e-8c8b-94134e74bfb4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:14.562939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5b1ef-c1bf-4bf4-a857-701632e09e14 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:14.599659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78a88c-3b12-49c2-a9f2-4b83eeb0661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:14.600211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95ccdc-7de3-4a9b-867b-4e05efead7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:14.600344 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78a88c-3b12-49c2-a9f2-4b83eeb0661f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:14.600808 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78a88c-3b12-49c2-a9f2-4b83eeb0661f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:14.600923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78a88c-3b12-49c2-a9f2-4b83eeb0661f None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:14.601141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95ccdc-7de3-4a9b-867b-4e05efead7fb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:14.601333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95ccdc-7de3-4a9b-867b-4e05efead7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:14.601601 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95ccdc-7de3-4a9b-867b-4e05efead7fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:14.601696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78a88c-3b12-49c2-a9f2-4b83eeb0661f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:14.601955 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78a88c-3b12-49c2-a9f2-4b83eeb0661f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:14.603462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78a88c-3b12-49c2-a9f2-4b83eeb0661f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:14.612449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95ccdc-7de3-4a9b-867b-4e05efead7fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:14.620963 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 327/680] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:14.620963 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78a88c-3b12-49c2-a9f2-4b83eeb0661f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-8e95ccdc-7de3-4a9b-867b-4e05efead7fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:14.621204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:14.622824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:14.623793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:14.623793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:14.623793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:14.623793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:14.623793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:14.623793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:14.623793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:14.623793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:14.623793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:14.623793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:14.623793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:14.623793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:14.623793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 354/681] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:14.623793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95ccdc-7de3-4a9b-867b-4e05efead7fb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:14.738590 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95ccdc-7de3-4a9b-867b-4e05efead7fb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:14.739302 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78a88c-3b12-49c2-a9f2-4b83eeb0661f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:14.760275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:14.765642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:14.774648 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e1d5c-7698-4af2-ac1b-ea2351327288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:14.775543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e1d5c-7698-4af2-ac1b-ea2351327288 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:14.775987 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e1d5c-7698-4af2-ac1b-ea2351327288 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:14.776117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8debb31-65eb-4a9f-9162-5c66a232ef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:14.776654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e1d5c-7698-4af2-ac1b-ea2351327288 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:14.776767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8debb31-65eb-4a9f-9162-5c66a232ef87 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:14.776959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8debb31-65eb-4a9f-9162-5c66a232ef87 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:14.777233 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8debb31-65eb-4a9f-9162-5c66a232ef87 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:14.778014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8debb31-65eb-4a9f-9162-5c66a232ef87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:14.778280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e1d5c-7698-4af2-ac1b-ea2351327288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:14.778380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8debb31-65eb-4a9f-9162-5c66a232ef87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:14.778860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e1d5c-7698-4af2-ac1b-ea2351327288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:14.779724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8debb31-65eb-4a9f-9162-5c66a232ef87 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:14.780695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e1d5c-7698-4af2-ac1b-ea2351327288 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:14.792063 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 328/682] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:14.792956 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8debb31-65eb-4a9f-9162-5c66a232ef87 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:14.793899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 355/683] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:14.794889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e1d5c-7698-4af2-ac1b-ea2351327288 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:14.902251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8debb31-65eb-4a9f-9162-5c66a232ef87 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:14.903423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e1d5c-7698-4af2-ac1b-ea2351327288 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:14.938246 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76ae7d-5f41-4cfc-b73d-e27ae0e59869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:14.938419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cbae3-0771-427b-a592-a092002a80c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:14.938897 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76ae7d-5f41-4cfc-b73d-e27ae0e59869 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:14.939003 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cbae3-0771-427b-a592-a092002a80c3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:14.939212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cbae3-0771-427b-a592-a092002a80c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:14.939310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76ae7d-5f41-4cfc-b73d-e27ae0e59869 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:14.939459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cbae3-0771-427b-a592-a092002a80c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:14.939552 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76ae7d-5f41-4cfc-b73d-e27ae0e59869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:14.940210 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cbae3-0771-427b-a592-a092002a80c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:14.940326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76ae7d-5f41-4cfc-b73d-e27ae0e59869 None admin] RBAC: Adding query filter params (role.id=feef3a85c1c0446590c2671a9f266cf4, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=397a66eb12254a65bf05bc9fff9a868e) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:14.940514 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cbae3-0771-427b-a592-a092002a80c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:14.940610 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76ae7d-5f41-4cfc-b73d-e27ae0e59869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:14.941872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cbae3-0771-427b-a592-a092002a80c3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:14.941985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76ae7d-5f41-4cfc-b73d-e27ae0e59869 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:14.948118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 329/684] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:14 2022] GET /identity/v3/role_assignments?user.id=397a66eb12254a65bf05bc9fff9a868e&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=feef3a85c1c0446590c2671a9f266cf4 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:14.948705 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76ae7d-5f41-4cfc-b73d-e27ae0e59869 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:14.972031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 356/685] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:05:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:14.972031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cbae3-0771-427b-a592-a092002a80c3 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:15.025145 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:15.026060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:15.087842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cbae3-0771-427b-a592-a092002a80c3 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:15.098334 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76ae7d-5f41-4cfc-b73d-e27ae0e59869 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:15.127611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840c077-7574-4888-af06-f377b7e8ca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:15.128828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840c077-7574-4888-af06-f377b7e8ca2f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:15.129111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840c077-7574-4888-af06-f377b7e8ca2f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:15.129383 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840c077-7574-4888-af06-f377b7e8ca2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:15.138600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840c077-7574-4888-af06-f377b7e8ca2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:15.140122 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840c077-7574-4888-af06-f377b7e8ca2f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:15.141003 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb59c84-8468-47e0-ab79-8cf72e6cda1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:15.142203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59c84-8468-47e0-ab79-8cf72e6cda1c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:15.142483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59c84-8468-47e0-ab79-8cf72e6cda1c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:15.142754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59c84-8468-47e0-ab79-8cf72e6cda1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:15.143772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb59c84-8468-47e0-ab79-8cf72e6cda1c None admin] RBAC: Adding query filter params (role.id=feef3a85c1c0446590c2671a9f266cf4, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=bf41e7a4968e4ab9bce98f6e1c050b4c) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:15.144577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb59c84-8468-47e0-ab79-8cf72e6cda1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:15.146024 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb59c84-8468-47e0-ab79-8cf72e6cda1c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:15.153045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 330/686] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:14 2022] GET /identity/v3/role_assignments?user.id=bf41e7a4968e4ab9bce98f6e1c050b4c&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=feef3a85c1c0446590c2671a9f266cf4 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:15.153806 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb59c84-8468-47e0-ab79-8cf72e6cda1c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-f840c077-7574-4888-af06-f377b7e8ca2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:15.158189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:15.159177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:15.161448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:15.161448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:15.161448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:15.161448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:15.161448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:15.161448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:15.161448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:15.161448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:15.161448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:05:15.161448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:15.166847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 357/687] 10.222.0.74 () {56 vars in 1093 bytes} [Thu Jul 14 10:05:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:15.166847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840c077-7574-4888-af06-f377b7e8ca2f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:15.292359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb59c84-8468-47e0-ab79-8cf72e6cda1c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:15.294791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840c077-7574-4888-af06-f377b7e8ca2f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:15.304759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:15.308247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:15.334199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92081f-1e40-4886-8ebe-d8baf6f0b979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:15.334993 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92081f-1e40-4886-8ebe-d8baf6f0b979 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:15.335272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92081f-1e40-4886-8ebe-d8baf6f0b979 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:15.335729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92081f-1e40-4886-8ebe-d8baf6f0b979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:15.341916 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f4185-ee1c-4945-9263-31b267421464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:15.342958 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f4185-ee1c-4945-9263-31b267421464 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:15.342958 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f4185-ee1c-4945-9263-31b267421464 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:15.343143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f4185-ee1c-4945-9263-31b267421464 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:15.344217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f4185-ee1c-4945-9263-31b267421464 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:15.344549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f4185-ee1c-4945-9263-31b267421464 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:15.345996 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f4185-ee1c-4945-9263-31b267421464 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:15.350866 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92081f-1e40-4886-8ebe-d8baf6f0b979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:15.352364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92081f-1e40-4886-8ebe-d8baf6f0b979 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:15.369708 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 358/688] 10.222.0.74 () {56 vars in 1133 bytes} [Thu Jul 14 10:05:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:15.374843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f4185-ee1c-4945-9263-31b267421464 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-dc92081f-1e40-4886-8ebe-d8baf6f0b979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:15.376648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:15.377549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:15.378458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:15.378458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:15.378458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:15.378458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:15.378458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 331/689] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:15.389373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92081f-1e40-4886-8ebe-d8baf6f0b979 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:15.501767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f4185-ee1c-4945-9263-31b267421464 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:15.520140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92081f-1e40-4886-8ebe-d8baf6f0b979 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:15.539213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8300b2-feaa-42c4-be10-0f01a7432f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:15.540100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8300b2-feaa-42c4-be10-0f01a7432f4d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:15.540456 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8300b2-feaa-42c4-be10-0f01a7432f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:15.540799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8300b2-feaa-42c4-be10-0f01a7432f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:15.556940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceb725-a4d3-477a-9b5c-bae40c456cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:15.557612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb725-a4d3-477a-9b5c-bae40c456cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:15.557898 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb725-a4d3-477a-9b5c-bae40c456cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:15.558177 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb725-a4d3-477a-9b5c-bae40c456cc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:15.558904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceb725-a4d3-477a-9b5c-bae40c456cc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:15.559210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceb725-a4d3-477a-9b5c-bae40c456cc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:15.560795 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceb725-a4d3-477a-9b5c-bae40c456cc7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:15.574045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 332/690] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:15.579966 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceb725-a4d3-477a-9b5c-bae40c456cc7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:15.580701 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:15.616851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8300b2-feaa-42c4-be10-0f01a7432f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:15.618555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8300b2-feaa-42c4-be10-0f01a7432f4d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:15.620191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:15.732042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 359/691] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:05:15.736047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538ad7-3689-4053-8da9-a464b1045fea None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:15.736047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538ad7-3689-4053-8da9-a464b1045fea None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:15.736047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538ad7-3689-4053-8da9-a464b1045fea None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:15.736325 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 360/692] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:15.741704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47aa6b8-8920-4110-aeb2-b506dfb9a9ed None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:15.742291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47aa6b8-8920-4110-aeb2-b506dfb9a9ed None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:15.742646 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47aa6b8-8920-4110-aeb2-b506dfb9a9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:15.744770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceb725-a4d3-477a-9b5c-bae40c456cc7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:15.767539 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c47aa6b8-8920-4110-aeb2-b506dfb9a9ed None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:15.769323 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c47aa6b8-8920-4110-aeb2-b506dfb9a9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:15.783759 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370986aa-89a7-4085-97cb-3d685c451108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:15.784874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370986aa-89a7-4085-97cb-3d685c451108 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:15.785690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370986aa-89a7-4085-97cb-3d685c451108 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:15.786140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370986aa-89a7-4085-97cb-3d685c451108 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:15.794488 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370986aa-89a7-4085-97cb-3d685c451108 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:15.796283 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370986aa-89a7-4085-97cb-3d685c451108 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-370986aa-89a7-4085-97cb-3d685c451108 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:15.813828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:15.814799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:15.815745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:15.815745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:15.815745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:15.815745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:15.815745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:15.815745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:15.815745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:15.815745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:15.815745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:05:15.815745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:15.817874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 333/693] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:05:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:15.818942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370986aa-89a7-4085-97cb-3d685c451108 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:15.848436 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:15.857822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 361/694] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:05:15.858848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47aa6b8-8920-4110-aeb2-b506dfb9a9ed None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:15.934905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:15.957688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370986aa-89a7-4085-97cb-3d685c451108 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:15.983324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47aa6b8-8920-4110-aeb2-b506dfb9a9ed None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:16.004778 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585b10a-0eb8-43ed-8a40-ae1c2ca50b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:16.006382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585b10a-0eb8-43ed-8a40-ae1c2ca50b0e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:16.007082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585b10a-0eb8-43ed-8a40-ae1c2ca50b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:16.007509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585b10a-0eb8-43ed-8a40-ae1c2ca50b0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:16.020154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292835d-675b-4b93-923d-7f9571a970d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:16.020797 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292835d-675b-4b93-923d-7f9571a970d2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:16.021009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292835d-675b-4b93-923d-7f9571a970d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:16.021344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292835d-675b-4b93-923d-7f9571a970d2 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:16.021994 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585b10a-0eb8-43ed-8a40-ae1c2ca50b0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:16.022178 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292835d-675b-4b93-923d-7f9571a970d2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:16.022570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292835d-675b-4b93-923d-7f9571a970d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:16.023909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585b10a-0eb8-43ed-8a40-ae1c2ca50b0e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:16.024045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292835d-675b-4b93-923d-7f9571a970d2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3585b10a-0eb8-43ed-8a40-ae1c2ca50b0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:16.046602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:16.048560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:16.049815 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:16.049815 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:16.049815 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:16.049815 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:16.050840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 334/695] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:16.051443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 362/696] 10.222.0.74 () {56 vars in 1135 bytes} [Thu Jul 14 10:05:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:16.056225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585b10a-0eb8-43ed-8a40-ae1c2ca50b0e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:16.056371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292835d-675b-4b93-923d-7f9571a970d2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:16.112473 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:16.165901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292835d-675b-4b93-923d-7f9571a970d2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:16.181388 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585b10a-0eb8-43ed-8a40-ae1c2ca50b0e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:16.201818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3841dcd-64c6-49f0-bb60-9a076eac0309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:16.202619 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3841dcd-64c6-49f0-bb60-9a076eac0309 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:16.203001 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3841dcd-64c6-49f0-bb60-9a076eac0309 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:16.203370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3841dcd-64c6-49f0-bb60-9a076eac0309 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:16.204790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3841dcd-64c6-49f0-bb60-9a076eac0309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:16.205193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3841dcd-64c6-49f0-bb60-9a076eac0309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:16.206656 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3841dcd-64c6-49f0-bb60-9a076eac0309 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:16.223576 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 363/697] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:16.224653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3841dcd-64c6-49f0-bb60-9a076eac0309 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:16.227304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9463423-0da2-4726-8051-61bd480dd849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:16.229434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9463423-0da2-4726-8051-61bd480dd849 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:16.229865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9463423-0da2-4726-8051-61bd480dd849 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:16.230307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9463423-0da2-4726-8051-61bd480dd849 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:16.231104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9463423-0da2-4726-8051-61bd480dd849 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:16.232640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9463423-0da2-4726-8051-61bd480dd849 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:16.237570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-a9463423-0da2-4726-8051-61bd480dd849 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:16.253704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:16.254923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:05:16.255876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:16.262617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 335/698] 10.222.0.74 () {56 vars in 1129 bytes} [Thu Jul 14 10:05:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:16.262617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9463423-0da2-4726-8051-61bd480dd849 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:16.337630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3841dcd-64c6-49f0-bb60-9a076eac0309 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:16.347060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:16.382055 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fd705-6377-4a79-8d2c-81fde14dfe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:16.383058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fd705-6377-4a79-8d2c-81fde14dfe7e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:16.383587 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fd705-6377-4a79-8d2c-81fde14dfe7e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:16.384061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fd705-6377-4a79-8d2c-81fde14dfe7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:16.386238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9463423-0da2-4726-8051-61bd480dd849 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:16.422169 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485b079-83a6-45fc-a0b2-54f4154e79fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:16.423617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485b079-83a6-45fc-a0b2-54f4154e79fe None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:16.423962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485b079-83a6-45fc-a0b2-54f4154e79fe None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:16.424377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485b079-83a6-45fc-a0b2-54f4154e79fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:16.431719 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485b079-83a6-45fc-a0b2-54f4154e79fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:16.433281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485b079-83a6-45fc-a0b2-54f4154e79fe None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-1485b079-83a6-45fc-a0b2-54f4154e79fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:16.448263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:16.449191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:16.450095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:16.450095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:16.450095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:16.450095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:16.450095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:16.450095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:16.450095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:16.450095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:16.454294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 336/699] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:16.455161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485b079-83a6-45fc-a0b2-54f4154e79fe None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:16.464559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fd705-6377-4a79-8d2c-81fde14dfe7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:16.466420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fd705-6377-4a79-8d2c-81fde14dfe7e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:16.520055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:16.582009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485b079-83a6-45fc-a0b2-54f4154e79fe None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:16.583443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 364/700] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:05:16.584409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fd705-6377-4a79-8d2c-81fde14dfe7e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:16.596203 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:16.624811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a8546-58ca-495e-95f8-36e4de5fe91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:16.626402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a8546-58ca-495e-95f8-36e4de5fe91c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:16.626692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a8546-58ca-495e-95f8-36e4de5fe91c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:16.626968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a8546-58ca-495e-95f8-36e4de5fe91c None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:16.627745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a8546-58ca-495e-95f8-36e4de5fe91c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:16.628067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a8546-58ca-495e-95f8-36e4de5fe91c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:16.630423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a8546-58ca-495e-95f8-36e4de5fe91c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:16.639695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 337/701] 10.222.0.74 () {56 vars in 1124 bytes} [Thu Jul 14 10:05:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:16.639695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a8546-58ca-495e-95f8-36e4de5fe91c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:16.706114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fd705-6377-4a79-8d2c-81fde14dfe7e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:16.741677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb28c18-6b1b-495f-8375-0f32056bf6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:16.742526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb28c18-6b1b-495f-8375-0f32056bf6ae None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:16.742935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb28c18-6b1b-495f-8375-0f32056bf6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:16.743267 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb28c18-6b1b-495f-8375-0f32056bf6ae None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:16.744242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb28c18-6b1b-495f-8375-0f32056bf6ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:16.744623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb28c18-6b1b-495f-8375-0f32056bf6ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:16.746211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb28c18-6b1b-495f-8375-0f32056bf6ae None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:16.750422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a8546-58ca-495e-95f8-36e4de5fe91c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:16.764064 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 365/702] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:16.764064 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb28c18-6b1b-495f-8375-0f32056bf6ae None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:16.781460 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:16.804852 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d6557-6f83-496f-904f-45d577272070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:16.806803 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6557-6f83-496f-904f-45d577272070 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:16.807263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6557-6f83-496f-904f-45d577272070 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:16.807682 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6557-6f83-496f-904f-45d577272070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:16.821924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d6557-6f83-496f-904f-45d577272070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:16.823924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d6557-6f83-496f-904f-45d577272070 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:16.841641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-db0d6557-6f83-496f-904f-45d577272070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:16.849065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:16.850141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:16.851307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:16.851307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:16.851307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:16.851307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:16.853619 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 338/703] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:16.854694 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d6557-6f83-496f-904f-45d577272070 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:16.884822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb28c18-6b1b-495f-8375-0f32056bf6ae None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:16.921810 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11398881-0819-48a9-aa37-b6e0c4bbd24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:16.922860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11398881-0819-48a9-aa37-b6e0c4bbd24b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:16.923284 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11398881-0819-48a9-aa37-b6e0c4bbd24b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:16.923701 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11398881-0819-48a9-aa37-b6e0c4bbd24b None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:16.924663 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11398881-0819-48a9-aa37-b6e0c4bbd24b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:16.925126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11398881-0819-48a9-aa37-b6e0c4bbd24b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:16.927000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11398881-0819-48a9-aa37-b6e0c4bbd24b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:16.940424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 366/704] 10.222.0.74 () {56 vars in 1124 bytes} [Thu Jul 14 10:05:16 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:16.941638 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11398881-0819-48a9-aa37-b6e0c4bbd24b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:16.979444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d6557-6f83-496f-904f-45d577272070 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:17.054721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c4564-426b-48ae-85cb-acd75a5ea41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:17.055393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c4564-426b-48ae-85cb-acd75a5ea41c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:17.055682 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c4564-426b-48ae-85cb-acd75a5ea41c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:17.055964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c4564-426b-48ae-85cb-acd75a5ea41c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:17.056840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c4564-426b-48ae-85cb-acd75a5ea41c None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=2a0626754b40449ba2346d05c5c90a35) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:17.057153 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c4564-426b-48ae-85cb-acd75a5ea41c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:17.058598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c4564-426b-48ae-85cb-acd75a5ea41c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:17.062161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11398881-0819-48a9-aa37-b6e0c4bbd24b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:17.071363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 339/705] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:16 2022] GET /identity/v3/role_assignments?user.id=2a0626754b40449ba2346d05c5c90a35&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:17.115744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:17.134089 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6677e7-d950-4392-b029-c50db6372071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:17.135049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6677e7-d950-4392-b029-c50db6372071 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:17.135505 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6677e7-d950-4392-b029-c50db6372071 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:17.135945 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6677e7-d950-4392-b029-c50db6372071 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:17.136857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6677e7-d950-4392-b029-c50db6372071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:17.137305 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6677e7-d950-4392-b029-c50db6372071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:17.143716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6677e7-d950-4392-b029-c50db6372071 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:17.158510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 367/706] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:17.164083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c4564-426b-48ae-85cb-acd75a5ea41c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:17.221751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:17.286703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c4564-426b-48ae-85cb-acd75a5ea41c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:17.323769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07807fe6-ffab-41c8-9470-fe77e6c1b1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:17.324603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07807fe6-ffab-41c8-9470-fe77e6c1b1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:17.324920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07807fe6-ffab-41c8-9470-fe77e6c1b1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:17.325164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07807fe6-ffab-41c8-9470-fe77e6c1b1c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:17.332288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07807fe6-ffab-41c8-9470-fe77e6c1b1c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:17.333746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07807fe6-ffab-41c8-9470-fe77e6c1b1c2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-07807fe6-ffab-41c8-9470-fe77e6c1b1c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:17.347510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:17.348481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:17.349402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:17.349402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:17.349402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:17.349402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:17.349402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:17.349402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:17.349402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:17.349402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:17.349402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 340/707] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:17.354438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6677e7-d950-4392-b029-c50db6372071 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:17.430673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504c6a3-b8f0-4644-9ef2-4248198ace6d None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:17.430973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504c6a3-b8f0-4644-9ef2-4248198ace6d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:17.431146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504c6a3-b8f0-4644-9ef2-4248198ace6d None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:17.432520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 341/708] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:05:17.439021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efbee8-1bc1-4189-9739-2d5efd0ef07e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:17.439303 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efbee8-1bc1-4189-9739-2d5efd0ef07e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:17.439575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efbee8-1bc1-4189-9739-2d5efd0ef07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:17.468074 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-06efbee8-1bc1-4189-9739-2d5efd0ef07e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:17.469812 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-06efbee8-1bc1-4189-9739-2d5efd0ef07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:17.519288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6677e7-d950-4392-b029-c50db6372071 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:17.560021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 342/709] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:05:17.579732 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efbee8-1bc1-4189-9739-2d5efd0ef07e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:17.580731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885518d-6af5-416f-b33f-7aaa74d6f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:17.594721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885518d-6af5-416f-b33f-7aaa74d6f50c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:17.594721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885518d-6af5-416f-b33f-7aaa74d6f50c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:17.594721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885518d-6af5-416f-b33f-7aaa74d6f50c None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:17.594721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885518d-6af5-416f-b33f-7aaa74d6f50c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:17.594721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885518d-6af5-416f-b33f-7aaa74d6f50c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:17.594721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885518d-6af5-416f-b33f-7aaa74d6f50c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:17.609021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 368/710] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:17.610575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:17.616091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885518d-6af5-416f-b33f-7aaa74d6f50c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:17.675796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:17.693953 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efbee8-1bc1-4189-9739-2d5efd0ef07e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:17.727259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885518d-6af5-416f-b33f-7aaa74d6f50c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:17.740662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7077d-ae6c-4e3f-8c13-9550fa041014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:17.741721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7077d-ae6c-4e3f-8c13-9550fa041014 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:17.742005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7077d-ae6c-4e3f-8c13-9550fa041014 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:17.742281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7077d-ae6c-4e3f-8c13-9550fa041014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:17.756738 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7077d-ae6c-4e3f-8c13-9550fa041014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:17.758177 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7077d-ae6c-4e3f-8c13-9550fa041014 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:17.766712 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e5ceb-f277-41c1-b97f-8c769d215da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:17.767419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e5ceb-f277-41c1-b97f-8c769d215da5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:17.767700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e5ceb-f277-41c1-b97f-8c769d215da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:17.767974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e5ceb-f277-41c1-b97f-8c769d215da5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:17.768826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e5ceb-f277-41c1-b97f-8c769d215da5 None admin] RBAC: Adding query filter params (role.id=feef3a85c1c0446590c2671a9f266cf4, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=323279b7ad0c418b848d6d7ae26ec5d2) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:17.769133 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e5ceb-f277-41c1-b97f-8c769d215da5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:17.770606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e5ceb-f277-41c1-b97f-8c769d215da5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:17.777091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 369/711] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:17 2022] GET /identity/v3/role_assignments?user.id=323279b7ad0c418b848d6d7ae26ec5d2&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=feef3a85c1c0446590c2671a9f266cf4 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:17.778331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8fd39-d043-446b-9814-0e10d00742e1 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:17.778610 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8fd39-d043-446b-9814-0e10d00742e1 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:17.778878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8fd39-d043-446b-9814-0e10d00742e1 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:17.784240 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 370/712] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3ae7077d-ae6c-4e3f-8c13-9550fa041014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:17.786176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:17.787197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:17.789214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:17.789214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:17.789214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:17.789214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:17.789214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 343/713] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:17.789508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca73c1-2e6e-4627-8048-88dc921cdea3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:17.789508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca73c1-2e6e-4627-8048-88dc921cdea3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:17.789635 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca73c1-2e6e-4627-8048-88dc921cdea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:17.801827 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7077d-ae6c-4e3f-8c13-9550fa041014 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:17.815298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e7ca73c1-2e6e-4627-8048-88dc921cdea3 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:17.816980 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e7ca73c1-2e6e-4627-8048-88dc921cdea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:17.906522 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 371/714] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:05:17.941559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca73c1-2e6e-4627-8048-88dc921cdea3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:17.975063 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:17.994752 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7077d-ae6c-4e3f-8c13-9550fa041014 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:17.997627 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:18.032644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a09ab-c5cb-43f8-aea5-e7588f1e339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:18.033407 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a09ab-c5cb-43f8-aea5-e7588f1e339d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:18.033696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a09ab-c5cb-43f8-aea5-e7588f1e339d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:18.034029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a09ab-c5cb-43f8-aea5-e7588f1e339d None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:18.034786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a09ab-c5cb-43f8-aea5-e7588f1e339d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:18.035090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a09ab-c5cb-43f8-aea5-e7588f1e339d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:18.036786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a09ab-c5cb-43f8-aea5-e7588f1e339d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:18.054845 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 344/715] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:18.057824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca73c1-2e6e-4627-8048-88dc921cdea3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:18.061126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a09ab-c5cb-43f8-aea5-e7588f1e339d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:18.095262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4837d4-ce81-4ea6-a468-d71adf08e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:18.096159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4837d4-ce81-4ea6-a468-d71adf08e4fc None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:18.096443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4837d4-ce81-4ea6-a468-d71adf08e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:18.096769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4837d4-ce81-4ea6-a468-d71adf08e4fc None admin] PATH_INFO: `/v3/services/network` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:18.097422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4837d4-ce81-4ea6-a468-d71adf08e4fc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:18.098809 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4837d4-ce81-4ea6-a468-d71adf08e4fc None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-7f4837d4-ce81-4ea6-a468-d71adf08e4fc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:18.113906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:18.114933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:18.115784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:18.115784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:18.115784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:18.115784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:18.115784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:18.115784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:18.115784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:18.115784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:18.115784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:18.115784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:18.115784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:18.115784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:18.115784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:05:18.115784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:18.116588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 372/716] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:17 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:18.123779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4837d4-ce81-4ea6-a468-d71adf08e4fc None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:18.178439 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a09ab-c5cb-43f8-aea5-e7588f1e339d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:18.216564 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5e270-e542-47be-9104-c6c1bcfcb46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:18.217576 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5e270-e542-47be-9104-c6c1bcfcb46d None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:18.218071 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5e270-e542-47be-9104-c6c1bcfcb46d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:18.218656 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5e270-e542-47be-9104-c6c1bcfcb46d None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:18.220251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5e270-e542-47be-9104-c6c1bcfcb46d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:18.221889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5e270-e542-47be-9104-c6c1bcfcb46d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:18.228727 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4837d4-ce81-4ea6-a468-d71adf08e4fc None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:18.240190 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:18.265954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdebb7-b6d3-4e55-8e9e-8df2fba9c5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:18.266637 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdebb7-b6d3-4e55-8e9e-8df2fba9c5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:18.266920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdebb7-b6d3-4e55-8e9e-8df2fba9c5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:18.267199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdebb7-b6d3-4e55-8e9e-8df2fba9c5a1 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:18.267936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdebb7-b6d3-4e55-8e9e-8df2fba9c5a1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:18.268248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdebb7-b6d3-4e55-8e9e-8df2fba9c5a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:18.271193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdebb7-b6d3-4e55-8e9e-8df2fba9c5a1 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:18.274810 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 373/717] 10.222.0.74 () {56 vars in 1112 bytes} [Thu Jul 14 10:05:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:18.280404 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdebb7-b6d3-4e55-8e9e-8df2fba9c5a1 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:18.289135 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:18.303310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 345/718] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:05:18 2022] POST /identity/v3/users => generated 254 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:05:18.403000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdebb7-b6d3-4e55-8e9e-8df2fba9c5a1 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:18.460144 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d454d4-b170-449a-a6ba-0500a3942808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:18.460859 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d454d4-b170-449a-a6ba-0500a3942808 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:18.461143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d454d4-b170-449a-a6ba-0500a3942808 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:18.461420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d454d4-b170-449a-a6ba-0500a3942808 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:18.462196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d454d4-b170-449a-a6ba-0500a3942808 None admin] RBAC: Adding query filter params (type=network) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:18.462507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d454d4-b170-449a-a6ba-0500a3942808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:18.464032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d454d4-b170-449a-a6ba-0500a3942808 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:18.478685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 374/719] 10.222.0.74 () {56 vars in 1112 bytes} [Thu Jul 14 10:05:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:19.499127 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01fd28-9df5-474b-8363-a9dadd5bc2c8 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:19.499654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01fd28-9df5-474b-8363-a9dadd5bc2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:19.499654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01fd28-9df5-474b-8363-a9dadd5bc2c8 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:19.501451 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 346/720] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:19.507496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357734c-408c-4f6a-a6cc-9823a7204186 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:19.508033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357734c-408c-4f6a-a6cc-9823a7204186 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:19.508114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357734c-408c-4f6a-a6cc-9823a7204186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:19.525921 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9357734c-408c-4f6a-a6cc-9823a7204186 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:19.527130 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9357734c-408c-4f6a-a6cc-9823a7204186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:19.569676 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:19.622597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 375/721] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:05:19.622785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9e0e3-1c51-4666-9003-b1cbfddabb4c None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:19.623065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9e0e3-1c51-4666-9003-b1cbfddabb4c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:19.623231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9e0e3-1c51-4666-9003-b1cbfddabb4c None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:19.624845 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 347/722] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:19.630496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39321e30-e8e4-43be-84f5-35c34e3ba9e0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:19.630786 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39321e30-e8e4-43be-84f5-35c34e3ba9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:19.631061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39321e30-e8e4-43be-84f5-35c34e3ba9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:19.652503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-39321e30-e8e4-43be-84f5-35c34e3ba9e0 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:19.653682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-39321e30-e8e4-43be-84f5-35c34e3ba9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:19.667970 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9e0e3-1c51-4666-9003-b1cbfddabb4c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:19.769839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 376/723] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:05:19.804114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39321e30-e8e4-43be-84f5-35c34e3ba9e0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:19.890858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9e0e3-1c51-4666-9003-b1cbfddabb4c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:19.917091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:19.921159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39321e30-e8e4-43be-84f5-35c34e3ba9e0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:19.967485 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fe8dd-e7cd-4625-b5c6-f0f19f1b3793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:19.968192 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fe8dd-e7cd-4625-b5c6-f0f19f1b3793 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:19.968477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fe8dd-e7cd-4625-b5c6-f0f19f1b3793 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:19.968862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fe8dd-e7cd-4625-b5c6-f0f19f1b3793 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:19.970321 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fe8dd-e7cd-4625-b5c6-f0f19f1b3793 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:19.972158 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fe8dd-e7cd-4625-b5c6-f0f19f1b3793 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:19.972519 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07645a42-6baf-4592-a3a6-6a6e313130c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:19.973393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07645a42-6baf-4592-a3a6-6a6e313130c5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:19.973738 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07645a42-6baf-4592-a3a6-6a6e313130c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:19.974092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07645a42-6baf-4592-a3a6-6a6e313130c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:19.991703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07645a42-6baf-4592-a3a6-6a6e313130c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-07645a42-6baf-4592-a3a6-6a6e313130c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:19.999768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:20.004975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:20.005825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:20.005825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:20.005825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:20.005825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:20.005825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:20.005825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:20.005825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:20.005825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:20.005825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:20.005825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:20.005825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:05:20.005825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:20.005825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 348/724] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:05:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:20.007186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07645a42-6baf-4592-a3a6-6a6e313130c5 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:20.055384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 377/725] 10.222.0.74 () {60 vars in 1141 bytes} [Thu Jul 14 10:05:19 2022] POST /identity/v3/services => generated 251 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:05:20.088959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:20.126889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07645a42-6baf-4592-a3a6-6a6e313130c5 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:20.179792 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c3096-e619-4e88-9447-0f35ab15be77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:20.180569 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c3096-e619-4e88-9447-0f35ab15be77 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:20.180854 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c3096-e619-4e88-9447-0f35ab15be77 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:20.181126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c3096-e619-4e88-9447-0f35ab15be77 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:20.181891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c3096-e619-4e88-9447-0f35ab15be77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:20.182195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c3096-e619-4e88-9447-0f35ab15be77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:20.183585 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c3096-e619-4e88-9447-0f35ab15be77 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:20.193618 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 349/726] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:05:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:20.201501 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fe8dd-e7cd-4625-b5c6-f0f19f1b3793 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:20.320098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fe8dd-e7cd-4625-b5c6-f0f19f1b3793 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:20.356024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa756f6-5df2-41ba-bc7a-fe97c747ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:20.356845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa756f6-5df2-41ba-bc7a-fe97c747ba71 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:20.357126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa756f6-5df2-41ba-bc7a-fe97c747ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:20.357399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa756f6-5df2-41ba-bc7a-fe97c747ba71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:20.368872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa756f6-5df2-41ba-bc7a-fe97c747ba71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:20.370321 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa756f6-5df2-41ba-bc7a-fe97c747ba71 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-3fa756f6-5df2-41ba-bc7a-fe97c747ba71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:20.389298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:20.390255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:20.392239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:20.392239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:20.392239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:20.392239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:20.392239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 378/727] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:20.398177 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c3096-e619-4e88-9447-0f35ab15be77 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:20.501403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c3096-e619-4e88-9447-0f35ab15be77 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:20.520551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:20.538515 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21837bbc-b49e-47e2-9093-2e97ddaea46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:20.552143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21837bbc-b49e-47e2-9093-2e97ddaea46a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:20.552143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21837bbc-b49e-47e2-9093-2e97ddaea46a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:20.552143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21837bbc-b49e-47e2-9093-2e97ddaea46a None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:20.552143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21837bbc-b49e-47e2-9093-2e97ddaea46a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:20.552143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21837bbc-b49e-47e2-9093-2e97ddaea46a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:20.552143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21837bbc-b49e-47e2-9093-2e97ddaea46a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:20.557237 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 350/728] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:20.563639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa756f6-5df2-41ba-bc7a-fe97c747ba71 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:20.577676 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cbea5-4930-4cc9-826b-00ef54ab6097 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:20.577952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cbea5-4930-4cc9-826b-00ef54ab6097 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:20.578154 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cbea5-4930-4cc9-826b-00ef54ab6097 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:20.582611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 351/729] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:20.582987 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:20.588847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba78fd-3db2-4bfd-ba69-46dc3743fc2a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:20.589133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba78fd-3db2-4bfd-ba69-46dc3743fc2a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:20.589407 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba78fd-3db2-4bfd-ba69-46dc3743fc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:20.619415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b1ba78fd-3db2-4bfd-ba69-46dc3743fc2a None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:20.620793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b1ba78fd-3db2-4bfd-ba69-46dc3743fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:20.751892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 352/730] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:05:20.759249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa756f6-5df2-41ba-bc7a-fe97c747ba71 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:20.794414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba78fd-3db2-4bfd-ba69-46dc3743fc2a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:20.811549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274db1ef-23b6-4e72-bdeb-12575ec0b7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:20.813525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274db1ef-23b6-4e72-bdeb-12575ec0b7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:20.814030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274db1ef-23b6-4e72-bdeb-12575ec0b7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:20.814514 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274db1ef-23b6-4e72-bdeb-12575ec0b7d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:20.832955 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274db1ef-23b6-4e72-bdeb-12575ec0b7d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:20.834350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274db1ef-23b6-4e72-bdeb-12575ec0b7d6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-274db1ef-23b6-4e72-bdeb-12575ec0b7d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:20.866332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:20.867334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:20.868300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:20.868300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:20.868300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:20.868300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:20.868300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:20.868300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:20.868300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:20.868300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:20.868300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:05:20.868300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:20.870474 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 379/731] 10.222.0.74 () {56 vars in 1093 bytes} [Thu Jul 14 10:05:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:20.875764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274db1ef-23b6-4e72-bdeb-12575ec0b7d6 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:20.965971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:20.967812 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba78fd-3db2-4bfd-ba69-46dc3743fc2a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:20.975498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:20.998745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274db1ef-23b6-4e72-bdeb-12575ec0b7d6 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:21.003788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ef762-51d1-4739-88c7-ecf1de0ad178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:21.004608 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef762-51d1-4739-88c7-ecf1de0ad178 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:21.004887 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef762-51d1-4739-88c7-ecf1de0ad178 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:21.005159 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef762-51d1-4739-88c7-ecf1de0ad178 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:21.015519 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ef762-51d1-4739-88c7-ecf1de0ad178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-af6ef762-51d1-4739-88c7-ecf1de0ad178 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:21.023341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:21.027762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:21.028891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:21.028891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:21.028891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:21.028891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:21.028891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:21.028891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:21.028891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:21.028891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:21.028891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:21.028891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:21.028891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:05:21.028891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:21.028891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 353/732] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:05:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:21.028891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a13b74-1ff7-44c8-ae23-146621da7a48 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:21.029963 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a13b74-1ff7-44c8-ae23-146621da7a48 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:21.029963 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a13b74-1ff7-44c8-ae23-146621da7a48 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:21.032101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 354/733] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:21.032915 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a13b74-1ff7-44c8-ae23-146621da7a48 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:21.035474 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f00053-d4bb-49eb-a565-dfc5e246afb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:21.036198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f00053-d4bb-49eb-a565-dfc5e246afb7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:21.036485 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f00053-d4bb-49eb-a565-dfc5e246afb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:21.036767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f00053-d4bb-49eb-a565-dfc5e246afb7 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:21.037685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f00053-d4bb-49eb-a565-dfc5e246afb7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:21.037995 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f00053-d4bb-49eb-a565-dfc5e246afb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:21.039546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f00053-d4bb-49eb-a565-dfc5e246afb7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:21.059242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 380/734] 10.222.0.74 () {56 vars in 1133 bytes} [Thu Jul 14 10:05:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:21.060631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9ae79-8608-4ce6-aa27-e36794476b48 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:21.060924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9ae79-8608-4ce6-aa27-e36794476b48 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:21.061203 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9ae79-8608-4ce6-aa27-e36794476b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:21.079735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-38e9ae79-8608-4ce6-aa27-e36794476b48 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:21.081183 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-38e9ae79-8608-4ce6-aa27-e36794476b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:21.143756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a13b74-1ff7-44c8-ae23-146621da7a48 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:21.153883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 381/735] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:05:21.154721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9ae79-8608-4ce6-aa27-e36794476b48 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:21.182478 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fd931-f317-42ec-a185-abd80c1302e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:21.183156 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fd931-f317-42ec-a185-abd80c1302e5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:21.183459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fd931-f317-42ec-a185-abd80c1302e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:21.184187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fd931-f317-42ec-a185-abd80c1302e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:21.184953 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fd931-f317-42ec-a185-abd80c1302e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:21.185262 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fd931-f317-42ec-a185-abd80c1302e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:21.186650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fd931-f317-42ec-a185-abd80c1302e5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:21.196586 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 355/736] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:05:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:21.197769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71aabc-2f0a-44d0-bbbc-37d8967b591d None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:21.198124 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71aabc-2f0a-44d0-bbbc-37d8967b591d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:21.198398 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71aabc-2f0a-44d0-bbbc-37d8967b591d None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:21.199764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 356/737] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:21.200791 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71aabc-2f0a-44d0-bbbc-37d8967b591d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:21.231202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:21.236213 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:21.274349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9ae79-8608-4ce6-aa27-e36794476b48 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:21.311804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844a32c-46a6-419a-a6e5-27f0e3a0a6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:21.312662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844a32c-46a6-419a-a6e5-27f0e3a0a6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:21.312943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844a32c-46a6-419a-a6e5-27f0e3a0a6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:21.313220 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844a32c-46a6-419a-a6e5-27f0e3a0a6e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:21.315556 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71aabc-2f0a-44d0-bbbc-37d8967b591d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:21.323574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844a32c-46a6-419a-a6e5-27f0e3a0a6e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:21.325066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844a32c-46a6-419a-a6e5-27f0e3a0a6e4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-2844a32c-46a6-419a-a6e5-27f0e3a0a6e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:21.342918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:21.343836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:21.345507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:21.345507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:21.345507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:21.345507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:21.349101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 382/738] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:21.349926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844a32c-46a6-419a-a6e5-27f0e3a0a6e4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:21.354035 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae362a-dcf6-44f9-be2f-863bd764791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:21.354870 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae362a-dcf6-44f9-be2f-863bd764791a None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:21.355322 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae362a-dcf6-44f9-be2f-863bd764791a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:21.355747 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae362a-dcf6-44f9-be2f-863bd764791a None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:21.356644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae362a-dcf6-44f9-be2f-863bd764791a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:21.358195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae362a-dcf6-44f9-be2f-863bd764791a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:21.418310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 357/739] 10.222.0.74 () {60 vars in 1141 bytes} [Thu Jul 14 10:05:21 2022] POST /identity/v3/services => generated 240 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:05:21.419663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03fbb-5f12-43e3-b960-24d66e5897bd None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:21.420044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03fbb-5f12-43e3-b960-24d66e5897bd None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:21.420392 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03fbb-5f12-43e3-b960-24d66e5897bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:21.441749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4df03fbb-5f12-43e3-b960-24d66e5897bd None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:21.443074 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4df03fbb-5f12-43e3-b960-24d66e5897bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:21.469574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844a32c-46a6-419a-a6e5-27f0e3a0a6e4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:21.488112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:21.522764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29f51b-5cce-46e4-8f2b-f46dfa8f4d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:21.523702 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29f51b-5cce-46e4-8f2b-f46dfa8f4d37 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:21.524032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29f51b-5cce-46e4-8f2b-f46dfa8f4d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:21.524367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29f51b-5cce-46e4-8f2b-f46dfa8f4d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:21.532414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 358/740] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:21.534101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df03fbb-5f12-43e3-b960-24d66e5897bd None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:21.537915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29f51b-5cce-46e4-8f2b-f46dfa8f4d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:21.540074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29f51b-5cce-46e4-8f2b-f46dfa8f4d37 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-dc29f51b-5cce-46e4-8f2b-f46dfa8f4d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:21.562494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:21.564751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:21.565903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:21.565903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:21.565903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:21.565903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:21.566990 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 383/741] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:21.577093 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29f51b-5cce-46e4-8f2b-f46dfa8f4d37 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:21.581309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:21.697787 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df03fbb-5f12-43e3-b960-24d66e5897bd None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:21.703701 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29f51b-5cce-46e4-8f2b-f46dfa8f4d37 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:21.742327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fda03d-c935-48e6-830c-040058c4e8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:21.742572 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86aa53-4e55-4471-8f89-d491dd93e421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:21.743239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fda03d-c935-48e6-830c-040058c4e8fd None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:21.743589 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86aa53-4e55-4471-8f89-d491dd93e421 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:21.743703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fda03d-c935-48e6-830c-040058c4e8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:21.744077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fda03d-c935-48e6-830c-040058c4e8fd None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:21.744354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86aa53-4e55-4471-8f89-d491dd93e421 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:21.744769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86aa53-4e55-4471-8f89-d491dd93e421 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:21.745088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fda03d-c935-48e6-830c-040058c4e8fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:21.745485 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fda03d-c935-48e6-830c-040058c4e8fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:21.745961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86aa53-4e55-4471-8f89-d491dd93e421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:21.746426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86aa53-4e55-4471-8f89-d491dd93e421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:21.747126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fda03d-c935-48e6-830c-040058c4e8fd None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:21.748115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86aa53-4e55-4471-8f89-d491dd93e421 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:21.765430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 359/743] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:21.765621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 384/743] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:21.766618 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86aa53-4e55-4471-8f89-d491dd93e421 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:21.766863 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fda03d-c935-48e6-830c-040058c4e8fd None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:21.791586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:21.857688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:21.878858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86aa53-4e55-4471-8f89-d491dd93e421 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:21.881945 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fda03d-c935-48e6-830c-040058c4e8fd None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:21.916074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f62ff-7956-41c1-b722-2adc26212841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:21.917077 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f62ff-7956-41c1-b722-2adc26212841 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:21.917367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f62ff-7956-41c1-b722-2adc26212841 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:21.917650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f62ff-7956-41c1-b722-2adc26212841 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:21.922072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3529a6-a509-4f14-9879-ec4d1daa4621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:21.922858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3529a6-a509-4f14-9879-ec4d1daa4621 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:21.923139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3529a6-a509-4f14-9879-ec4d1daa4621 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:21.923409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3529a6-a509-4f14-9879-ec4d1daa4621 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:21.928924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f62ff-7956-41c1-b722-2adc26212841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:21.931613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3529a6-a509-4f14-9879-ec4d1daa4621 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:21.933101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3529a6-a509-4f14-9879-ec4d1daa4621 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-ad9f62ff-7956-41c1-b722-2adc26212841 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:21.936997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:21.937970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:21.938820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:21.938820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:21.938820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:21.938820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:21.938820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:21.938820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:21.938820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:21.938820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:21.938820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:21.938820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:21.938820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:21.938820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:21.938820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 385/744] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:21.939520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f62ff-7956-41c1-b722-2adc26212841 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-de3529a6-a509-4f14-9879-ec4d1daa4621 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:21.947579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:21.949819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:21.952272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:21.952272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:21.952272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:21.952272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:21.952272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:21.952272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:21.952272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:21.952272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:21.952272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:05:21.952272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:21.952272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 360/745] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:05:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:21.952272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3529a6-a509-4f14-9879-ec4d1daa4621 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:22.044590 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:22.073292 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f62ff-7956-41c1-b722-2adc26212841 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:22.079320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3529a6-a509-4f14-9879-ec4d1daa4621 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:22.114155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e1109-f938-49fd-b8df-b0f11b45bddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:22.114962 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e1109-f938-49fd-b8df-b0f11b45bddd None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:22.115250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e1109-f938-49fd-b8df-b0f11b45bddd None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:22.115536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e1109-f938-49fd-b8df-b0f11b45bddd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:22.119266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37267062-1c8c-425b-85c7-18ef34a97e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:22.120189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267062-1c8c-425b-85c7-18ef34a97e45 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:22.120676 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267062-1c8c-425b-85c7-18ef34a97e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:22.121247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267062-1c8c-425b-85c7-18ef34a97e45 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:22.122195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267062-1c8c-425b-85c7-18ef34a97e45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:22.122662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e1109-f938-49fd-b8df-b0f11b45bddd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:22.122928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267062-1c8c-425b-85c7-18ef34a97e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:22.124176 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e1109-f938-49fd-b8df-b0f11b45bddd None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:22.124948 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267062-1c8c-425b-85c7-18ef34a97e45 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:22.131057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-171e1109-f938-49fd-b8df-b0f11b45bddd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:22.139689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:22.140640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:22.142147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:22.142147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:22.142147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:22.142147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:22.142147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:22.142147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:22.142147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:22.142147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:22.143561 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 361/747] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:05:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:22.144799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37267062-1c8c-425b-85c7-18ef34a97e45 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:22.146181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 386/747] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:22.147042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e1109-f938-49fd-b8df-b0f11b45bddd None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:22.250282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37267062-1c8c-425b-85c7-18ef34a97e45 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:22.259089 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e1109-f938-49fd-b8df-b0f11b45bddd None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:22.286101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67cd62-9991-4177-ac5a-b5d401e3c0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:22.287161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67cd62-9991-4177-ac5a-b5d401e3c0cb None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:22.287661 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67cd62-9991-4177-ac5a-b5d401e3c0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:22.288193 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67cd62-9991-4177-ac5a-b5d401e3c0cb None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:22.289236 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67cd62-9991-4177-ac5a-b5d401e3c0cb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:22.289761 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67cd62-9991-4177-ac5a-b5d401e3c0cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:22.291393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67cd62-9991-4177-ac5a-b5d401e3c0cb None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:22.297826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f296615-5c2e-405e-9f0d-16e8386311f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:22.298637 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f296615-5c2e-405e-9f0d-16e8386311f4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:22.298923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f296615-5c2e-405e-9f0d-16e8386311f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:22.299197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f296615-5c2e-405e-9f0d-16e8386311f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:22.306584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:22.311408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f296615-5c2e-405e-9f0d-16e8386311f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:22.312929 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f296615-5c2e-405e-9f0d-16e8386311f4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:22.313040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 362/748] 10.222.0.74 () {56 vars in 1135 bytes} [Thu Jul 14 10:05:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:22.314286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67cd62-9991-4177-ac5a-b5d401e3c0cb None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-9f296615-5c2e-405e-9f0d-16e8386311f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:22.333881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:22.334863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:22.335757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:22.335757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:22.335757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:22.335757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:22.339784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 387/749] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:22.340649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f296615-5c2e-405e-9f0d-16e8386311f4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:22.377962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:22.421923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67cd62-9991-4177-ac5a-b5d401e3c0cb None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:22.452567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f296615-5c2e-405e-9f0d-16e8386311f4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:22.458884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da6950-075a-478c-8c67-d5a4df83e05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:22.459803 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da6950-075a-478c-8c67-d5a4df83e05a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:22.460308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da6950-075a-478c-8c67-d5a4df83e05a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:22.460786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da6950-075a-478c-8c67-d5a4df83e05a None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:22.461767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da6950-075a-478c-8c67-d5a4df83e05a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:22.462300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da6950-075a-478c-8c67-d5a4df83e05a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:22.463922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da6950-075a-478c-8c67-d5a4df83e05a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:22.481445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 363/750] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:22.482616 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da6950-075a-478c-8c67-d5a4df83e05a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:22.490417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5489cd6-506f-49cb-b226-9317b83049a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:22.491081 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5489cd6-506f-49cb-b226-9317b83049a6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:22.491366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5489cd6-506f-49cb-b226-9317b83049a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:22.491645 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5489cd6-506f-49cb-b226-9317b83049a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:22.556540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:22.567126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5489cd6-506f-49cb-b226-9317b83049a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:22.569776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5489cd6-506f-49cb-b226-9317b83049a6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:22.588952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da6950-075a-478c-8c67-d5a4df83e05a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:22.607777 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:22.626552 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beab0fc-c77a-4a3e-a91a-cbecc79bfc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:22.627015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beab0fc-c77a-4a3e-a91a-cbecc79bfc0e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:22.627329 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beab0fc-c77a-4a3e-a91a-cbecc79bfc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:22.627600 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beab0fc-c77a-4a3e-a91a-cbecc79bfc0e None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:22.628311 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beab0fc-c77a-4a3e-a91a-cbecc79bfc0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:22.628666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beab0fc-c77a-4a3e-a91a-cbecc79bfc0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:22.630042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beab0fc-c77a-4a3e-a91a-cbecc79bfc0e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:22.643276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 364/751] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:22.644092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beab0fc-c77a-4a3e-a91a-cbecc79bfc0e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:22.694513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 388/752] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:05:22.696938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20bf3-85f2-4c7e-9190-400ae9fb6873 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:22.697664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20bf3-85f2-4c7e-9190-400ae9fb6873 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:22.698126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20bf3-85f2-4c7e-9190-400ae9fb6873 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:22.700529 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 389/753] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:22.701437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20bf3-85f2-4c7e-9190-400ae9fb6873 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:22.752894 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beab0fc-c77a-4a3e-a91a-cbecc79bfc0e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:22.787260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c99092-1c99-4b83-9f42-ad4e663aa44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:22.788174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c99092-1c99-4b83-9f42-ad4e663aa44a None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:22.788455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c99092-1c99-4b83-9f42-ad4e663aa44a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:22.788728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c99092-1c99-4b83-9f42-ad4e663aa44a None admin] PATH_INFO: `/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/2a0626754b40449ba2346d05c5c90a35/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:22.790718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c99092-1c99-4b83-9f42-ad4e663aa44a None admin] RBAC: Authorizing `identity:create_grant(project_id=795b6593e7b74eeda9929aba07cbaa0e, user_id=2a0626754b40449ba2346d05c5c90a35, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:22.792196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c99092-1c99-4b83-9f42-ad4e663aa44a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:22.807861 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:22.818149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20bf3-85f2-4c7e-9190-400ae9fb6873 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:22.852363 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918e5bb-a80a-4072-a78a-89042a651cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:22.853171 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918e5bb-a80a-4072-a78a-89042a651cbc None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:22.853455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918e5bb-a80a-4072-a78a-89042a651cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:22.853731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918e5bb-a80a-4072-a78a-89042a651cbc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:22.860724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918e5bb-a80a-4072-a78a-89042a651cbc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:22.862165 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918e5bb-a80a-4072-a78a-89042a651cbc None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:22.883814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 365/754] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:05:22 2022] PUT /identity/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/2a0626754b40449ba2346d05c5c90a35/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:05:22.883814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c99092-1c99-4b83-9f42-ad4e663aa44a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-d918e5bb-a80a-4072-a78a-89042a651cbc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:22.884109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:22.885204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:22.886385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:22.886385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:22.886385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:22.886385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:22.886385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:22.886385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:22.886385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:22.886385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:22.886385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:05:22.886385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:22.886385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 390/755] 10.222.0.74 () {56 vars in 1117 bytes} [Thu Jul 14 10:05:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:22.886385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16f9d7-2d6f-4767-b7ed-4174f8c4751a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:22.886385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16f9d7-2d6f-4767-b7ed-4174f8c4751a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:22.887270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16f9d7-2d6f-4767-b7ed-4174f8c4751a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:22.911310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0b16f9d7-2d6f-4767-b7ed-4174f8c4751a None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:22.912628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0b16f9d7-2d6f-4767-b7ed-4174f8c4751a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:22.952951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:22.994938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 391/756] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:22.996233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16f9d7-2d6f-4767-b7ed-4174f8c4751a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:23.059484 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c99092-1c99-4b83-9f42-ad4e663aa44a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:23.102687 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:23.104740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483b2f1-2014-4d02-a80b-d0dab67983e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:23.105539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483b2f1-2014-4d02-a80b-d0dab67983e6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:23.105823 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483b2f1-2014-4d02-a80b-d0dab67983e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:23.106099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483b2f1-2014-4d02-a80b-d0dab67983e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:23.118772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483b2f1-2014-4d02-a80b-d0dab67983e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:23.120483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483b2f1-2014-4d02-a80b-d0dab67983e6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:23.129055 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16f9d7-2d6f-4767-b7ed-4174f8c4751a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-c483b2f1-2014-4d02-a80b-d0dab67983e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:23.145495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:23.146520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:23.147427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:23.147427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:23.147427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:23.147427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:23.147427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 366/757] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:23.148467 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483b2f1-2014-4d02-a80b-d0dab67983e6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:23.176773 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cd598-b999-494d-8b07-d1a04a18cab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:23.177460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cd598-b999-494d-8b07-d1a04a18cab2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:23.177746 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cd598-b999-494d-8b07-d1a04a18cab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:23.178130 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cd598-b999-494d-8b07-d1a04a18cab2 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:23.179043 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cd598-b999-494d-8b07-d1a04a18cab2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:23.179361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cd598-b999-494d-8b07-d1a04a18cab2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:23.180937 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cd598-b999-494d-8b07-d1a04a18cab2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:23.199917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 392/758] 10.222.0.74 () {56 vars in 1149 bytes} [Thu Jul 14 10:05:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:23.200875 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cd598-b999-494d-8b07-d1a04a18cab2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:23.262570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:23.275214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483b2f1-2014-4d02-a80b-d0dab67983e6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:23.312555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cd598-b999-494d-8b07-d1a04a18cab2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:23.318947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b6bbb-9d95-47c7-b19b-fef4a01bd005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:23.319876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b6bbb-9d95-47c7-b19b-fef4a01bd005 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:23.320284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b6bbb-9d95-47c7-b19b-fef4a01bd005 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:23.321044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b6bbb-9d95-47c7-b19b-fef4a01bd005 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:23.321826 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b6bbb-9d95-47c7-b19b-fef4a01bd005 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:23.323656 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b6bbb-9d95-47c7-b19b-fef4a01bd005 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-d41b6bbb-9d95-47c7-b19b-fef4a01bd005 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:23.339920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:23.341893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:23.342967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 367/759] 10.222.0.74 () {56 vars in 1129 bytes} [Thu Jul 14 10:05:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:23.344712 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b6bbb-9d95-47c7-b19b-fef4a01bd005 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:23.353452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9b33-a16b-47c6-b87f-6eade74748f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:23.354263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9b33-a16b-47c6-b87f-6eade74748f0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:23.354682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9b33-a16b-47c6-b87f-6eade74748f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:23.355142 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9b33-a16b-47c6-b87f-6eade74748f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:23.356063 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b9b33-a16b-47c6-b87f-6eade74748f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:23.356564 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b9b33-a16b-47c6-b87f-6eade74748f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:23.358099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b9b33-a16b-47c6-b87f-6eade74748f0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:23.370738 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:23.381587 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 393/760] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:23.382596 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9b33-a16b-47c6-b87f-6eade74748f0 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:23.467902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b6bbb-9d95-47c7-b19b-fef4a01bd005 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:23.504179 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488d0db-34cf-4f79-aedf-479a4aec0ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:23.505009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488d0db-34cf-4f79-aedf-479a4aec0ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:23.505396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488d0db-34cf-4f79-aedf-479a4aec0ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:23.505622 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9b33-a16b-47c6-b87f-6eade74748f0 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:23.505859 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488d0db-34cf-4f79-aedf-479a4aec0ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:23.531562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:23.551083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4402b6-0336-4316-9479-e434b948dacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:23.552061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4402b6-0336-4316-9479-e434b948dacb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:23.552807 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4402b6-0336-4316-9479-e434b948dacb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:23.553235 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4402b6-0336-4316-9479-e434b948dacb None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:23.554355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4402b6-0336-4316-9479-e434b948dacb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:23.554811 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4402b6-0336-4316-9479-e434b948dacb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:23.557083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4402b6-0336-4316-9479-e434b948dacb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:23.565029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 394/761] 10.222.0.74 () {56 vars in 1124 bytes} [Thu Jul 14 10:05:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:23.566331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4402b6-0336-4316-9479-e434b948dacb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:23.582809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488d0db-34cf-4f79-aedf-479a4aec0ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:23.584434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488d0db-34cf-4f79-aedf-479a4aec0ff6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:23.685593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:23.726380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 368/762] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:05:23.727275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488d0db-34cf-4f79-aedf-479a4aec0ff6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:23.732611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4402b6-0336-4316-9479-e434b948dacb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:23.769745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25599b-36c1-44df-97eb-33068ab97fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:23.770857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25599b-36c1-44df-97eb-33068ab97fba None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:23.771211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25599b-36c1-44df-97eb-33068ab97fba None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:23.771488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25599b-36c1-44df-97eb-33068ab97fba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:23.778315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25599b-36c1-44df-97eb-33068ab97fba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:23.779761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25599b-36c1-44df-97eb-33068ab97fba None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:23.787285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-fd25599b-36c1-44df-97eb-33068ab97fba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:23.794680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:23.801344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:23.802291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:23.802291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:23.802291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:23.802291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:23.802291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:23.802291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:23.802291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:23.802291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:23.802291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 395/763] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:23.802291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0707c-b885-4944-b160-5a96730d26b0 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:23.802291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0707c-b885-4944-b160-5a96730d26b0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:23.802913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0707c-b885-4944-b160-5a96730d26b0 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:23.802913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 396/764] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:23.802913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0707c-b885-4944-b160-5a96730d26b0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:23.839437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488d0db-34cf-4f79-aedf-479a4aec0ff6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:23.874534 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357d39f-a2fa-4f00-8b2f-59ef64021743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:23.875758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357d39f-a2fa-4f00-8b2f-59ef64021743 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:23.876093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357d39f-a2fa-4f00-8b2f-59ef64021743 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:23.876376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357d39f-a2fa-4f00-8b2f-59ef64021743 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:23.877078 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357d39f-a2fa-4f00-8b2f-59ef64021743 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:23.877380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357d39f-a2fa-4f00-8b2f-59ef64021743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:23.878760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357d39f-a2fa-4f00-8b2f-59ef64021743 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:23.884750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 369/765] 10.222.0.74 () {56 vars in 1124 bytes} [Thu Jul 14 10:05:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:23.885531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357d39f-a2fa-4f00-8b2f-59ef64021743 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:23.914920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0707c-b885-4944-b160-5a96730d26b0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:23.945425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:23.957310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accc92a-94c8-412e-9856-3afe01916b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:23.958111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accc92a-94c8-412e-9856-3afe01916b08 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:23.958393 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accc92a-94c8-412e-9856-3afe01916b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:23.963149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accc92a-94c8-412e-9856-3afe01916b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:23.970500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accc92a-94c8-412e-9856-3afe01916b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:23.972172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accc92a-94c8-412e-9856-3afe01916b08 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:23.991204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357d39f-a2fa-4f00-8b2f-59ef64021743 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-0accc92a-94c8-412e-9856-3afe01916b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:23.992905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:23.993804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:23.994791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:23.994791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:23.994791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:23.994791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:23.999532 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 397/766] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:24.000730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12474ae-a30e-48a4-b717-becda4a98411 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:24.001015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12474ae-a30e-48a4-b717-becda4a98411 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:24.001288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12474ae-a30e-48a4-b717-becda4a98411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:24.008885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:24.018314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f12474ae-a30e-48a4-b717-becda4a98411 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:24.019491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f12474ae-a30e-48a4-b717-becda4a98411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:24.026820 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32793f18-7475-46c9-bc69-0285abea1096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:24.027484 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32793f18-7475-46c9-bc69-0285abea1096 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:24.027765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32793f18-7475-46c9-bc69-0285abea1096 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:24.028073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32793f18-7475-46c9-bc69-0285abea1096 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:24.028944 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32793f18-7475-46c9-bc69-0285abea1096 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:24.029254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32793f18-7475-46c9-bc69-0285abea1096 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:24.030718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32793f18-7475-46c9-bc69-0285abea1096 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:24.050107 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 370/767] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:24.050107 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32793f18-7475-46c9-bc69-0285abea1096 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:24.104739 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 398/768] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:24.106608 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12474ae-a30e-48a4-b717-becda4a98411 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:24.155636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32793f18-7475-46c9-bc69-0285abea1096 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:24.190570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fabea-314a-40cf-9596-3c86540081f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:24.191228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fabea-314a-40cf-9596-3c86540081f2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:24.191507 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fabea-314a-40cf-9596-3c86540081f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:24.191779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fabea-314a-40cf-9596-3c86540081f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:24.192605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fabea-314a-40cf-9596-3c86540081f2 None admin] RBAC: Adding query filter params (interface=public, service_id=2ccade30b11d47f58a3560b051fd055a, region_id=RegionOne) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:24.192911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fabea-314a-40cf-9596-3c86540081f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:24.194302 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fabea-314a-40cf-9596-3c86540081f2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:24.201984 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 371/769] 10.222.0.74 () {56 vars in 1251 bytes} [Thu Jul 14 10:05:24 2022] GET /identity/v3/endpoints?service_id=2ccade30b11d47f58a3560b051fd055a&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:24.207386 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fabea-314a-40cf-9596-3c86540081f2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:24.225179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12474ae-a30e-48a4-b717-becda4a98411 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:24.228493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:24.253721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:24.261354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf1427-2712-4a5b-8050-e50bf98e9d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:24.262019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf1427-2712-4a5b-8050-e50bf98e9d8f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:24.262305 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf1427-2712-4a5b-8050-e50bf98e9d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:24.262582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf1427-2712-4a5b-8050-e50bf98e9d8f None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:24.263309 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf1427-2712-4a5b-8050-e50bf98e9d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:24.263622 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf1427-2712-4a5b-8050-e50bf98e9d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:24.265012 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf1427-2712-4a5b-8050-e50bf98e9d8f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:24.282100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 399/770] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:24.282100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf1427-2712-4a5b-8050-e50bf98e9d8f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:24.319160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fabea-314a-40cf-9596-3c86540081f2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:24.355813 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600312-d754-4c85-bfc0-5f7b04c17e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:24.356687 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600312-d754-4c85-bfc0-5f7b04c17e5a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:24.357148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600312-d754-4c85-bfc0-5f7b04c17e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:24.357591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600312-d754-4c85-bfc0-5f7b04c17e5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:24.358422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7600312-d754-4c85-bfc0-5f7b04c17e5a None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=323279b7ad0c418b848d6d7ae26ec5d2) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:24.358735 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7600312-d754-4c85-bfc0-5f7b04c17e5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:24.360806 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7600312-d754-4c85-bfc0-5f7b04c17e5a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:24.368150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 372/771] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:24 2022] GET /identity/v3/role_assignments?user.id=323279b7ad0c418b848d6d7ae26ec5d2&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:24.369196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600312-d754-4c85-bfc0-5f7b04c17e5a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:24.399328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf1427-2712-4a5b-8050-e50bf98e9d8f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:24.440543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60df1f7-41ad-4ed1-9777-e6fd70a0fac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:24.441394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60df1f7-41ad-4ed1-9777-e6fd70a0fac7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:24.441677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60df1f7-41ad-4ed1-9777-e6fd70a0fac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:24.441954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60df1f7-41ad-4ed1-9777-e6fd70a0fac7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:24.442722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60df1f7-41ad-4ed1-9777-e6fd70a0fac7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:24.444042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60df1f7-41ad-4ed1-9777-e6fd70a0fac7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-d60df1f7-41ad-4ed1-9777-e6fd70a0fac7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:24.457384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:24.458459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:24.459310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:24.459310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:24.459310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:24.459310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:24.459310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:24.459310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:24.459310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:24.459310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:24.459310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:24.459310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:24.459310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:24.459310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:24.459310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:05:24.459310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:24.464041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 400/772] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:24 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:24.465032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60df1f7-41ad-4ed1-9777-e6fd70a0fac7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:24.501391 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:24.509733 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600312-d754-4c85-bfc0-5f7b04c17e5a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:24.519990 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:24.561297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17efb6-9c42-4083-8675-6238dc39c2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:24.563218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17efb6-9c42-4083-8675-6238dc39c2ab None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:24.563509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17efb6-9c42-4083-8675-6238dc39c2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:24.563957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17efb6-9c42-4083-8675-6238dc39c2ab None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:24.564723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17efb6-9c42-4083-8675-6238dc39c2ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:24.567006 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17efb6-9c42-4083-8675-6238dc39c2ab None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:24.574322 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 373/773] 10.222.0.74 () {56 vars in 1087 bytes} [Thu Jul 14 10:05:24 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:24.575213 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17efb6-9c42-4083-8675-6238dc39c2ab None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:24.590508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60df1f7-41ad-4ed1-9777-e6fd70a0fac7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:24.633711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd53959-a6de-449b-aa8a-c780765868bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:24.634600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53959-a6de-449b-aa8a-c780765868bc None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:24.634886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53959-a6de-449b-aa8a-c780765868bc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:24.635165 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53959-a6de-449b-aa8a-c780765868bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:24.643965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd53959-a6de-449b-aa8a-c780765868bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:24.645602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd53959-a6de-449b-aa8a-c780765868bc None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-8fd53959-a6de-449b-aa8a-c780765868bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:24.662293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:24.663248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:24.664175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:24.664175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:24.664175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:24.664175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:24.664175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:24.664175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:24.664175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:24.664175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:24.664628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 401/774] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:24.675141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd53959-a6de-449b-aa8a-c780765868bc None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:24.792599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17efb6-9c42-4083-8675-6238dc39c2ab None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:24.830722 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57c366-0d34-46d4-955d-de0f43243a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:24.831869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57c366-0d34-46d4-955d-de0f43243a93 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:24.832374 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57c366-0d34-46d4-955d-de0f43243a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:24.832846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57c366-0d34-46d4-955d-de0f43243a93 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:24.833769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57c366-0d34-46d4-955d-de0f43243a93 None admin] RBAC: Adding query filter params (name=network) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:24.834280 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57c366-0d34-46d4-955d-de0f43243a93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:24.834733 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:24.837138 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57c366-0d34-46d4-955d-de0f43243a93 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:24.842619 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 374/775] 10.222.0.74 () {56 vars in 1112 bytes} [Thu Jul 14 10:05:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:24.847808 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57c366-0d34-46d4-955d-de0f43243a93 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:24.848048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd53959-a6de-449b-aa8a-c780765868bc None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:24.886304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:24.889722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f7412-aca9-4e83-b557-201ae86941d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:24.890405 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f7412-aca9-4e83-b557-201ae86941d9 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:24.890835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f7412-aca9-4e83-b557-201ae86941d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:24.891114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f7412-aca9-4e83-b557-201ae86941d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:24.891919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f7412-aca9-4e83-b557-201ae86941d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:24.892259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f7412-aca9-4e83-b557-201ae86941d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:24.893902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f7412-aca9-4e83-b557-201ae86941d9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:24.907607 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 402/776] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:24.913621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f7412-aca9-4e83-b557-201ae86941d9 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:24.959210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57c366-0d34-46d4-955d-de0f43243a93 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:25.022151 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f7412-aca9-4e83-b557-201ae86941d9 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:25.048733 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d35d6-852e-4115-8899-1b6ad3966c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:25.049758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d35d6-852e-4115-8899-1b6ad3966c84 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:25.050237 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d35d6-852e-4115-8899-1b6ad3966c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:25.050748 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d35d6-852e-4115-8899-1b6ad3966c84 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:25.051672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d35d6-852e-4115-8899-1b6ad3966c84 None admin] RBAC: Adding query filter params (type=network) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:25.052194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d35d6-852e-4115-8899-1b6ad3966c84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:25.053791 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d35d6-852e-4115-8899-1b6ad3966c84 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:25.070722 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 375/777] 10.222.0.74 () {56 vars in 1112 bytes} [Thu Jul 14 10:05:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:25.072049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33609065-2f4e-47db-bd77-829c97e741a1 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:25.072339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33609065-2f4e-47db-bd77-829c97e741a1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:25.072616 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33609065-2f4e-47db-bd77-829c97e741a1 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:25.074989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 376/778] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:25.076657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33609065-2f4e-47db-bd77-829c97e741a1 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:25.084120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2eea2d-2fea-43b5-8439-f28084573264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:25.084782 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eea2d-2fea-43b5-8439-f28084573264 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:25.085060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eea2d-2fea-43b5-8439-f28084573264 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:25.085334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eea2d-2fea-43b5-8439-f28084573264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:25.086161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eea2d-2fea-43b5-8439-f28084573264 None admin] RBAC: Adding query filter params (role.id=feef3a85c1c0446590c2671a9f266cf4, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=75710267bbf04b629f1fd96ca761b89d) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:25.086469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eea2d-2fea-43b5-8439-f28084573264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:25.087890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eea2d-2fea-43b5-8439-f28084573264 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:25.094984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 403/779] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:24 2022] GET /identity/v3/role_assignments?user.id=75710267bbf04b629f1fd96ca761b89d&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=feef3a85c1c0446590c2671a9f266cf4 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:25.096861 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4af4-715d-4ed0-a0a4-b276fb981611 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:25.097146 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4af4-715d-4ed0-a0a4-b276fb981611 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:25.097687 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4af4-715d-4ed0-a0a4-b276fb981611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:25.120593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ae1f4af4-715d-4ed0-a0a4-b276fb981611 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:25.121883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ae1f4af4-715d-4ed0-a0a4-b276fb981611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:25.140506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:25.256957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:25.262055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33609065-2f4e-47db-bd77-829c97e741a1 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:25.271171 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 404/780] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:25.295470 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f4af4-715d-4ed0-a0a4-b276fb981611 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:25.301097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85f4e9-6f46-46d9-bd00-2d115ff1a105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:25.301761 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85f4e9-6f46-46d9-bd00-2d115ff1a105 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:25.302042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85f4e9-6f46-46d9-bd00-2d115ff1a105 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:25.302312 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85f4e9-6f46-46d9-bd00-2d115ff1a105 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:25.303157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85f4e9-6f46-46d9-bd00-2d115ff1a105 None admin] RBAC: Adding query filter params (interface=public, service_id=6066c371569e4ac2a89aac85d2c0db07, region_id=RegionOne) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:25.303467 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85f4e9-6f46-46d9-bd00-2d115ff1a105 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:25.305046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85f4e9-6f46-46d9-bd00-2d115ff1a105 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:25.312033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 377/781] 10.222.0.74 () {56 vars in 1251 bytes} [Thu Jul 14 10:05:25 2022] GET /identity/v3/endpoints?service_id=6066c371569e4ac2a89aac85d2c0db07&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:25.316836 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85f4e9-6f46-46d9-bd00-2d115ff1a105 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:25.407320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f4af4-715d-4ed0-a0a4-b276fb981611 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:25.421112 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85f4e9-6f46-46d9-bd00-2d115ff1a105 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:25.444639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3db5b-c084-4614-b373-b79efc5cdc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:25.445675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3db5b-c084-4614-b373-b79efc5cdc51 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:25.446331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3db5b-c084-4614-b373-b79efc5cdc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:25.446504 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3db5b-c084-4614-b373-b79efc5cdc51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:25.457312 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8bc8e-4bec-41a9-9579-62dfcb52e2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:25.458286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8bc8e-4bec-41a9-9579-62dfcb52e2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:25.458791 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8bc8e-4bec-41a9-9579-62dfcb52e2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:25.459263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8bc8e-4bec-41a9-9579-62dfcb52e2b5 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:25.468015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8bc8e-4bec-41a9-9579-62dfcb52e2b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:25.468167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3db5b-c084-4614-b373-b79efc5cdc51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:25.470345 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8bc8e-4bec-41a9-9579-62dfcb52e2b5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-31a3db5b-c084-4614-b373-b79efc5cdc51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:25.473633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:25.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:25.475420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:25.475420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:25.475420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:25.475420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:25.475420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:25.475420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:25.475420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:25.475420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:25.475420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:25.475420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:25.475420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:05:25.475420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:25.479685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 405/782] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:05:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:25.480044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 378/783] 10.222.0.74 () {56 vars in 1087 bytes} [Thu Jul 14 10:05:25 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:25.488039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3db5b-c084-4614-b373-b79efc5cdc51 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:25.500891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:25.660696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3db5b-c084-4614-b373-b79efc5cdc51 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:25.712889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb50d05-d7e5-4c28-996a-1c928e506518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:25.713598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb50d05-d7e5-4c28-996a-1c928e506518 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:25.713928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb50d05-d7e5-4c28-996a-1c928e506518 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:25.714212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb50d05-d7e5-4c28-996a-1c928e506518 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:25.714984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb50d05-d7e5-4c28-996a-1c928e506518 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:25.715295 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb50d05-d7e5-4c28-996a-1c928e506518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:25.716745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb50d05-d7e5-4c28-996a-1c928e506518 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:25.727803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 406/784] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:05:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:25.733075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8bc8e-4bec-41a9-9579-62dfcb52e2b5 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:25.768475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:25.845243 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8bc8e-4bec-41a9-9579-62dfcb52e2b5 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:25.884372 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d92056-efc4-42d0-a47e-6777719be22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:25.885513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92056-efc4-42d0-a47e-6777719be22e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:25.885994 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92056-efc4-42d0-a47e-6777719be22e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:25.886488 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92056-efc4-42d0-a47e-6777719be22e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:25.897377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d92056-efc4-42d0-a47e-6777719be22e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:25.899072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d92056-efc4-42d0-a47e-6777719be22e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-64d92056-efc4-42d0-a47e-6777719be22e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:25.916947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:25.917847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:25.918753 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:25.918753 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:25.918753 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:25.918753 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:25.920962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 379/785] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:25.928033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb50d05-d7e5-4c28-996a-1c928e506518 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:26.028396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:26.070329 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb50d05-d7e5-4c28-996a-1c928e506518 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:26.112760 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a58b5-757d-4ea6-9f64-0936bbe32aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:26.113497 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a58b5-757d-4ea6-9f64-0936bbe32aee None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:26.113787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a58b5-757d-4ea6-9f64-0936bbe32aee None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:26.114065 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a58b5-757d-4ea6-9f64-0936bbe32aee None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:26.114799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a58b5-757d-4ea6-9f64-0936bbe32aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:26.115107 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a58b5-757d-4ea6-9f64-0936bbe32aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:26.116512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a58b5-757d-4ea6-9f64-0936bbe32aee None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:26.135127 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 407/786] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:26.141415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d92056-efc4-42d0-a47e-6777719be22e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:26.246681 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:26.268712 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d92056-efc4-42d0-a47e-6777719be22e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:26.303642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e665c4a-00ac-4403-b36a-7a1c46c2e82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:26.304463 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e665c4a-00ac-4403-b36a-7a1c46c2e82d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:26.304742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e665c4a-00ac-4403-b36a-7a1c46c2e82d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:26.305014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e665c4a-00ac-4403-b36a-7a1c46c2e82d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:26.312765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e665c4a-00ac-4403-b36a-7a1c46c2e82d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:26.314193 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e665c4a-00ac-4403-b36a-7a1c46c2e82d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-5e665c4a-00ac-4403-b36a-7a1c46c2e82d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:26.328577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:26.329589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:26.330588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:26.330588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:26.330588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:26.330588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:26.330588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:26.330588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:26.330588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:26.330588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:26.330588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:05:26.330588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:26.330588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 380/787] 10.222.0.74 () {56 vars in 1093 bytes} [Thu Jul 14 10:05:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:26.335600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a58b5-757d-4ea6-9f64-0936bbe32aee None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:26.498908 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a58b5-757d-4ea6-9f64-0936bbe32aee None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:26.528497 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:26.561148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984f679-f1b6-47c7-89b4-322d56c9bb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:26.562994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984f679-f1b6-47c7-89b4-322d56c9bb40 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:26.563479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984f679-f1b6-47c7-89b4-322d56c9bb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:26.563971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984f679-f1b6-47c7-89b4-322d56c9bb40 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:26.564925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984f679-f1b6-47c7-89b4-322d56c9bb40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:26.565247 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984f679-f1b6-47c7-89b4-322d56c9bb40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:26.566709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984f679-f1b6-47c7-89b4-322d56c9bb40 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:26.607022 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 408/788] 10.222.0.74 () {56 vars in 1133 bytes} [Thu Jul 14 10:05:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:26.613047 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e665c4a-00ac-4403-b36a-7a1c46c2e82d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:26.810818 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e665c4a-00ac-4403-b36a-7a1c46c2e82d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:26.850627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce31f7-19a5-4ac1-9fd6-677d12f8e1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:26.851357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce31f7-19a5-4ac1-9fd6-677d12f8e1eb None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:26.851587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce31f7-19a5-4ac1-9fd6-677d12f8e1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:26.851818 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce31f7-19a5-4ac1-9fd6-677d12f8e1eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:26.864904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:26.907748 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06350437-39bd-44d6-80b0-5704d05525d6 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:26.908081 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06350437-39bd-44d6-80b0-5704d05525d6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:26.908347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06350437-39bd-44d6-80b0-5704d05525d6 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:26.910600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 409/789] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:05:26.916258 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e9435-9b55-4178-b062-b38a8ee1e8ba None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:26.916621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e9435-9b55-4178-b062-b38a8ee1e8ba None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:26.916907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e9435-9b55-4178-b062-b38a8ee1e8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:26.937589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce31f7-19a5-4ac1-9fd6-677d12f8e1eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:26.939055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce31f7-19a5-4ac1-9fd6-677d12f8e1eb None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:26.949015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-385e9435-9b55-4178-b062-b38a8ee1e8ba None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:26.950230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-385e9435-9b55-4178-b062-b38a8ee1e8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:27.076653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 381/790] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:05:27.082658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce31f7-19a5-4ac1-9fd6-677d12f8e1eb None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:27.120729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 410/791] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:27.148389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:27.171963 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e9435-9b55-4178-b062-b38a8ee1e8ba None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:27.238919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce31f7-19a5-4ac1-9fd6-677d12f8e1eb None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:27.280633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aeed58-4cd6-4b49-97cb-9c9b92746a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:27.281465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeed58-4cd6-4b49-97cb-9c9b92746a4f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:27.281756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeed58-4cd6-4b49-97cb-9c9b92746a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:27.282041 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeed58-4cd6-4b49-97cb-9c9b92746a4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:27.295158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aeed58-4cd6-4b49-97cb-9c9b92746a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:27.296975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aeed58-4cd6-4b49-97cb-9c9b92746a4f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:27.311291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e9435-9b55-4178-b062-b38a8ee1e8ba None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-94aeed58-4cd6-4b49-97cb-9c9b92746a4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:27.319103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:27.320017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:27.320935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:27.320935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:27.320935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:27.320935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:27.324151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 382/792] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:27.325454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8ac72-aa1c-4e19-96ee-fe9018c13b7b None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:27.325743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8ac72-aa1c-4e19-96ee-fe9018c13b7b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:27.326024 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8ac72-aa1c-4e19-96ee-fe9018c13b7b None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:27.327487 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 383/793] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:27.330094 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8ac72-aa1c-4e19-96ee-fe9018c13b7b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:27.333416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:27.355948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568c4ab-710a-478b-836e-bc3a1ba1dbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:27.356780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568c4ab-710a-478b-836e-bc3a1ba1dbcd None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:27.357063 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568c4ab-710a-478b-836e-bc3a1ba1dbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:27.357341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568c4ab-710a-478b-836e-bc3a1ba1dbcd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:27.367811 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568c4ab-710a-478b-836e-bc3a1ba1dbcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-b568c4ab-710a-478b-836e-bc3a1ba1dbcd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:27.376831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:27.377835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:27.378677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:27.378677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:27.378677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:27.378677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:27.378677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:27.378677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:27.378677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:27.378677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:27.378677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:27.378677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:27.378677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:05:27.378677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:27.383212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 411/794] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:05:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:27.384450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fa9d7-4442-4b2c-bcd3-7759a78ac038 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:27.384745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fa9d7-4442-4b2c-bcd3-7759a78ac038 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:27.385030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fa9d7-4442-4b2c-bcd3-7759a78ac038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:27.403066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-642fa9d7-4442-4b2c-bcd3-7759a78ac038 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:27.404312 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-642fa9d7-4442-4b2c-bcd3-7759a78ac038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:27.453922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:27.465811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8ac72-aa1c-4e19-96ee-fe9018c13b7b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:27.478752 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 412/795] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:27.479617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fa9d7-4442-4b2c-bcd3-7759a78ac038 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:27.504764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae3acf-42ae-4a89-81b2-bc93b55728f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:27.505628 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3acf-42ae-4a89-81b2-bc93b55728f7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:27.506002 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3acf-42ae-4a89-81b2-bc93b55728f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:27.506355 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3acf-42ae-4a89-81b2-bc93b55728f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:27.507154 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae3acf-42ae-4a89-81b2-bc93b55728f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:27.507532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae3acf-42ae-4a89-81b2-bc93b55728f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:27.509222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae3acf-42ae-4a89-81b2-bc93b55728f7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:27.522693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 384/796] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:27.523848 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae3acf-42ae-4a89-81b2-bc93b55728f7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:27.589609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fa9d7-4442-4b2c-bcd3-7759a78ac038 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:27.589609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:27.620251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f46e8a-2b9b-4a99-aa60-eb1240e0fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:27.621235 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f46e8a-2b9b-4a99-aa60-eb1240e0fe81 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:27.621497 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f46e8a-2b9b-4a99-aa60-eb1240e0fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:27.621774 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f46e8a-2b9b-4a99-aa60-eb1240e0fe81 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:27.622536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f46e8a-2b9b-4a99-aa60-eb1240e0fe81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:27.622915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f46e8a-2b9b-4a99-aa60-eb1240e0fe81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:27.624315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f46e8a-2b9b-4a99-aa60-eb1240e0fe81 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:27.638246 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae3acf-42ae-4a89-81b2-bc93b55728f7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:27.639904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 413/797] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:05:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:27.640861 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f46e8a-2b9b-4a99-aa60-eb1240e0fe81 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:27.676102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1c5bc-f1b4-4128-a0f0-a1461664efff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:27.677003 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1c5bc-f1b4-4128-a0f0-a1461664efff None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:27.677291 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1c5bc-f1b4-4128-a0f0-a1461664efff None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:27.677574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1c5bc-f1b4-4128-a0f0-a1461664efff None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:27.678232 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1c5bc-f1b4-4128-a0f0-a1461664efff None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:27.679589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1c5bc-f1b4-4128-a0f0-a1461664efff None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-b6e1c5bc-f1b4-4128-a0f0-a1461664efff None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:27.692751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:27.693720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:27.694575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 385/798] 10.222.0.74 () {56 vars in 1129 bytes} [Thu Jul 14 10:05:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:27.695931 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c4da7-d054-40f9-a1d1-effb8818cfba None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:27.695931 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c4da7-d054-40f9-a1d1-effb8818cfba None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:27.695931 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c4da7-d054-40f9-a1d1-effb8818cfba None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:27.700402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 386/799] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:27.700402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c4da7-d054-40f9-a1d1-effb8818cfba None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:27.718939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:27.754280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f46e8a-2b9b-4a99-aa60-eb1240e0fe81 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:27.790700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa4cbd-3833-4e1c-93ae-c4e3f460eaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:27.791503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa4cbd-3833-4e1c-93ae-c4e3f460eaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:27.791787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa4cbd-3833-4e1c-93ae-c4e3f460eaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:27.792316 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa4cbd-3833-4e1c-93ae-c4e3f460eaf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:27.799889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa4cbd-3833-4e1c-93ae-c4e3f460eaf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:27.801372 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa4cbd-3833-4e1c-93ae-c4e3f460eaf8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:27.812102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c4da7-d054-40f9-a1d1-effb8818cfba None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a5fa4cbd-3833-4e1c-93ae-c4e3f460eaf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:27.816308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:27.817281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:27.818182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:27.818182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:27.818182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:27.818182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:27.818182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:27.818182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:27.818182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:27.818182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:27.822405 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 414/800] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:27.822919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa4cbd-3833-4e1c-93ae-c4e3f460eaf8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:27.849668 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c2cd0-7189-48c6-94ec-eda0234fd763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:27.849862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:27.851012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c2cd0-7189-48c6-94ec-eda0234fd763 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:27.851459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c2cd0-7189-48c6-94ec-eda0234fd763 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:27.851550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c2cd0-7189-48c6-94ec-eda0234fd763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:27.863244 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c2cd0-7189-48c6-94ec-eda0234fd763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:27.864741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c2cd0-7189-48c6-94ec-eda0234fd763 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-da7c2cd0-7189-48c6-94ec-eda0234fd763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:27.882875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:27.884015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:27.884959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:27.884959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:27.884959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:27.884959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:27.884959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 387/801] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:27.885380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70239e2-5603-4651-9175-d009cdb84824 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:27.885670 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70239e2-5603-4651-9175-d009cdb84824 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:27.885943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70239e2-5603-4651-9175-d009cdb84824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:27.904315 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b70239e2-5603-4651-9175-d009cdb84824 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:27.905511 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b70239e2-5603-4651-9175-d009cdb84824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:27.947759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa4cbd-3833-4e1c-93ae-c4e3f460eaf8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:27.968424 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:27.977152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 388/802] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:27.978799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70239e2-5603-4651-9175-d009cdb84824 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:28.008813 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5527c2-2ba3-46a7-8ea7-ddd8e06d2e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:28.009634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5527c2-2ba3-46a7-8ea7-ddd8e06d2e0d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:28.009915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5527c2-2ba3-46a7-8ea7-ddd8e06d2e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:28.010238 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5527c2-2ba3-46a7-8ea7-ddd8e06d2e0d None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:28.010954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5527c2-2ba3-46a7-8ea7-ddd8e06d2e0d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:28.011258 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5527c2-2ba3-46a7-8ea7-ddd8e06d2e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:28.012794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5527c2-2ba3-46a7-8ea7-ddd8e06d2e0d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:28.018588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 415/803] 10.222.0.74 () {56 vars in 1124 bytes} [Thu Jul 14 10:05:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:28.023204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5527c2-2ba3-46a7-8ea7-ddd8e06d2e0d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:28.084321 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70239e2-5603-4651-9175-d009cdb84824 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:28.113467 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:28.119111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd678a-92ec-4638-be6b-f7f56d6ca6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:28.119776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd678a-92ec-4638-be6b-f7f56d6ca6df None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:28.120101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd678a-92ec-4638-be6b-f7f56d6ca6df None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:28.120379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd678a-92ec-4638-be6b-f7f56d6ca6df None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:28.121163 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd678a-92ec-4638-be6b-f7f56d6ca6df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:28.121773 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd678a-92ec-4638-be6b-f7f56d6ca6df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:28.122959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd678a-92ec-4638-be6b-f7f56d6ca6df None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:28.125659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5527c2-2ba3-46a7-8ea7-ddd8e06d2e0d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:28.134972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 389/804] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:28.135775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd678a-92ec-4638-be6b-f7f56d6ca6df None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:28.160711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94367c6d-98c5-437f-8bb3-701cad9798cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:28.161379 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94367c6d-98c5-437f-8bb3-701cad9798cb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:28.161669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94367c6d-98c5-437f-8bb3-701cad9798cb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:28.161949 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94367c6d-98c5-437f-8bb3-701cad9798cb None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:28.162665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94367c6d-98c5-437f-8bb3-701cad9798cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:28.162973 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94367c6d-98c5-437f-8bb3-701cad9798cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:28.164408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94367c6d-98c5-437f-8bb3-701cad9798cb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:28.176126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 416/805] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:28.176908 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94367c6d-98c5-437f-8bb3-701cad9798cb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:28.195089 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:28.239331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd678a-92ec-4638-be6b-f7f56d6ca6df None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:28.272009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4fc1f-02d8-4f6f-a02c-e5b077ac6734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:28.272827 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4fc1f-02d8-4f6f-a02c-e5b077ac6734 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:28.273109 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4fc1f-02d8-4f6f-a02c-e5b077ac6734 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:28.273403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4fc1f-02d8-4f6f-a02c-e5b077ac6734 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:28.274605 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94367c6d-98c5-437f-8bb3-701cad9798cb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:28.283821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4fc1f-02d8-4f6f-a02c-e5b077ac6734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-61d4fc1f-02d8-4f6f-a02c-e5b077ac6734 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:28.291650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:28.292636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:28.293516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:28.293516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:28.293516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:28.293516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:28.293516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:28.293516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:28.293516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:28.293516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:28.293516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:28.293516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:28.293516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:28.293516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:28.293516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 390/806] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:28.294242 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bd936-a09b-4f46-bc8a-cded2f45fdf9 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:28.294321 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bd936-a09b-4f46-bc8a-cded2f45fdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:28.294721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bd936-a09b-4f46-bc8a-cded2f45fdf9 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:28.295785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 391/807] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:28.296520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bd936-a09b-4f46-bc8a-cded2f45fdf9 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:28.312930 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e213ad-23af-4751-8da0-70626bade258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:28.313602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e213ad-23af-4751-8da0-70626bade258 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:28.313882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e213ad-23af-4751-8da0-70626bade258 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:28.314157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e213ad-23af-4751-8da0-70626bade258 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:28.314870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e213ad-23af-4751-8da0-70626bade258 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:28.315175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e213ad-23af-4751-8da0-70626bade258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:28.316580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e213ad-23af-4751-8da0-70626bade258 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:28.321335 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 417/808] 10.222.0.74 () {56 vars in 1124 bytes} [Thu Jul 14 10:05:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:28.322090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e213ad-23af-4751-8da0-70626bade258 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:28.336465 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:28.405317 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bd936-a09b-4f46-bc8a-cded2f45fdf9 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:28.421750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:28.422665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e213ad-23af-4751-8da0-70626bade258 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:28.439094 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6a2d4-0629-4942-bef6-1788483c689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:28.439765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6a2d4-0629-4942-bef6-1788483c689b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:28.440397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6a2d4-0629-4942-bef6-1788483c689b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:28.441012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6a2d4-0629-4942-bef6-1788483c689b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:28.442282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6a2d4-0629-4942-bef6-1788483c689b None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=2a0626754b40449ba2346d05c5c90a35) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:28.442599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6a2d4-0629-4942-bef6-1788483c689b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:28.444055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6a2d4-0629-4942-bef6-1788483c689b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:28.450166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 392/809] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:28 2022] GET /identity/v3/role_assignments?user.id=2a0626754b40449ba2346d05c5c90a35&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:28.450940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6a2d4-0629-4942-bef6-1788483c689b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:28.456232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd367e42-73c9-48a9-8318-f6017f8513c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:28.457054 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd367e42-73c9-48a9-8318-f6017f8513c2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:28.457340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd367e42-73c9-48a9-8318-f6017f8513c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:28.457618 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd367e42-73c9-48a9-8318-f6017f8513c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:28.466692 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd367e42-73c9-48a9-8318-f6017f8513c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:28.469617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd367e42-73c9-48a9-8318-f6017f8513c2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-bd367e42-73c9-48a9-8318-f6017f8513c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:28.490724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:28.491826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:28.493082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:28.493082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:28.493082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:28.493082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:28.493082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:28.493082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:28.493082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:28.493082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:28.493082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:05:28.493082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:28.493082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 418/810] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:05:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:28.493792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4bc0e-d22a-4cb8-a770-dd8b83d1a146 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:28.494071 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4bc0e-d22a-4cb8-a770-dd8b83d1a146 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:28.494163 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4bc0e-d22a-4cb8-a770-dd8b83d1a146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:28.515894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8ec4bc0e-d22a-4cb8-a770-dd8b83d1a146 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:28.517202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8ec4bc0e-d22a-4cb8-a770-dd8b83d1a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:28.566944 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6a2d4-0629-4942-bef6-1788483c689b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:28.604020 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 419/811] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:28.604020 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4bc0e-d22a-4cb8-a770-dd8b83d1a146 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:28.604020 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:28.623100 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81341972-117f-4bf1-be0d-ead4f6b37fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:28.623785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81341972-117f-4bf1-be0d-ead4f6b37fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:28.624116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81341972-117f-4bf1-be0d-ead4f6b37fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:28.624399 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81341972-117f-4bf1-be0d-ead4f6b37fe3 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:28.625189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81341972-117f-4bf1-be0d-ead4f6b37fe3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:28.625496 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81341972-117f-4bf1-be0d-ead4f6b37fe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:28.626873 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81341972-117f-4bf1-be0d-ead4f6b37fe3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:28.636330 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 393/812] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:05:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:28.637150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81341972-117f-4bf1-be0d-ead4f6b37fe3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:28.684456 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:28.711231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4bc0e-d22a-4cb8-a770-dd8b83d1a146 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:28.743356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81341972-117f-4bf1-be0d-ead4f6b37fe3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:28.747599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651198a-4299-483e-90f9-998f3d302c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:28.748305 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651198a-4299-483e-90f9-998f3d302c9e None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:28.748594 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651198a-4299-483e-90f9-998f3d302c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:28.748873 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651198a-4299-483e-90f9-998f3d302c9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:28.749616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651198a-4299-483e-90f9-998f3d302c9e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:28.751504 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651198a-4299-483e-90f9-998f3d302c9e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:28.781760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ef8ef-ab9a-400b-8cde-53fe0feea47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:28.782433 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ef8ef-ab9a-400b-8cde-53fe0feea47d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:28.782718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ef8ef-ab9a-400b-8cde-53fe0feea47d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:28.782992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ef8ef-ab9a-400b-8cde-53fe0feea47d None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:28.783829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ef8ef-ab9a-400b-8cde-53fe0feea47d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:28.784174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ef8ef-ab9a-400b-8cde-53fe0feea47d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:28.785895 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ef8ef-ab9a-400b-8cde-53fe0feea47d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:28.804957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 394/813] 10.222.0.74 () {56 vars in 1135 bytes} [Thu Jul 14 10:05:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:28.805782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ef8ef-ab9a-400b-8cde-53fe0feea47d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:28.880069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 420/814] 10.222.0.74 () {60 vars in 1144 bytes} [Thu Jul 14 10:05:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:05:28.881065 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651198a-4299-483e-90f9-998f3d302c9e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:28.923665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:28.927763 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ef8ef-ab9a-400b-8cde-53fe0feea47d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:28.972876 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:28.979455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48160ae-edbd-4829-a9af-6c507f4c0e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:28.980432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48160ae-edbd-4829-a9af-6c507f4c0e3b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:28.980714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48160ae-edbd-4829-a9af-6c507f4c0e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:28.981036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48160ae-edbd-4829-a9af-6c507f4c0e3b None admin] PATH_INFO: `/v3/services/network` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:28.981712 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48160ae-edbd-4829-a9af-6c507f4c0e3b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:28.983124 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48160ae-edbd-4829-a9af-6c507f4c0e3b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-e48160ae-edbd-4829-a9af-6c507f4c0e3b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:28.996431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:28.997625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:28.998509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:28.998509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:28.998509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:28.998509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:28.998509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:28.998509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:28.998509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:28.998509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:28.998509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:28.998509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:28.998509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:28.998509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:28.998509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:05:28.998509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:29.002981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 395/815] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:28 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:29.003959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48160ae-edbd-4829-a9af-6c507f4c0e3b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:29.037120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651198a-4299-483e-90f9-998f3d302c9e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:29.084776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ee895-8b22-42b8-b30c-322081950349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:29.085755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ee895-8b22-42b8-b30c-322081950349 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:29.086043 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ee895-8b22-42b8-b30c-322081950349 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:29.086318 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ee895-8b22-42b8-b30c-322081950349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:29.101530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ee895-8b22-42b8-b30c-322081950349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:29.103584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ee895-8b22-42b8-b30c-322081950349 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:29.125637 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48160ae-edbd-4829-a9af-6c507f4c0e3b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-125ee895-8b22-42b8-b30c-322081950349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:29.126148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:29.127031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:29.127941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:29.127941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:29.127941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:29.127941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:29.128813 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 421/816] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:29.129644 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ee895-8b22-42b8-b30c-322081950349 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:29.168829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ab607-8611-4277-9a5c-f11dfbf0ea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:29.169634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab607-8611-4277-9a5c-f11dfbf0ea6e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:29.169948 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab607-8611-4277-9a5c-f11dfbf0ea6e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:29.170358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab607-8611-4277-9a5c-f11dfbf0ea6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:29.181873 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ab607-8611-4277-9a5c-f11dfbf0ea6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:29.183571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ab607-8611-4277-9a5c-f11dfbf0ea6e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-b10ab607-8611-4277-9a5c-f11dfbf0ea6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:29.202034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:29.203502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:29.204444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:29.204444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:29.204444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:29.204444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:29.204444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 396/817] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:29.205165 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ab607-8611-4277-9a5c-f11dfbf0ea6e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:29.222121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:29.246402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ee895-8b22-42b8-b30c-322081950349 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:29.260027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:29.288538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb01f1-dad6-4a23-8c3e-a3c292079266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:29.289216 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb01f1-dad6-4a23-8c3e-a3c292079266 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:29.289502 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb01f1-dad6-4a23-8c3e-a3c292079266 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:29.289780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb01f1-dad6-4a23-8c3e-a3c292079266 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:29.290495 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb01f1-dad6-4a23-8c3e-a3c292079266 None admin] RBAC: Adding query filter params (name=network) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:29.290800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb01f1-dad6-4a23-8c3e-a3c292079266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:29.292211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb01f1-dad6-4a23-8c3e-a3c292079266 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:29.297179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 422/818] 10.222.0.74 () {56 vars in 1112 bytes} [Thu Jul 14 10:05:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:29.298119 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb01f1-dad6-4a23-8c3e-a3c292079266 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:29.325495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ab607-8611-4277-9a5c-f11dfbf0ea6e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:29.367105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc6ce4-4c23-4e05-8b6c-51b216655b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:29.368116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc6ce4-4c23-4e05-8b6c-51b216655b26 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:29.368413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc6ce4-4c23-4e05-8b6c-51b216655b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:29.368693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc6ce4-4c23-4e05-8b6c-51b216655b26 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:29.369759 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc6ce4-4c23-4e05-8b6c-51b216655b26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:29.370072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc6ce4-4c23-4e05-8b6c-51b216655b26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:29.371682 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc6ce4-4c23-4e05-8b6c-51b216655b26 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:29.387049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 397/819] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:29.387955 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc6ce4-4c23-4e05-8b6c-51b216655b26 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:29.426106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb01f1-dad6-4a23-8c3e-a3c292079266 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:29.471828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04be0d-bdac-4a31-a1c0-6463a63038e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:29.472769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04be0d-bdac-4a31-a1c0-6463a63038e4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:29.473058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04be0d-bdac-4a31-a1c0-6463a63038e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:29.473335 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04be0d-bdac-4a31-a1c0-6463a63038e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:29.474058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04be0d-bdac-4a31-a1c0-6463a63038e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:29.475381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04be0d-bdac-4a31-a1c0-6463a63038e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:29.476792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04be0d-bdac-4a31-a1c0-6463a63038e4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:29.481530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:29.495680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 423/820] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:29.497004 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04be0d-bdac-4a31-a1c0-6463a63038e4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:29.516623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc6ce4-4c23-4e05-8b6c-51b216655b26 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:29.541795 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:29.566694 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe883db9-805e-4cf0-93e6-cf16b2e90706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:29.567581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe883db9-805e-4cf0-93e6-cf16b2e90706 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:29.568137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe883db9-805e-4cf0-93e6-cf16b2e90706 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:29.568606 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe883db9-805e-4cf0-93e6-cf16b2e90706 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:29.569631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe883db9-805e-4cf0-93e6-cf16b2e90706 None admin] RBAC: Adding query filter params (type=network) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:29.570047 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe883db9-805e-4cf0-93e6-cf16b2e90706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:29.572342 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe883db9-805e-4cf0-93e6-cf16b2e90706 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:29.580240 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 398/821] 10.222.0.74 () {56 vars in 1112 bytes} [Thu Jul 14 10:05:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:29.581254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe883db9-805e-4cf0-93e6-cf16b2e90706 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:29.632294 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04be0d-bdac-4a31-a1c0-6463a63038e4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:29.702482 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe883db9-805e-4cf0-93e6-cf16b2e90706 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:29.745047 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5eff6-9495-4e43-b313-d472bb67974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:29.746183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5eff6-9495-4e43-b313-d472bb67974f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:29.746607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5eff6-9495-4e43-b313-d472bb67974f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:29.747078 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5eff6-9495-4e43-b313-d472bb67974f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:29.750493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:29.756031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5eff6-9495-4e43-b313-d472bb67974f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:29.757686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5eff6-9495-4e43-b313-d472bb67974f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-0db5eff6-9495-4e43-b313-d472bb67974f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:29.774199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:29.785729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:29.786650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:29.786650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:29.786650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:29.786650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:29.786650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:29.786650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:29.786650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:29.786650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:29.786650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 399/822] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:29.786650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5eff6-9495-4e43-b313-d472bb67974f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:29.802681 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716cc74-2345-4906-a33f-a0c7b22e7a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:29.804038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716cc74-2345-4906-a33f-a0c7b22e7a6f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:29.804602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716cc74-2345-4906-a33f-a0c7b22e7a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:29.805085 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716cc74-2345-4906-a33f-a0c7b22e7a6f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:29.814169 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716cc74-2345-4906-a33f-a0c7b22e7a6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:29.816112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716cc74-2345-4906-a33f-a0c7b22e7a6f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-8716cc74-2345-4906-a33f-a0c7b22e7a6f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:29.833181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:29.834212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:29.835218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:29.835218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:29.835218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:29.835218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:29.835218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:29.835218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:29.835218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:29.835218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:29.835218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:05:29.835218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:29.838106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 424/823] 10.222.0.74 () {56 vars in 1117 bytes} [Thu Jul 14 10:05:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:29.839291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716cc74-2345-4906-a33f-a0c7b22e7a6f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:29.957894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:29.967106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716cc74-2345-4906-a33f-a0c7b22e7a6f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:30.017882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accc95f-57da-42c7-b82e-872386400319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:30.018480 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc95f-57da-42c7-b82e-872386400319 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:30.018762 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc95f-57da-42c7-b82e-872386400319 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:30.019037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc95f-57da-42c7-b82e-872386400319 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:30.019825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accc95f-57da-42c7-b82e-872386400319 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:30.020160 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accc95f-57da-42c7-b82e-872386400319 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:30.021585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accc95f-57da-42c7-b82e-872386400319 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:30.027130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5eff6-9495-4e43-b313-d472bb67974f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:30.042873 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 425/824] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:30.044142 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accc95f-57da-42c7-b82e-872386400319 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:30.078474 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d052c2-8309-4392-aaf3-79f2181fffe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:30.079590 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d052c2-8309-4392-aaf3-79f2181fffe0 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:30.079880 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d052c2-8309-4392-aaf3-79f2181fffe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:30.080202 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d052c2-8309-4392-aaf3-79f2181fffe0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:30.080953 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d052c2-8309-4392-aaf3-79f2181fffe0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:30.082439 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d052c2-8309-4392-aaf3-79f2181fffe0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:30.163501 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accc95f-57da-42c7-b82e-872386400319 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:30.188150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 400/825] 10.222.0.74 () {60 vars in 1144 bytes} [Thu Jul 14 10:05:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:05:30.189540 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d052c2-8309-4392-aaf3-79f2181fffe0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:30.232102 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdd2a0-2b76-4b7d-98fe-b5c2b7511850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:30.234680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd2a0-2b76-4b7d-98fe-b5c2b7511850 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:30.236308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd2a0-2b76-4b7d-98fe-b5c2b7511850 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:30.237403 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd2a0-2b76-4b7d-98fe-b5c2b7511850 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:30.239817 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdd2a0-2b76-4b7d-98fe-b5c2b7511850 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:30.240366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdd2a0-2b76-4b7d-98fe-b5c2b7511850 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:30.242416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdd2a0-2b76-4b7d-98fe-b5c2b7511850 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:30.282725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 426/826] 10.222.0.74 () {56 vars in 1149 bytes} [Thu Jul 14 10:05:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:30.288714 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdd2a0-2b76-4b7d-98fe-b5c2b7511850 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:30.307938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:30.308157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:30.395950 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d052c2-8309-4392-aaf3-79f2181fffe0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:30.452022 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438419c-edf9-4c76-967c-57614589f2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:30.453366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438419c-edf9-4c76-967c-57614589f2b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:30.454030 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438419c-edf9-4c76-967c-57614589f2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:30.454968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438419c-edf9-4c76-967c-57614589f2b4 None admin] PATH_INFO: `/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/323279b7ad0c418b848d6d7ae26ec5d2/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:30.457577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438419c-edf9-4c76-967c-57614589f2b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=795b6593e7b74eeda9929aba07cbaa0e, user_id=323279b7ad0c418b848d6d7ae26ec5d2, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:30.457871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdd2a0-2b76-4b7d-98fe-b5c2b7511850 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:30.459805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438419c-edf9-4c76-967c-57614589f2b4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:30.501030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b17074-8e6d-4b9c-9f13-df82b66af8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:30.502185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17074-8e6d-4b9c-9f13-df82b66af8db None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:30.502473 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17074-8e6d-4b9c-9f13-df82b66af8db None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:30.502764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17074-8e6d-4b9c-9f13-df82b66af8db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:30.513738 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b17074-8e6d-4b9c-9f13-df82b66af8db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:30.515226 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b17074-8e6d-4b9c-9f13-df82b66af8db None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:30.527396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 401/827] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:05:30 2022] PUT /identity/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/323279b7ad0c418b848d6d7ae26ec5d2/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-48b17074-8e6d-4b9c-9f13-df82b66af8db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:30.544526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:30.545715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:30.547209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:30.547209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:30.547209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:30.547209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:30.550230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 427/828] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:30.560242 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438419c-edf9-4c76-967c-57614589f2b4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:30.620112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d7b37-fd4f-4409-8ee5-b448a92189c3 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:30.620638 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d7b37-fd4f-4409-8ee5-b448a92189c3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:30.621462 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d7b37-fd4f-4409-8ee5-b448a92189c3 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:30.623895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 428/829] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:05:30.629755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ed32-1aa6-46d3-b650-6c8334d35a92 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:30.630298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ed32-1aa6-46d3-b650-6c8334d35a92 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:30.630744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ed32-1aa6-46d3-b650-6c8334d35a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:30.651628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e520ed32-1aa6-46d3-b650-6c8334d35a92 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:30.653022 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e520ed32-1aa6-46d3-b650-6c8334d35a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:30.690181 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438419c-edf9-4c76-967c-57614589f2b4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:30.710200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:30.724698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:30.739339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237f56d-4354-408d-b65b-072804cbbe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:30.740529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237f56d-4354-408d-b65b-072804cbbe22 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:30.741044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237f56d-4354-408d-b65b-072804cbbe22 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:30.741518 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237f56d-4354-408d-b65b-072804cbbe22 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:30.742208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 429/830] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:05:30.748729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237f56d-4354-408d-b65b-072804cbbe22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:30.749017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237f56d-4354-408d-b65b-072804cbbe22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:30.750591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237f56d-4354-408d-b65b-072804cbbe22 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:30.763067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 402/831] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:30.769317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520ed32-1aa6-46d3-b650-6c8334d35a92 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:30.773762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237f56d-4354-408d-b65b-072804cbbe22 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:30.884158 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520ed32-1aa6-46d3-b650-6c8334d35a92 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:30.905632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237f56d-4354-408d-b65b-072804cbbe22 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:30.923803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dfa5c-7c89-43e1-a299-1f0efb95d5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:30.924755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dfa5c-7c89-43e1-a299-1f0efb95d5dc None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:30.925111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dfa5c-7c89-43e1-a299-1f0efb95d5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:30.925454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dfa5c-7c89-43e1-a299-1f0efb95d5dc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:30.926195 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dfa5c-7c89-43e1-a299-1f0efb95d5dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:30.928195 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dfa5c-7c89-43e1-a299-1f0efb95d5dc None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-698dfa5c-7c89-43e1-a299-1f0efb95d5dc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:30.944854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:30.946080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:05:30.947175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:30.954244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 430/832] 10.222.0.74 () {56 vars in 1132 bytes} [Thu Jul 14 10:05:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:30.955771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dfa5c-7c89-43e1-a299-1f0efb95d5dc None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:30.963167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e093a6c-9bef-4639-b33e-4b9ebc3a0459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:30.964100 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e093a6c-9bef-4639-b33e-4b9ebc3a0459 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:30.964461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e093a6c-9bef-4639-b33e-4b9ebc3a0459 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:30.964875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e093a6c-9bef-4639-b33e-4b9ebc3a0459 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:30.976320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e093a6c-9bef-4639-b33e-4b9ebc3a0459 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:30.977948 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e093a6c-9bef-4639-b33e-4b9ebc3a0459 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-5e093a6c-9bef-4639-b33e-4b9ebc3a0459 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:30.993250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:30.994363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:30.995475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:30.995475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:30.995475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:30.995475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:30.995475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:30.995475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:30.995475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:30.995475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:30.997561 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 403/833] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:31.004412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e093a6c-9bef-4639-b33e-4b9ebc3a0459 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:31.027601 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:31.050426 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:31.080287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dfa5c-7c89-43e1-a299-1f0efb95d5dc None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:31.115068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e42c4f-04de-4a47-b03a-8d5fe013ae02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:31.115769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42c4f-04de-4a47-b03a-8d5fe013ae02 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:31.116076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42c4f-04de-4a47-b03a-8d5fe013ae02 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:31.116349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42c4f-04de-4a47-b03a-8d5fe013ae02 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:31.117052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e42c4f-04de-4a47-b03a-8d5fe013ae02 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:31.117354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e42c4f-04de-4a47-b03a-8d5fe013ae02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:31.118716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e42c4f-04de-4a47-b03a-8d5fe013ae02 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:31.123533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 431/834] 10.222.0.74 () {56 vars in 1126 bytes} [Thu Jul 14 10:05:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:31.125135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dcca8-18db-4337-8b00-669589729371 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:31.125419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dcca8-18db-4337-8b00-669589729371 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:31.125686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dcca8-18db-4337-8b00-669589729371 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:31.127047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 432/835] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:31.131468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dcca8-18db-4337-8b00-669589729371 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:31.133954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e093a6c-9bef-4639-b33e-4b9ebc3a0459 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:31.169785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7c44a-2256-472e-93d7-d4504356b823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:31.170511 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c44a-2256-472e-93d7-d4504356b823 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:31.170847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c44a-2256-472e-93d7-d4504356b823 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:31.171207 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c44a-2256-472e-93d7-d4504356b823 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:31.172122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7c44a-2256-472e-93d7-d4504356b823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:31.172495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7c44a-2256-472e-93d7-d4504356b823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:31.173986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7c44a-2256-472e-93d7-d4504356b823 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:31.191868 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 404/836] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:31.191868 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5a0e-b5b0-4243-b99d-3810e9685a92 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:31.191868 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5a0e-b5b0-4243-b99d-3810e9685a92 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:31.191868 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5a0e-b5b0-4243-b99d-3810e9685a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:31.205469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ac7c5a0e-b5b0-4243-b99d-3810e9685a92 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:31.206655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ac7c5a0e-b5b0-4243-b99d-3810e9685a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:31.241798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dcca8-18db-4337-8b00-669589729371 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:31.261780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:31.278367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 405/837] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:31.279795 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6f984-5044-4183-9666-aa367ce5781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:31.280894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6f984-5044-4183-9666-aa367ce5781d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:31.281396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6f984-5044-4183-9666-aa367ce5781d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:31.281945 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6f984-5044-4183-9666-aa367ce5781d None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:31.282846 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6f984-5044-4183-9666-aa367ce5781d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:31.283525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6f984-5044-4183-9666-aa367ce5781d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:31.285156 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c5a0e-b5b0-4243-b99d-3810e9685a92 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:31.285468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6f984-5044-4183-9666-aa367ce5781d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:31.299566 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 433/838] 10.222.0.74 () {56 vars in 1126 bytes} [Thu Jul 14 10:05:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:31.300597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6f984-5044-4183-9666-aa367ce5781d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:31.320755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:31.418782 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6f984-5044-4183-9666-aa367ce5781d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:31.440502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c5a0e-b5b0-4243-b99d-3810e9685a92 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:31.457910 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bc823-41bc-4388-b0d1-490e8707fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:31.458894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bc823-41bc-4388-b0d1-490e8707fba7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:31.459275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bc823-41bc-4388-b0d1-490e8707fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:31.459551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bc823-41bc-4388-b0d1-490e8707fba7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:31.461222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bc823-41bc-4388-b0d1-490e8707fba7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:31.461598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bc823-41bc-4388-b0d1-490e8707fba7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-179bc823-41bc-4388-b0d1-490e8707fba7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:31.475460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:31.476574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:31.477425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:31.477425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:31.477425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:31.477425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:31.477425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:31.477425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:31.477425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:31.477425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:31.477425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:31.477425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:31.477425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:31.477425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:31.477425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:05:31.477425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:31.482564 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 434/839] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:05:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:31.483352 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bc823-41bc-4388-b0d1-490e8707fba7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:31.485257 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628129e5-909a-4241-ad99-8b4b05c04b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:31.486152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628129e5-909a-4241-ad99-8b4b05c04b4e None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:31.486433 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628129e5-909a-4241-ad99-8b4b05c04b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:31.486709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628129e5-909a-4241-ad99-8b4b05c04b4e None admin] PATH_INFO: `/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/75710267bbf04b629f1fd96ca761b89d/roles/feef3a85c1c0446590c2671a9f266cf4` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:31.503054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628129e5-909a-4241-ad99-8b4b05c04b4e None admin] RBAC: Authorizing `identity:create_grant(project_id=795b6593e7b74eeda9929aba07cbaa0e, user_id=75710267bbf04b629f1fd96ca761b89d, role_id=feef3a85c1c0446590c2671a9f266cf4)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:31.504567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628129e5-909a-4241-ad99-8b4b05c04b4e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:31.538303 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:31.592382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 406/840] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:05:31 2022] PUT /identity/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/75710267bbf04b629f1fd96ca761b89d/roles/feef3a85c1c0446590c2671a9f266cf4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:05:31.598878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bc823-41bc-4388-b0d1-490e8707fba7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:31.639696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32b623-2a71-4950-be83-5bc37060f618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:31.641010 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32b623-2a71-4950-be83-5bc37060f618 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:31.641292 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32b623-2a71-4950-be83-5bc37060f618 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:31.641567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32b623-2a71-4950-be83-5bc37060f618 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:31.642348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32b623-2a71-4950-be83-5bc37060f618 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:31.642655 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32b623-2a71-4950-be83-5bc37060f618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:31.644117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32b623-2a71-4950-be83-5bc37060f618 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:31.650029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 435/841] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:05:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:31.656320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628129e5-909a-4241-ad99-8b4b05c04b4e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:31.740244 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:31.776965 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628129e5-909a-4241-ad99-8b4b05c04b4e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:31.814804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033208df-0e8e-49f0-b162-2f79c6189c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:31.815470 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033208df-0e8e-49f0-b162-2f79c6189c49 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:31.815751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033208df-0e8e-49f0-b162-2f79c6189c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:31.816038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033208df-0e8e-49f0-b162-2f79c6189c49 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:31.816751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033208df-0e8e-49f0-b162-2f79c6189c49 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:31.817053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033208df-0e8e-49f0-b162-2f79c6189c49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:31.818408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033208df-0e8e-49f0-b162-2f79c6189c49 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:31.822962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 407/842] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:05:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:32.662968 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58f92a-ea6a-45ad-9cce-8669ee1ad307 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:32.663530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58f92a-ea6a-45ad-9cce-8669ee1ad307 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:32.663530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58f92a-ea6a-45ad-9cce-8669ee1ad307 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:32.665264 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 436/843] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:32.670391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cf303-2ace-4131-99cb-488fb8989d09 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:32.670804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cf303-2ace-4131-99cb-488fb8989d09 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:32.670972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cf303-2ace-4131-99cb-488fb8989d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:32.690676 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0a2cf303-2ace-4131-99cb-488fb8989d09 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:32.691932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0a2cf303-2ace-4131-99cb-488fb8989d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:32.763972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 408/844] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:32.787950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58f92a-ea6a-45ad-9cce-8669ee1ad307 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:32.900884 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58f92a-ea6a-45ad-9cce-8669ee1ad307 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:32.912661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:32.937287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a75f8-d9f8-44ad-8b4c-743609208634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:32.938022 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a75f8-d9f8-44ad-8b4c-743609208634 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:32.938298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a75f8-d9f8-44ad-8b4c-743609208634 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:32.938565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a75f8-d9f8-44ad-8b4c-743609208634 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:32.952225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a75f8-d9f8-44ad-8b4c-743609208634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a78a75f8-d9f8-44ad-8b4c-743609208634 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:32.960415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:32.961400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:32.962460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:32.962460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:32.962460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:32.962460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:32.962460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:32.962460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:32.962460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:32.962460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:32.962460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:32.962460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:32.962460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:05:32.962460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:32.962460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 437/845] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:05:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:32.967498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cf303-2ace-4131-99cb-488fb8989d09 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:33.050227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:33.082325 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cf303-2ace-4131-99cb-488fb8989d09 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:33.118553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e6970-8a67-442e-b3b3-5ed4cbac094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:33.119235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e6970-8a67-442e-b3b3-5ed4cbac094c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:33.119514 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e6970-8a67-442e-b3b3-5ed4cbac094c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:33.119795 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e6970-8a67-442e-b3b3-5ed4cbac094c None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:33.120576 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e6970-8a67-442e-b3b3-5ed4cbac094c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:33.120876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e6970-8a67-442e-b3b3-5ed4cbac094c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:33.122248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e6970-8a67-442e-b3b3-5ed4cbac094c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:33.131338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 409/846] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:05:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:33.136901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a75f8-d9f8-44ad-8b4c-743609208634 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:33.244285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a75f8-d9f8-44ad-8b4c-743609208634 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:33.279692 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fa671-7580-4d1d-8345-333e68b05c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:33.281139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fa671-7580-4d1d-8345-333e68b05c22 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:33.281427 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fa671-7580-4d1d-8345-333e68b05c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:33.281694 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fa671-7580-4d1d-8345-333e68b05c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:33.292755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fa671-7580-4d1d-8345-333e68b05c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:33.294200 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fa671-7580-4d1d-8345-333e68b05c22 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-661fa671-7580-4d1d-8345-333e68b05c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:33.312954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:33.313901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:33.315019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:33.315019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:33.315019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:33.315019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:33.315019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 438/847] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:33.319771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e6970-8a67-442e-b3b3-5ed4cbac094c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:33.425819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e6970-8a67-442e-b3b3-5ed4cbac094c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:33.448079 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba8773-6a82-442d-bcf9-ded52032db30 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:33.448697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba8773-6a82-442d-bcf9-ded52032db30 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:33.449197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba8773-6a82-442d-bcf9-ded52032db30 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:33.452103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 439/848] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:05:33.455530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:33.457869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55340a1a-43f2-4f78-99ed-38bad2d7ca09 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:33.458370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55340a1a-43f2-4f78-99ed-38bad2d7ca09 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:33.458846 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55340a1a-43f2-4f78-99ed-38bad2d7ca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:33.461327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c55f27-4d45-468e-8e52-b1433adb3693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:33.461989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55f27-4d45-468e-8e52-b1433adb3693 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:33.462271 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55f27-4d45-468e-8e52-b1433adb3693 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:33.462540 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55f27-4d45-468e-8e52-b1433adb3693 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:33.463259 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c55f27-4d45-468e-8e52-b1433adb3693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:33.463561 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c55f27-4d45-468e-8e52-b1433adb3693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:33.464954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c55f27-4d45-468e-8e52-b1433adb3693 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:33.478725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-55340a1a-43f2-4f78-99ed-38bad2d7ca09 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:33.479057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 410/849] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:33.479798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-55340a1a-43f2-4f78-99ed-38bad2d7ca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:33.485906 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c55f27-4d45-468e-8e52-b1433adb3693 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:33.505781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:33.568152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 440/850] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:33.586411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55340a1a-43f2-4f78-99ed-38bad2d7ca09 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:33.611476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c55f27-4d45-468e-8e52-b1433adb3693 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:33.664219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2065ef3-43b4-49e9-ad82-c6925296a1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:33.665024 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2065ef3-43b4-49e9-ad82-c6925296a1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:33.665379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2065ef3-43b4-49e9-ad82-c6925296a1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:33.665918 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2065ef3-43b4-49e9-ad82-c6925296a1e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:33.681327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2065ef3-43b4-49e9-ad82-c6925296a1e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:33.682804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2065ef3-43b4-49e9-ad82-c6925296a1e9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-e2065ef3-43b4-49e9-ad82-c6925296a1e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:33.704920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:33.705933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:33.706899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:33.706899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:33.706899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:33.706899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:33.706899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:33.706899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:33.706899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:33.706899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:33.706899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:05:33.706899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:33.710946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 411/851] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:05:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:33.712240 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2065ef3-43b4-49e9-ad82-c6925296a1e9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:33.715902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55340a1a-43f2-4f78-99ed-38bad2d7ca09 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:33.753497 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654baf0-ea9c-4c0c-aa98-ada76f84e86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:33.754438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654baf0-ea9c-4c0c-aa98-ada76f84e86a None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:33.754869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654baf0-ea9c-4c0c-aa98-ada76f84e86a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:33.755286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654baf0-ea9c-4c0c-aa98-ada76f84e86a None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:33.756244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654baf0-ea9c-4c0c-aa98-ada76f84e86a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:33.757746 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654baf0-ea9c-4c0c-aa98-ada76f84e86a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:33.772529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:33.822405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2065ef3-43b4-49e9-ad82-c6925296a1e9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:33.838777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 441/852] 10.222.0.74 () {60 vars in 1141 bytes} [Thu Jul 14 10:05:33 2022] POST /identity/v3/services => generated 269 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:05:33.838777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc5ceb-ea16-438a-83fc-a970671dff30 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:33.838777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc5ceb-ea16-438a-83fc-a970671dff30 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:33.838777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc5ceb-ea16-438a-83fc-a970671dff30 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:33.838777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 442/853] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:33.844248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e612360-d6b1-49f0-bb58-913b6d5c60f3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:33.844853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e612360-d6b1-49f0-bb58-913b6d5c60f3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:33.845357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e612360-d6b1-49f0-bb58-913b6d5c60f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:33.864923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0e612360-d6b1-49f0-bb58-913b6d5c60f3 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:33.866623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0e612360-d6b1-49f0-bb58-913b6d5c60f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:33.873497 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee5e85-8d4a-4f76-8692-aac683a8c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:33.874383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee5e85-8d4a-4f76-8692-aac683a8c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:33.875174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee5e85-8d4a-4f76-8692-aac683a8c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:33.875448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee5e85-8d4a-4f76-8692-aac683a8c6f9 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:33.876398 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee5e85-8d4a-4f76-8692-aac683a8c6f9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:33.876707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee5e85-8d4a-4f76-8692-aac683a8c6f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:33.878869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee5e85-8d4a-4f76-8692-aac683a8c6f9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:33.884401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:33.901695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 412/854] 10.222.0.74 () {56 vars in 1135 bytes} [Thu Jul 14 10:05:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:33.909784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee5e85-8d4a-4f76-8692-aac683a8c6f9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:33.963017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 443/855] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:33 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:33.964890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b447b-a15e-4776-98aa-5e3eb88b9c8a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:33.965178 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b447b-a15e-4776-98aa-5e3eb88b9c8a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:33.965451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b447b-a15e-4776-98aa-5e3eb88b9c8a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:33.966930 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 444/856] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:33.973387 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81695a52-47d7-4c43-a739-94197730f93e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:33.973569 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81695a52-47d7-4c43-a739-94197730f93e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:33.973804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81695a52-47d7-4c43-a739-94197730f93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:33.992214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-81695a52-47d7-4c43-a739-94197730f93e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:33.993399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-81695a52-47d7-4c43-a739-94197730f93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:34.040415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee5e85-8d4a-4f76-8692-aac683a8c6f9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:34.041903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:34.076034 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 445/857] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:33 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:34.076034 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81695a52-47d7-4c43-a739-94197730f93e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:34.083092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026026ca-b139-42b5-9842-5ad98c54a746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:34.083750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026026ca-b139-42b5-9842-5ad98c54a746 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:34.084065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026026ca-b139-42b5-9842-5ad98c54a746 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:34.084341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026026ca-b139-42b5-9842-5ad98c54a746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:34.149729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:34.154432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026026ca-b139-42b5-9842-5ad98c54a746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:34.156471 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026026ca-b139-42b5-9842-5ad98c54a746 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:34.182411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81695a52-47d7-4c43-a739-94197730f93e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:34.219023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603f383-7236-45a1-a517-5582b33a1941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:34.219815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603f383-7236-45a1-a517-5582b33a1941 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:34.220119 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603f383-7236-45a1-a517-5582b33a1941 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:34.220388 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603f383-7236-45a1-a517-5582b33a1941 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:34.231018 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603f383-7236-45a1-a517-5582b33a1941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-f603f383-7236-45a1-a517-5582b33a1941 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:34.239756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:34.240750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:34.241598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:34.241598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:34.241598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:34.241598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:34.241598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:34.241598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:34.241598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:34.241598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:34.241598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:34.241598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:34.241598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:05:34.241598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:34.241598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 446/858] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:05:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:34.242315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603f383-7236-45a1-a517-5582b33a1941 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:34.266593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 413/859] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:33 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:05:34.266593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026026ca-b139-42b5-9842-5ad98c54a746 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:34.266593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:34.348342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603f383-7236-45a1-a517-5582b33a1941 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:34.369859 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026026ca-b139-42b5-9842-5ad98c54a746 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:34.380581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:34.386378 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ee4f6-abdb-48a9-943a-2317c3878fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:34.387580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ee4f6-abdb-48a9-943a-2317c3878fad None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:34.388031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ee4f6-abdb-48a9-943a-2317c3878fad None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:34.388306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ee4f6-abdb-48a9-943a-2317c3878fad None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:34.389019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ee4f6-abdb-48a9-943a-2317c3878fad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:34.390925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ee4f6-abdb-48a9-943a-2317c3878fad None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:34.408326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7861a-7425-40c2-a71e-01b0d6c0e8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:34.408994 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7861a-7425-40c2-a71e-01b0d6c0e8af None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:34.409531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7861a-7425-40c2-a71e-01b0d6c0e8af None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:34.409807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7861a-7425-40c2-a71e-01b0d6c0e8af None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:34.410546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7861a-7425-40c2-a71e-01b0d6c0e8af None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:34.411030 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7861a-7425-40c2-a71e-01b0d6c0e8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:34.412261 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7861a-7425-40c2-a71e-01b0d6c0e8af None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:34.420421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 414/860] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:05:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:34.421252 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7861a-7425-40c2-a71e-01b0d6c0e8af None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:34.472023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 447/861] 10.222.0.74 () {60 vars in 1141 bytes} [Thu Jul 14 10:05:34 2022] POST /identity/v3/services => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:05:34.472023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ee4f6-abdb-48a9-943a-2317c3878fad None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:34.489368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:34.533212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7861a-7425-40c2-a71e-01b0d6c0e8af None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:34.581901 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb7911-74c4-4d8d-83c4-275eed7b8f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:34.582730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb7911-74c4-4d8d-83c4-275eed7b8f3d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:34.583008 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb7911-74c4-4d8d-83c4-275eed7b8f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:34.583277 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb7911-74c4-4d8d-83c4-275eed7b8f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:34.596707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb7911-74c4-4d8d-83c4-275eed7b8f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:34.598560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb7911-74c4-4d8d-83c4-275eed7b8f3d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:34.617364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ee4f6-abdb-48a9-943a-2317c3878fad None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-f1eb7911-74c4-4d8d-83c4-275eed7b8f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:34.618539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:34.619465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:34.627481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:34.627481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:34.627481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:34.627481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:34.627481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 415/862] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:34.627481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb7911-74c4-4d8d-83c4-275eed7b8f3d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:34.665999 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cdabd-ba10-4922-92fc-52f4085f64e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:34.667191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cdabd-ba10-4922-92fc-52f4085f64e0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:34.668321 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cdabd-ba10-4922-92fc-52f4085f64e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:34.668832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cdabd-ba10-4922-92fc-52f4085f64e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:34.680561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cdabd-ba10-4922-92fc-52f4085f64e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:34.682185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cdabd-ba10-4922-92fc-52f4085f64e0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-7b8cdabd-ba10-4922-92fc-52f4085f64e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:34.703167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:34.704131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:34.705193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:34.705193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:34.705193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:34.705193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:34.705193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 448/863] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:34.711367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cdabd-ba10-4922-92fc-52f4085f64e0 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:34.751910 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb7911-74c4-4d8d-83c4-275eed7b8f3d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:34.763223 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:34.765770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:34.787557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d8b23-08d2-4159-85b4-80c0bbbcfdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:34.788381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8b23-08d2-4159-85b4-80c0bbbcfdea None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:34.788838 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8b23-08d2-4159-85b4-80c0bbbcfdea None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:34.789188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8b23-08d2-4159-85b4-80c0bbbcfdea None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:34.789986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d8b23-08d2-4159-85b4-80c0bbbcfdea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:34.790367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d8b23-08d2-4159-85b4-80c0bbbcfdea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:34.791809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d8b23-08d2-4159-85b4-80c0bbbcfdea None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:34.805241 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 416/864] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:34.812029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d8b23-08d2-4159-85b4-80c0bbbcfdea None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:34.827703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cdabd-ba10-4922-92fc-52f4085f64e0 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:34.875057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e147b9-9043-4214-b4c1-75d0f341f733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:34.876121 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e147b9-9043-4214-b4c1-75d0f341f733 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:34.876479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e147b9-9043-4214-b4c1-75d0f341f733 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:34.877034 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e147b9-9043-4214-b4c1-75d0f341f733 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:34.877767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e147b9-9043-4214-b4c1-75d0f341f733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:34.878236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e147b9-9043-4214-b4c1-75d0f341f733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:34.880234 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e147b9-9043-4214-b4c1-75d0f341f733 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:34.896110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 449/865] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:34.901806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e147b9-9043-4214-b4c1-75d0f341f733 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:34.930686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d8b23-08d2-4159-85b4-80c0bbbcfdea None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:34.968926 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05966e-3eee-48b8-9e52-68037de97f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:34.970144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05966e-3eee-48b8-9e52-68037de97f2b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:34.970625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05966e-3eee-48b8-9e52-68037de97f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:34.971102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05966e-3eee-48b8-9e52-68037de97f2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:34.979216 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05966e-3eee-48b8-9e52-68037de97f2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:34.981320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05966e-3eee-48b8-9e52-68037de97f2b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-1f05966e-3eee-48b8-9e52-68037de97f2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:34.996421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:34.997464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:34.998378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:34.998378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:34.998378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:34.998378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:34.998378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:34.998378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:34.998378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:34.998378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:35.006098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 417/866] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:35.007205 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05966e-3eee-48b8-9e52-68037de97f2b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:35.039318 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e147b9-9043-4214-b4c1-75d0f341f733 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:35.041160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:35.041948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:35.091270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7d69d-df71-41d3-a947-8ac1f773aa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:35.092738 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7d69d-df71-41d3-a947-8ac1f773aa69 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:35.093781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7d69d-df71-41d3-a947-8ac1f773aa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:35.094359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7d69d-df71-41d3-a947-8ac1f773aa69 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:35.104385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7d69d-df71-41d3-a947-8ac1f773aa69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:35.106475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7d69d-df71-41d3-a947-8ac1f773aa69 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-34d7d69d-df71-41d3-a947-8ac1f773aa69 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:35.127347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:35.128382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:35.129326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:35.129326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:35.129326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:35.129326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:35.129326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:35.129326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:35.129326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:35.129326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:35.129326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:05:35.129326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:35.132139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 450/867] 10.222.0.74 () {56 vars in 1117 bytes} [Thu Jul 14 10:05:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:35.134575 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7d69d-df71-41d3-a947-8ac1f773aa69 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:35.135893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05966e-3eee-48b8-9e52-68037de97f2b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:35.173631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c83356-0b62-4cc0-a3b6-fe9baa0442fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:35.174343 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83356-0b62-4cc0-a3b6-fe9baa0442fe None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:35.174623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83356-0b62-4cc0-a3b6-fe9baa0442fe None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:35.174957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83356-0b62-4cc0-a3b6-fe9baa0442fe None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:35.175717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c83356-0b62-4cc0-a3b6-fe9baa0442fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:35.176044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c83356-0b62-4cc0-a3b6-fe9baa0442fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:35.177465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c83356-0b62-4cc0-a3b6-fe9baa0442fe None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:35.196192 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 418/868] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:35.197077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c83356-0b62-4cc0-a3b6-fe9baa0442fe None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:35.259393 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7d69d-df71-41d3-a947-8ac1f773aa69 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:35.298976 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f72f8-fce0-47e8-b719-1c9775051c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:35.299732 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f72f8-fce0-47e8-b719-1c9775051c9c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:35.300105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f72f8-fce0-47e8-b719-1c9775051c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:35.300447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f72f8-fce0-47e8-b719-1c9775051c9c None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:35.301442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f72f8-fce0-47e8-b719-1c9775051c9c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:35.301834 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f72f8-fce0-47e8-b719-1c9775051c9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:35.302666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:35.304502 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f72f8-fce0-47e8-b719-1c9775051c9c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:35.313311 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c83356-0b62-4cc0-a3b6-fe9baa0442fe None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:35.328052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 451/869] 10.222.0.74 () {56 vars in 1149 bytes} [Thu Jul 14 10:05:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:35.333693 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f72f8-fce0-47e8-b719-1c9775051c9c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:35.358961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b742-e71e-4f31-867c-4edfcbb92fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:35.359613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b742-e71e-4f31-867c-4edfcbb92fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:35.359891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b742-e71e-4f31-867c-4edfcbb92fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:35.360206 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b742-e71e-4f31-867c-4edfcbb92fc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:35.361032 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03b742-e71e-4f31-867c-4edfcbb92fc2 None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=323279b7ad0c418b848d6d7ae26ec5d2) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:35.361336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03b742-e71e-4f31-867c-4edfcbb92fc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:35.362874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03b742-e71e-4f31-867c-4edfcbb92fc2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:35.364969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:35.376374 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 419/870] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:35 2022] GET /identity/v3/role_assignments?user.id=323279b7ad0c418b848d6d7ae26ec5d2&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:35.451978 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f72f8-fce0-47e8-b719-1c9775051c9c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:35.490930 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0082f-4e12-4968-af72-097c177d560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:35.492030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0082f-4e12-4968-af72-097c177d560c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:35.492550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0082f-4e12-4968-af72-097c177d560c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:35.493027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0082f-4e12-4968-af72-097c177d560c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:35.566672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0082f-4e12-4968-af72-097c177d560c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:35.568487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0082f-4e12-4968-af72-097c177d560c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:35.595265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:35.676135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 452/871] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:35 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:05:35.681758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b742-e71e-4f31-867c-4edfcbb92fc2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:35.789040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b742-e71e-4f31-867c-4edfcbb92fc2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:35.825011 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b408f-5c90-4ff0-8821-4efb7a70b1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:35.825816 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b408f-5c90-4ff0-8821-4efb7a70b1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:35.826099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b408f-5c90-4ff0-8821-4efb7a70b1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:35.826379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b408f-5c90-4ff0-8821-4efb7a70b1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:35.837846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b408f-5c90-4ff0-8821-4efb7a70b1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:35.839297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b408f-5c90-4ff0-8821-4efb7a70b1e6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-ab2b408f-5c90-4ff0-8821-4efb7a70b1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:35.857087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:35.857982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:35.859418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:35.859418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:35.859418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:35.859418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:35.859418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 420/872] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:35.864657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0082f-4e12-4968-af72-097c177d560c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:35.922319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12da68-77e7-453a-9f70-25d8bb79f899 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:35.922636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12da68-77e7-453a-9f70-25d8bb79f899 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:35.922878 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12da68-77e7-453a-9f70-25d8bb79f899 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:35.924538 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 421/873] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:05:35.929352 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c44e95-2bcd-4182-ae46-79a4a8b37418 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:35.929638 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c44e95-2bcd-4182-ae46-79a4a8b37418 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:35.929919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c44e95-2bcd-4182-ae46-79a4a8b37418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:35.947767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e2c44e95-2bcd-4182-ae46-79a4a8b37418 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:35.949025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e2c44e95-2bcd-4182-ae46-79a4a8b37418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:35.951265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:35.980985 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0082f-4e12-4968-af72-097c177d560c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:36.009112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:36.022157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a8bd0-6332-41d1-89d2-0d9f9155a9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:36.022959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a8bd0-6332-41d1-89d2-0d9f9155a9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:36.023364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a8bd0-6332-41d1-89d2-0d9f9155a9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:36.023743 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a8bd0-6332-41d1-89d2-0d9f9155a9d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:36.024705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a8bd0-6332-41d1-89d2-0d9f9155a9d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:36.025392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a8bd0-6332-41d1-89d2-0d9f9155a9d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:36.026816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a8bd0-6332-41d1-89d2-0d9f9155a9d4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:36.031599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 422/874] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:05:36.042594 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 453/875] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:36.048777 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c44e95-2bcd-4182-ae46-79a4a8b37418 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:36.055003 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a8bd0-6332-41d1-89d2-0d9f9155a9d4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:36.160524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c44e95-2bcd-4182-ae46-79a4a8b37418 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:36.184958 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a8bd0-6332-41d1-89d2-0d9f9155a9d4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:36.201949 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b1cda-12ca-42f3-a23a-021d501ef866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:36.203038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b1cda-12ca-42f3-a23a-021d501ef866 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:36.203427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b1cda-12ca-42f3-a23a-021d501ef866 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:36.203903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b1cda-12ca-42f3-a23a-021d501ef866 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:36.211385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b1cda-12ca-42f3-a23a-021d501ef866 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:36.213164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b1cda-12ca-42f3-a23a-021d501ef866 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:36.215003 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:36.223817 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff6b4f-57a2-4992-90c7-2b90d8a19dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:36.224983 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff6b4f-57a2-4992-90c7-2b90d8a19dbb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:36.225424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff6b4f-57a2-4992-90c7-2b90d8a19dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:36.225846 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff6b4f-57a2-4992-90c7-2b90d8a19dbb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:36.226644 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff6b4f-57a2-4992-90c7-2b90d8a19dbb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:36.228304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff6b4f-57a2-4992-90c7-2b90d8a19dbb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-315b1cda-12ca-42f3-a23a-021d501ef866 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:36.229623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:36.230581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:36.231491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:36.231491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:36.231491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:36.231491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:36.231491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:36.231491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:36.231491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:36.231491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:36.241644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 423/876] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:36.241644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b1cda-12ca-42f3-a23a-021d501ef866 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-70ff6b4f-57a2-4992-90c7-2b90d8a19dbb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:36.244735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:36.245731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:05:36.246585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:36.249650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 454/877] 10.222.0.74 () {56 vars in 1132 bytes} [Thu Jul 14 10:05:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:36.260057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff6b4f-57a2-4992-90c7-2b90d8a19dbb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:36.316250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:36.361646 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b1cda-12ca-42f3-a23a-021d501ef866 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:36.373629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff6b4f-57a2-4992-90c7-2b90d8a19dbb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:36.404046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f1e0f-d1b9-4f51-8072-85b2069a7cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:36.404996 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f1e0f-d1b9-4f51-8072-85b2069a7cde None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:36.405810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f1e0f-d1b9-4f51-8072-85b2069a7cde None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:36.406094 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f1e0f-d1b9-4f51-8072-85b2069a7cde None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:36.406888 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f1e0f-d1b9-4f51-8072-85b2069a7cde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:36.407198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f1e0f-d1b9-4f51-8072-85b2069a7cde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:36.408671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f1e0f-d1b9-4f51-8072-85b2069a7cde None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:36.409805 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7efe9-1f08-4f3e-8781-47536c0bd324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:36.410553 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7efe9-1f08-4f3e-8781-47536c0bd324 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:36.410909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7efe9-1f08-4f3e-8781-47536c0bd324 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:36.411257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7efe9-1f08-4f3e-8781-47536c0bd324 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:36.412060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7efe9-1f08-4f3e-8781-47536c0bd324 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:36.412442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7efe9-1f08-4f3e-8781-47536c0bd324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:36.413868 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7efe9-1f08-4f3e-8781-47536c0bd324 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:36.424039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 455/879] 10.222.0.74 () {56 vars in 1126 bytes} [Thu Jul 14 10:05:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:36.425136 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7efe9-1f08-4f3e-8781-47536c0bd324 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:36.427452 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 424/879] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:36.428624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f1e0f-d1b9-4f51-8072-85b2069a7cde None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:36.516357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:36.534377 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7efe9-1f08-4f3e-8781-47536c0bd324 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:36.545891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:36.563334 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f1e0f-d1b9-4f51-8072-85b2069a7cde None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:36.576740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a6daa-0b18-4808-9fe4-87a662f78966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:36.578180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a6daa-0b18-4808-9fe4-87a662f78966 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:36.578473 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a6daa-0b18-4808-9fe4-87a662f78966 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:36.578757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a6daa-0b18-4808-9fe4-87a662f78966 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:36.579474 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a6daa-0b18-4808-9fe4-87a662f78966 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:36.579947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a6daa-0b18-4808-9fe4-87a662f78966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:36.582071 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a6daa-0b18-4808-9fe4-87a662f78966 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:36.588795 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 456/880] 10.222.0.74 () {56 vars in 1126 bytes} [Thu Jul 14 10:05:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:36.594736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a6daa-0b18-4808-9fe4-87a662f78966 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:36.608195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393a452-ad86-40fa-9510-d45f4628660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:36.609426 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393a452-ad86-40fa-9510-d45f4628660a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:36.609708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393a452-ad86-40fa-9510-d45f4628660a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:36.609983 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393a452-ad86-40fa-9510-d45f4628660a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:36.610819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393a452-ad86-40fa-9510-d45f4628660a None admin] RBAC: Adding query filter params (role.id=feef3a85c1c0446590c2671a9f266cf4, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=75710267bbf04b629f1fd96ca761b89d) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:36.611237 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393a452-ad86-40fa-9510-d45f4628660a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:36.612813 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393a452-ad86-40fa-9510-d45f4628660a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:36.619664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 425/881] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:36 2022] GET /identity/v3/role_assignments?user.id=75710267bbf04b629f1fd96ca761b89d&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=feef3a85c1c0446590c2671a9f266cf4 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:36.656872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab625d52-68b5-4a26-bd97-5d10cd08a771 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:36.657258 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab625d52-68b5-4a26-bd97-5d10cd08a771 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:36.657536 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab625d52-68b5-4a26-bd97-5d10cd08a771 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:36.659539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 426/882] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:05:36.665594 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585da4bd-b27b-4ed6-bb31-063d3572774a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:36.666019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585da4bd-b27b-4ed6-bb31-063d3572774a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:36.666378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585da4bd-b27b-4ed6-bb31-063d3572774a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:36.686632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-585da4bd-b27b-4ed6-bb31-063d3572774a None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:36.688343 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-585da4bd-b27b-4ed6-bb31-063d3572774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:36.723475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a6daa-0b18-4808-9fe4-87a662f78966 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:36.765487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369ea33-a5da-4441-9a91-a02437458dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:36.766167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369ea33-a5da-4441-9a91-a02437458dcb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:36.766454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369ea33-a5da-4441-9a91-a02437458dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:36.766734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369ea33-a5da-4441-9a91-a02437458dcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:36.767543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369ea33-a5da-4441-9a91-a02437458dcb None admin] RBAC: Adding query filter params (interface=public, service_id=7e7e8cce5cea44f0b126a236366c74b8, region_id=RegionOne) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:36.767857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369ea33-a5da-4441-9a91-a02437458dcb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:36.769569 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369ea33-a5da-4441-9a91-a02437458dcb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:36.778532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 427/883] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:05:36.784246 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 457/884] 10.222.0.74 () {56 vars in 1251 bytes} [Thu Jul 14 10:05:36 2022] GET /identity/v3/endpoints?service_id=7e7e8cce5cea44f0b126a236366c74b8&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:36.785382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585da4bd-b27b-4ed6-bb31-063d3572774a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:36.803407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369ea33-a5da-4441-9a91-a02437458dcb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:36.846267 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:36.854470 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:36.906356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585da4bd-b27b-4ed6-bb31-063d3572774a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:36.935462 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369ea33-a5da-4441-9a91-a02437458dcb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:36.944844 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274e813-ccf9-408e-95ed-f783a5e7c9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:36.945774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274e813-ccf9-408e-95ed-f783a5e7c9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:36.946284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274e813-ccf9-408e-95ed-f783a5e7c9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:36.946774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274e813-ccf9-408e-95ed-f783a5e7c9f6 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:36.947664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274e813-ccf9-408e-95ed-f783a5e7c9f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:36.949359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274e813-ccf9-408e-95ed-f783a5e7c9f6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:36.956379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 428/885] 10.222.0.74 () {56 vars in 1087 bytes} [Thu Jul 14 10:05:36 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:05:36.982683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c26bf9-3028-4637-8cda-1a359f081f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:36.984141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c26bf9-3028-4637-8cda-1a359f081f27 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:36.984441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c26bf9-3028-4637-8cda-1a359f081f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:36.984724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c26bf9-3028-4637-8cda-1a359f081f27 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:36.985412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c26bf9-3028-4637-8cda-1a359f081f27 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:36.986878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c26bf9-3028-4637-8cda-1a359f081f27 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c9c26bf9-3028-4637-8cda-1a359f081f27 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:37.000907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:37.002046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:37.002896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 458/886] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:05:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:37.010964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274e813-ccf9-408e-95ed-f783a5e7c9f6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:37.128679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274e813-ccf9-408e-95ed-f783a5e7c9f6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:37.147702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:37.165838 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de00451-f93b-45e2-9041-5da295e37b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:37.166499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de00451-f93b-45e2-9041-5da295e37b96 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:37.166773 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de00451-f93b-45e2-9041-5da295e37b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:37.167037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de00451-f93b-45e2-9041-5da295e37b96 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:37.167740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de00451-f93b-45e2-9041-5da295e37b96 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:37.168072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de00451-f93b-45e2-9041-5da295e37b96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:37.169479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de00451-f93b-45e2-9041-5da295e37b96 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:37.174536 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 429/887] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:05:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:37.179885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c26bf9-3028-4637-8cda-1a359f081f27 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:37.285936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c26bf9-3028-4637-8cda-1a359f081f27 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:37.287512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:37.321263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25709f-79e6-4684-bcd4-0a71d58114e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:37.321935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25709f-79e6-4684-bcd4-0a71d58114e6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:37.322212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25709f-79e6-4684-bcd4-0a71d58114e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:37.322480 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25709f-79e6-4684-bcd4-0a71d58114e6 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:37.323255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25709f-79e6-4684-bcd4-0a71d58114e6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:37.323557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25709f-79e6-4684-bcd4-0a71d58114e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:37.325069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25709f-79e6-4684-bcd4-0a71d58114e6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:37.330579 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 459/888] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:05:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:37.336235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de00451-f93b-45e2-9041-5da295e37b96 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:37.442870 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de00451-f93b-45e2-9041-5da295e37b96 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:37.480095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34d555-714e-478e-abfb-427fd446b13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:37.480095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34d555-714e-478e-abfb-427fd446b13e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:37.480394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34d555-714e-478e-abfb-427fd446b13e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:37.480649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34d555-714e-478e-abfb-427fd446b13e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:37.481459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34d555-714e-478e-abfb-427fd446b13e None admin] RBAC: Adding query filter params (interface=public, service_id=34b23d95258c40bfb79312e9f21a744b, region_id=RegionOne) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:37.481755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34d555-714e-478e-abfb-427fd446b13e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:37.483118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34d555-714e-478e-abfb-427fd446b13e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:37.489286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 430/889] 10.222.0.74 () {56 vars in 1251 bytes} [Thu Jul 14 10:05:37 2022] GET /identity/v3/endpoints?service_id=34b23d95258c40bfb79312e9f21a744b&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:37.494690 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25709f-79e6-4684-bcd4-0a71d58114e6 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:37.604923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25709f-79e6-4684-bcd4-0a71d58114e6 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:37.612391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad374a3-96a7-4d2b-96a4-b4c6abf9ce8a None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:37.612684 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad374a3-96a7-4d2b-96a4-b4c6abf9ce8a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:37.612965 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad374a3-96a7-4d2b-96a4-b4c6abf9ce8a None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:37.614691 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 431/890] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:05:37.619624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d0803-8c5c-4ba3-a71d-3b2a697ec1fe None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:37.619910 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d0803-8c5c-4ba3-a71d-3b2a697ec1fe None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:37.620419 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d0803-8c5c-4ba3-a71d-3b2a697ec1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:37.638130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ff0d0803-8c5c-4ba3-a71d-3b2a697ec1fe None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:37.639506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ff0d0803-8c5c-4ba3-a71d-3b2a697ec1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:37.641826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090d738-ed3e-42bc-bca8-a6765e6380be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:37.643008 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090d738-ed3e-42bc-bca8-a6765e6380be None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:37.643008 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090d738-ed3e-42bc-bca8-a6765e6380be None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:37.643186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090d738-ed3e-42bc-bca8-a6765e6380be None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:37.643809 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090d738-ed3e-42bc-bca8-a6765e6380be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:37.645329 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090d738-ed3e-42bc-bca8-a6765e6380be None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:37.652213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 460/891] 10.222.0.74 () {56 vars in 1087 bytes} [Thu Jul 14 10:05:37 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:05:37.688529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:37.724231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 432/892] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:05:37.743333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090d738-ed3e-42bc-bca8-a6765e6380be None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:37.779014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:37.857544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090d738-ed3e-42bc-bca8-a6765e6380be None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:37.893003 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc8ce4-ab1f-4b57-a2b4-39eb380ccd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:37.893823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc8ce4-ab1f-4b57-a2b4-39eb380ccd8e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:37.894103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc8ce4-ab1f-4b57-a2b4-39eb380ccd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:37.894378 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc8ce4-ab1f-4b57-a2b4-39eb380ccd8e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:37.895026 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc8ce4-ab1f-4b57-a2b4-39eb380ccd8e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:37.896417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc8ce4-ab1f-4b57-a2b4-39eb380ccd8e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a9fc8ce4-ab1f-4b57-a2b4-39eb380ccd8e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:37.909231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:37.911454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:37.913444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 461/893] 10.222.0.74 () {56 vars in 1126 bytes} [Thu Jul 14 10:05:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:37.917240 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d0803-8c5c-4ba3-a71d-3b2a697ec1fe None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:38.020931 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d0803-8c5c-4ba3-a71d-3b2a697ec1fe None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:38.060040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd61f1-8d22-42dc-8724-b9b57392129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:38.060727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd61f1-8d22-42dc-8724-b9b57392129c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:38.061008 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd61f1-8d22-42dc-8724-b9b57392129c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:38.061282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd61f1-8d22-42dc-8724-b9b57392129c None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:38.062484 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd61f1-8d22-42dc-8724-b9b57392129c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:38.062484 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd61f1-8d22-42dc-8724-b9b57392129c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:38.063683 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd61f1-8d22-42dc-8724-b9b57392129c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:38.073482 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 433/894] 10.222.0.74 () {56 vars in 1122 bytes} [Thu Jul 14 10:05:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:38.077113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc8ce4-ab1f-4b57-a2b4-39eb380ccd8e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:38.180378 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:38.187940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc8ce4-ab1f-4b57-a2b4-39eb380ccd8e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:38.223213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2f471-3bdc-47f0-b034-ee647df42811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:38.224241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2f471-3bdc-47f0-b034-ee647df42811 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:38.224705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2f471-3bdc-47f0-b034-ee647df42811 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:38.225160 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2f471-3bdc-47f0-b034-ee647df42811 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:38.226049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2f471-3bdc-47f0-b034-ee647df42811 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:38.226534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2f471-3bdc-47f0-b034-ee647df42811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:38.228114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2f471-3bdc-47f0-b034-ee647df42811 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:38.240142 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 462/895] 10.222.0.74 () {56 vars in 1122 bytes} [Thu Jul 14 10:05:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:38.920021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413208bb-0897-4d91-b4a3-1de7c4fc7b93 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:38.920542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413208bb-0897-4d91-b4a3-1de7c4fc7b93 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:38.920642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413208bb-0897-4d91-b4a3-1de7c4fc7b93 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:38.922419 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 434/896] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:38.927845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0be378-8cac-46ad-bdde-e1f5fc7afe80 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:38.928265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0be378-8cac-46ad-bdde-e1f5fc7afe80 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:38.928624 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0be378-8cac-46ad-bdde-e1f5fc7afe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:38.946614 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0c0be378-8cac-46ad-bdde-e1f5fc7afe80 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:38.947979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0c0be378-8cac-46ad-bdde-e1f5fc7afe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:39.028530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 463/897] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:39.056090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413208bb-0897-4d91-b4a3-1de7c4fc7b93 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:39.090179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c65880-0a0e-45e6-bb29-c4098e285600 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:39.090673 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c65880-0a0e-45e6-bb29-c4098e285600 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:39.090797 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c65880-0a0e-45e6-bb29-c4098e285600 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:39.092427 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 464/898] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:39.097628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a4fe1-745a-456f-88ba-06e2a3a0df5e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:39.098018 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a4fe1-745a-456f-88ba-06e2a3a0df5e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:39.098397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a4fe1-745a-456f-88ba-06e2a3a0df5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:39.104970 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:39.116833 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e03a4fe1-745a-456f-88ba-06e2a3a0df5e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:39.123212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e03a4fe1-745a-456f-88ba-06e2a3a0df5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:39.173697 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413208bb-0897-4d91-b4a3-1de7c4fc7b93 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:39.208018 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 465/899] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:05:39.213774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218550f-6fca-4f7e-8a81-2e07e991f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:39.214580 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218550f-6fca-4f7e-8a81-2e07e991f5ae None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:39.214860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218550f-6fca-4f7e-8a81-2e07e991f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:39.215212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218550f-6fca-4f7e-8a81-2e07e991f5ae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:39.226567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218550f-6fca-4f7e-8a81-2e07e991f5ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:39.227533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a4fe1-745a-456f-88ba-06e2a3a0df5e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-9218550f-6fca-4f7e-8a81-2e07e991f5ae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:39.235409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:39.236650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:39.237524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:39.237524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:39.237524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:39.237524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:39.237524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:39.237524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:39.237524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:39.237524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:39.237524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:39.237524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:39.237524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:05:39.237524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:39.237524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 435/900] 10.222.0.74 () {56 vars in 1120 bytes} [Thu Jul 14 10:05:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:39.243922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218550f-6fca-4f7e-8a81-2e07e991f5ae None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:39.252300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:39.339894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a4fe1-745a-456f-88ba-06e2a3a0df5e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:39.349083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:39.354098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218550f-6fca-4f7e-8a81-2e07e991f5ae None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:39.382193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b54e4-a75d-4df3-886b-a887b7e7f554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:39.383326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b54e4-a75d-4df3-886b-a887b7e7f554 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:39.384087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b54e4-a75d-4df3-886b-a887b7e7f554 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:39.385171 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b54e4-a75d-4df3-886b-a887b7e7f554 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:39.386278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b54e4-a75d-4df3-886b-a887b7e7f554 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:39.388110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b54e4-a75d-4df3-886b-a887b7e7f554 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:39.396277 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0256d-7a65-4433-b5b8-f5e53369610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:39.396943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0256d-7a65-4433-b5b8-f5e53369610e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:39.397224 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0256d-7a65-4433-b5b8-f5e53369610e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:39.397498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0256d-7a65-4433-b5b8-f5e53369610e None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:39.398246 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0256d-7a65-4433-b5b8-f5e53369610e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:39.398556 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0256d-7a65-4433-b5b8-f5e53369610e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:39.399910 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0256d-7a65-4433-b5b8-f5e53369610e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-583b54e4-a75d-4df3-886b-a887b7e7f554 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:39.402573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:39.403512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:05:39.404407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:39.408101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 466/901] 10.222.0.74 () {56 vars in 1132 bytes} [Thu Jul 14 10:05:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:39.412036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 436/902] 10.222.0.74 () {56 vars in 1115 bytes} [Thu Jul 14 10:05:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:39.415640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b54e4-a75d-4df3-886b-a887b7e7f554 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:39.417425 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0256d-7a65-4433-b5b8-f5e53369610e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:39.520569 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:39.524228 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b54e4-a75d-4df3-886b-a887b7e7f554 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:39.535427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0256d-7a65-4433-b5b8-f5e53369610e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:39.560354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793933a5-6231-4060-aa9a-847f106ed2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:39.561327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793933a5-6231-4060-aa9a-847f106ed2ff None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:39.561787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793933a5-6231-4060-aa9a-847f106ed2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:39.562235 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793933a5-6231-4060-aa9a-847f106ed2ff None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:39.563161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793933a5-6231-4060-aa9a-847f106ed2ff None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:39.563686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793933a5-6231-4060-aa9a-847f106ed2ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:39.565347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793933a5-6231-4060-aa9a-847f106ed2ff None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:39.571414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c2f30-ada5-4d44-8ff6-2256dfa74d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:39.572199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 467/903] 10.222.0.74 () {56 vars in 1126 bytes} [Thu Jul 14 10:05:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:39.572395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c2f30-ada5-4d44-8ff6-2256dfa74d5e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:39.572664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c2f30-ada5-4d44-8ff6-2256dfa74d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:39.572937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c2f30-ada5-4d44-8ff6-2256dfa74d5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:39.576087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793933a5-6231-4060-aa9a-847f106ed2ff None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:39.585614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c2f30-ada5-4d44-8ff6-2256dfa74d5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:39.589246 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c2f30-ada5-4d44-8ff6-2256dfa74d5e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-7d1c2f30-ada5-4d44-8ff6-2256dfa74d5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:39.610173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:39.611099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:39.612031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:39.612031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:39.612031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:39.612031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:39.616277 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 437/904] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:39.620837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c2f30-ada5-4d44-8ff6-2256dfa74d5e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:39.638831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:39.694168 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793933a5-6231-4060-aa9a-847f106ed2ff None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:39.730453 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acba3b-fb54-42c6-a7c7-fdc10dc47703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:39.731475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acba3b-fb54-42c6-a7c7-fdc10dc47703 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:39.732072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acba3b-fb54-42c6-a7c7-fdc10dc47703 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:39.732645 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acba3b-fb54-42c6-a7c7-fdc10dc47703 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:39.734083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acba3b-fb54-42c6-a7c7-fdc10dc47703 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:39.734599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acba3b-fb54-42c6-a7c7-fdc10dc47703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:39.736455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acba3b-fb54-42c6-a7c7-fdc10dc47703 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:39.742021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c2f30-ada5-4d44-8ff6-2256dfa74d5e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:39.742503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 468/905] 10.222.0.74 () {56 vars in 1126 bytes} [Thu Jul 14 10:05:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:39.748118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acba3b-fb54-42c6-a7c7-fdc10dc47703 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:39.762206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:39.780744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971c559-77e5-43b4-8a2b-87f8e91cc2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:39.781336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971c559-77e5-43b4-8a2b-87f8e91cc2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:39.781617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971c559-77e5-43b4-8a2b-87f8e91cc2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:39.781887 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971c559-77e5-43b4-8a2b-87f8e91cc2f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:39.782612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971c559-77e5-43b4-8a2b-87f8e91cc2f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:39.782919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971c559-77e5-43b4-8a2b-87f8e91cc2f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:39.784587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971c559-77e5-43b4-8a2b-87f8e91cc2f3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:39.797839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 438/906] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:39.801792 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad67d5c-9939-4c2b-bf67-a6ddd1727c0f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:39.802460 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad67d5c-9939-4c2b-bf67-a6ddd1727c0f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:39.802790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad67d5c-9939-4c2b-bf67-a6ddd1727c0f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:39.808188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 439/907] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:39.808188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad67d5c-9939-4c2b-bf67-a6ddd1727c0f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:39.861406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acba3b-fb54-42c6-a7c7-fdc10dc47703 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:39.883163 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:39.899739 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21785695-cb51-49dc-b2cb-492c6f10a40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:39.900438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21785695-cb51-49dc-b2cb-492c6f10a40e None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:39.900722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21785695-cb51-49dc-b2cb-492c6f10a40e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:39.901003 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21785695-cb51-49dc-b2cb-492c6f10a40e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:39.901839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21785695-cb51-49dc-b2cb-492c6f10a40e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:39.903298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21785695-cb51-49dc-b2cb-492c6f10a40e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:39.915879 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad67d5c-9939-4c2b-bf67-a6ddd1727c0f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:39.950263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59252b5c-84c2-4616-8937-99dd3d116f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:39.951075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59252b5c-84c2-4616-8937-99dd3d116f0c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:39.951357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59252b5c-84c2-4616-8937-99dd3d116f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:39.951630 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59252b5c-84c2-4616-8937-99dd3d116f0c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:39.958802 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59252b5c-84c2-4616-8937-99dd3d116f0c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:39.960323 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59252b5c-84c2-4616-8937-99dd3d116f0c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-59252b5c-84c2-4616-8937-99dd3d116f0c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:39.975614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:39.982012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:39.983027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:39.983027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:39.983027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:39.983027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:39.983027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:39.983027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:39.983027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:39.983027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:39.983027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:05:39.983027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:39.983027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 440/908] 10.222.0.74 () {56 vars in 1117 bytes} [Thu Jul 14 10:05:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:39.983027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191751e-b7f8-40e3-9f47-d63a81da68ca None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:39.983027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191751e-b7f8-40e3-9f47-d63a81da68ca None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:39.984437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191751e-b7f8-40e3-9f47-d63a81da68ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:39.987828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 469/909] 10.222.0.74 () {60 vars in 1144 bytes} [Thu Jul 14 10:05:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:05:39.988983 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21785695-cb51-49dc-b2cb-492c6f10a40e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:40.005566 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2191751e-b7f8-40e3-9f47-d63a81da68ca None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:40.006886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2191751e-b7f8-40e3-9f47-d63a81da68ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:40.087875 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:40.109487 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 441/910] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:40.129665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21785695-cb51-49dc-b2cb-492c6f10a40e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:40.132183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191751e-b7f8-40e3-9f47-d63a81da68ca None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:40.178101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da89753-f9a9-468c-8513-e114f4d89e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:40.178796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da89753-f9a9-468c-8513-e114f4d89e6c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:40.179211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da89753-f9a9-468c-8513-e114f4d89e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:40.179493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da89753-f9a9-468c-8513-e114f4d89e6c None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:40.180384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da89753-f9a9-468c-8513-e114f4d89e6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:40.180695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da89753-f9a9-468c-8513-e114f4d89e6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:40.182287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da89753-f9a9-468c-8513-e114f4d89e6c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:40.204315 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:40.207939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 470/911] 10.222.0.74 () {56 vars in 1149 bytes} [Thu Jul 14 10:05:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:40.214102 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da89753-f9a9-468c-8513-e114f4d89e6c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:40.259276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191751e-b7f8-40e3-9f47-d63a81da68ca None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:40.299068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99ec47-e00a-403d-b41d-5c79332a72c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:40.300344 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99ec47-e00a-403d-b41d-5c79332a72c6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:40.300780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99ec47-e00a-403d-b41d-5c79332a72c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:40.301279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99ec47-e00a-403d-b41d-5c79332a72c6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:40.302109 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99ec47-e00a-403d-b41d-5c79332a72c6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:40.303743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99ec47-e00a-403d-b41d-5c79332a72c6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3c99ec47-e00a-403d-b41d-5c79332a72c6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:40.316919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:40.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:40.319316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:40.319316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:40.319316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:40.319316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:40.319316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:40.319316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:40.319316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:40.319316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:40.319316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:40.319316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:40.319316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:40.319316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:40.319316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:05:40.319316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:40.321871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 442/912] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:05:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:40.323124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da89753-f9a9-468c-8513-e114f4d89e6c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:40.329415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99ec47-e00a-403d-b41d-5c79332a72c6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:40.348430 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:40.359798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770ef8b-686e-4973-924d-560cffc36a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:40.360634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770ef8b-686e-4973-924d-560cffc36a0b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:40.360926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770ef8b-686e-4973-924d-560cffc36a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:40.361203 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770ef8b-686e-4973-924d-560cffc36a0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:40.432260 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770ef8b-686e-4973-924d-560cffc36a0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:40.433724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770ef8b-686e-4973-924d-560cffc36a0b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:40.439231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99ec47-e00a-403d-b41d-5c79332a72c6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:40.462863 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:40.477658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dcb81-0f7b-4b76-8dcf-c2519ad508c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:40.478689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dcb81-0f7b-4b76-8dcf-c2519ad508c7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:40.478980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dcb81-0f7b-4b76-8dcf-c2519ad508c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:40.479532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dcb81-0f7b-4b76-8dcf-c2519ad508c7 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:40.480298 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6dcb81-0f7b-4b76-8dcf-c2519ad508c7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:40.480607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6dcb81-0f7b-4b76-8dcf-c2519ad508c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:40.482541 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6dcb81-0f7b-4b76-8dcf-c2519ad508c7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:40.488064 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 443/913] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:05:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:40.493318 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04c256-1e45-4777-b459-a795551cdc16 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:40.493601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04c256-1e45-4777-b459-a795551cdc16 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:40.493877 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04c256-1e45-4777-b459-a795551cdc16 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:40.495164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 444/914] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:40.495851 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04c256-1e45-4777-b459-a795551cdc16 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:40.549066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 471/915] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:40 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:05:40.550665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0000-506e-4928-9cb1-22cbf2ca316d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:40.550955 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0000-506e-4928-9cb1-22cbf2ca316d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:40.551229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0000-506e-4928-9cb1-22cbf2ca316d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:40.568379 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e2fa0000-506e-4928-9cb1-22cbf2ca316d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:40.569499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e2fa0000-506e-4928-9cb1-22cbf2ca316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:40.589116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:40.616445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04c256-1e45-4777-b459-a795551cdc16 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:40.644038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 472/916] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:40.644560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa0000-506e-4928-9cb1-22cbf2ca316d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:40.654971 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ca259-c2f5-4434-be3b-2815958c442f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:40.655968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ca259-c2f5-4434-be3b-2815958c442f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:40.656475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ca259-c2f5-4434-be3b-2815958c442f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:40.657066 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ca259-c2f5-4434-be3b-2815958c442f None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:40.658043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ca259-c2f5-4434-be3b-2815958c442f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:40.658571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ca259-c2f5-4434-be3b-2815958c442f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:40.660433 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ca259-c2f5-4434-be3b-2815958c442f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:40.667189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 445/917] 10.222.0.74 () {56 vars in 1114 bytes} [Thu Jul 14 10:05:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:40.673287 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ca259-c2f5-4434-be3b-2815958c442f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:40.734836 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:40.770062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa0000-506e-4928-9cb1-22cbf2ca316d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:40.786794 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ca259-c2f5-4434-be3b-2815958c442f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:40.804824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3fd87-9531-4d19-8753-a47d9960ebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:40.805615 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3fd87-9531-4d19-8753-a47d9960ebbd None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:40.805893 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3fd87-9531-4d19-8753-a47d9960ebbd None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:40.806159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3fd87-9531-4d19-8753-a47d9960ebbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:40.816716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3fd87-9531-4d19-8753-a47d9960ebbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:40.818142 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3fd87-9531-4d19-8753-a47d9960ebbd None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:40.823489 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd675c17-ba74-4485-9717-49e4fb9c53a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:40.824108 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd675c17-ba74-4485-9717-49e4fb9c53a2 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:40.824392 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd675c17-ba74-4485-9717-49e4fb9c53a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:40.824665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd675c17-ba74-4485-9717-49e4fb9c53a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:40.825515 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd675c17-ba74-4485-9717-49e4fb9c53a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:40.827550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd675c17-ba74-4485-9717-49e4fb9c53a2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-28e3fd87-9531-4d19-8753-a47d9960ebbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:40.835920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:40.837149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:40.838310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:40.838310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:40.838310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:40.838310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:40.841934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 473/918] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:40.842656 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3fd87-9531-4d19-8753-a47d9960ebbd None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:40.851118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:40.890235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 446/919] 10.222.0.74 () {60 vars in 1144 bytes} [Thu Jul 14 10:05:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:05:40.890235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd675c17-ba74-4485-9717-49e4fb9c53a2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:40.965982 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3fd87-9531-4d19-8753-a47d9960ebbd None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:41.017111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9a16f-aec8-4a4a-b09e-1871dce77f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:41.018254 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9a16f-aec8-4a4a-b09e-1871dce77f57 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:41.018880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9a16f-aec8-4a4a-b09e-1871dce77f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:41.019228 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9a16f-aec8-4a4a-b09e-1871dce77f57 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:41.020054 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9a16f-aec8-4a4a-b09e-1871dce77f57 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:41.023152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9a16f-aec8-4a4a-b09e-1871dce77f57 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:41.025055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd675c17-ba74-4485-9717-49e4fb9c53a2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:41.034525 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:41.069302 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0f166-16ad-4e20-953e-3ae816de3b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:41.069972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0f166-16ad-4e20-953e-3ae816de3b13 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:41.070252 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0f166-16ad-4e20-953e-3ae816de3b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:41.070523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0f166-16ad-4e20-953e-3ae816de3b13 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:41.071241 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0f166-16ad-4e20-953e-3ae816de3b13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:41.071546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0f166-16ad-4e20-953e-3ae816de3b13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:41.072947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0f166-16ad-4e20-953e-3ae816de3b13 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:41.088520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 447/920] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:41.091961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0f166-16ad-4e20-953e-3ae816de3b13 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:41.119231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 474/921] 10.222.0.74 () {60 vars in 1141 bytes} [Thu Jul 14 10:05:40 2022] POST /identity/v3/services => generated 241 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:05:41.209214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0f166-16ad-4e20-953e-3ae816de3b13 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:41.259445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264d22d-368e-40de-af06-19f2e40a0771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:41.260359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264d22d-368e-40de-af06-19f2e40a0771 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:41.260650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264d22d-368e-40de-af06-19f2e40a0771 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:41.260959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264d22d-368e-40de-af06-19f2e40a0771 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:41.268908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264d22d-368e-40de-af06-19f2e40a0771 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:41.270369 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264d22d-368e-40de-af06-19f2e40a0771 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-1264d22d-368e-40de-af06-19f2e40a0771 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:41.285152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:41.286073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:41.286987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:41.286987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:41.286987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:41.286987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:41.286987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:41.286987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:41.286987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:41.286987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:41.286987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 448/922] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:41.292083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9a16f-aec8-4a4a-b09e-1871dce77f57 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:41.368884 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:41.401022 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9a16f-aec8-4a4a-b09e-1871dce77f57 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:41.437165 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b971ecc-778d-476d-aab3-e7aa525b7555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:41.437838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b971ecc-778d-476d-aab3-e7aa525b7555 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:41.438125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b971ecc-778d-476d-aab3-e7aa525b7555 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:41.438400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b971ecc-778d-476d-aab3-e7aa525b7555 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:41.439194 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b971ecc-778d-476d-aab3-e7aa525b7555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:41.439502 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b971ecc-778d-476d-aab3-e7aa525b7555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:41.441003 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b971ecc-778d-476d-aab3-e7aa525b7555 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:41.453825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 475/923] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:41.459430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264d22d-368e-40de-af06-19f2e40a0771 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:41.489359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:41.573989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264d22d-368e-40de-af06-19f2e40a0771 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:41.609265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096d0f8-d0b7-450d-bd43-1d9bd80e266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:41.609918 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d0f8-d0b7-450d-bd43-1d9bd80e266d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:41.610198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d0f8-d0b7-450d-bd43-1d9bd80e266d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:41.610468 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d0f8-d0b7-450d-bd43-1d9bd80e266d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:41.611296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096d0f8-d0b7-450d-bd43-1d9bd80e266d None admin] RBAC: Adding query filter params (role.id=a99d4e2c5a7d4b2d947e64f622f1bb52, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=75710267bbf04b629f1fd96ca761b89d) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:41.611602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096d0f8-d0b7-450d-bd43-1d9bd80e266d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:41.613070 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096d0f8-d0b7-450d-bd43-1d9bd80e266d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:41.619153 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 449/924] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:41 2022] GET /identity/v3/role_assignments?user.id=75710267bbf04b629f1fd96ca761b89d&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=a99d4e2c5a7d4b2d947e64f622f1bb52 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:42.141300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e606-af21-4524-9c7b-c344c396d9c2 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:42.141666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e606-af21-4524-9c7b-c344c396d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:42.141865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e606-af21-4524-9c7b-c344c396d9c2 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:42.143652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 476/925] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:42.149418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3d1f7-8718-4699-af5e-e7579c3f3164 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:42.149947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3d1f7-8718-4699-af5e-e7579c3f3164 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:42.149947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3d1f7-8718-4699-af5e-e7579c3f3164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:42.167027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f6c3d1f7-8718-4699-af5e-e7579c3f3164 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:42.168255 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f6c3d1f7-8718-4699-af5e-e7579c3f3164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:42.241198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 450/926] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:42.262791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899e606-af21-4524-9c7b-c344c396d9c2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:42.368735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899e606-af21-4524-9c7b-c344c396d9c2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:42.391327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:42.402462 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80f2e9-3010-441f-9387-ed639e5696a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:42.416106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80f2e9-3010-441f-9387-ed639e5696a8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:42.416106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80f2e9-3010-441f-9387-ed639e5696a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:42.416106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80f2e9-3010-441f-9387-ed639e5696a8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:42.416106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80f2e9-3010-441f-9387-ed639e5696a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:42.416106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80f2e9-3010-441f-9387-ed639e5696a8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-fd80f2e9-3010-441f-9387-ed639e5696a8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:42.418199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:42.419402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:42.421115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 477/927] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:42.426402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3d1f7-8718-4699-af5e-e7579c3f3164 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:42.447112 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:42.527880 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3d1f7-8718-4699-af5e-e7579c3f3164 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:42.562932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91458671-1ea7-41b6-984a-adf52e5dcd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:42.563596 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91458671-1ea7-41b6-984a-adf52e5dcd41 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:42.563881 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91458671-1ea7-41b6-984a-adf52e5dcd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:42.564186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91458671-1ea7-41b6-984a-adf52e5dcd41 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:42.564896 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91458671-1ea7-41b6-984a-adf52e5dcd41 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:42.565203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91458671-1ea7-41b6-984a-adf52e5dcd41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:42.566570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91458671-1ea7-41b6-984a-adf52e5dcd41 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:42.571656 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 451/928] 10.222.0.74 () {56 vars in 1112 bytes} [Thu Jul 14 10:05:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:42.577597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80f2e9-3010-441f-9387-ed639e5696a8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:42.687517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80f2e9-3010-441f-9387-ed639e5696a8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:42.722143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3aa0e-73b4-485b-b234-0d2ca13f41ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:42.722818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3aa0e-73b4-485b-b234-0d2ca13f41ba None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:42.723100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3aa0e-73b4-485b-b234-0d2ca13f41ba None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:42.723381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3aa0e-73b4-485b-b234-0d2ca13f41ba None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:42.724122 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3aa0e-73b4-485b-b234-0d2ca13f41ba None admin] RBAC: Adding query filter params (type=compute) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:42.724431 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3aa0e-73b4-485b-b234-0d2ca13f41ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:42.725810 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3aa0e-73b4-485b-b234-0d2ca13f41ba None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:42.730932 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 478/929] 10.222.0.74 () {56 vars in 1112 bytes} [Thu Jul 14 10:05:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:43.139577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f6cb7-f31b-4ebf-87b7-e6084f9b175c None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:43.140247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f6cb7-f31b-4ebf-87b7-e6084f9b175c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:43.140755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f6cb7-f31b-4ebf-87b7-e6084f9b175c None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:43.142590 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 452/930] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:43.148300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1437e7-3311-4051-a753-7b3680cbb317 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:43.148890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1437e7-3311-4051-a753-7b3680cbb317 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:43.149384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1437e7-3311-4051-a753-7b3680cbb317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:43.167228 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3e1437e7-3311-4051-a753-7b3680cbb317 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:43.168800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3e1437e7-3311-4051-a753-7b3680cbb317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:43.216700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:43.239408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 479/931] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:43.263406 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f6cb7-f31b-4ebf-87b7-e6084f9b175c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:43.319101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5a6f-e25c-4e93-8f98-1775746807d2 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:43.319723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5a6f-e25c-4e93-8f98-1775746807d2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:43.320429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5a6f-e25c-4e93-8f98-1775746807d2 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:43.322586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 480/932] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:05:43.329759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61a2c-569e-4543-8d2e-28bec94722d7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:43.330313 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61a2c-569e-4543-8d2e-28bec94722d7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:43.330797 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61a2c-569e-4543-8d2e-28bec94722d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:43.349208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3ce61a2c-569e-4543-8d2e-28bec94722d7 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:43.350743 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3ce61a2c-569e-4543-8d2e-28bec94722d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:43.362039 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:43.384886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f6cb7-f31b-4ebf-87b7-e6084f9b175c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:43.427379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648a10b-94b5-4c3b-b00f-447d20d773f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:43.428339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648a10b-94b5-4c3b-b00f-447d20d773f1 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:43.428629 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648a10b-94b5-4c3b-b00f-447d20d773f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:43.428906 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648a10b-94b5-4c3b-b00f-447d20d773f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:43.429628 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648a10b-94b5-4c3b-b00f-447d20d773f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:43.431546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648a10b-94b5-4c3b-b00f-447d20d773f1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:43.433255 dv-cinder-849800-1-smb devstack@keystone.service[80503]: WARNING keystone.server.flask.common [None req-7648a10b-94b5-4c3b-b00f-447d20d773f1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 10:05:43.444051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 481/933] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:43.462967 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce61a2c-569e-4543-8d2e-28bec94722d7 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:43.496629 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.sql.core [None req-7648a10b-94b5-4c3b-b00f-447d20d773f1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 10:05:43.496629 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 10:05:43.496629 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [parameters: {'id': '4279bd31024a481d804b869dd0c76427', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 10:05:43.496629 dv-cinder-849800-1-smb devstack@keystone.service[80503]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80503) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 10:05:43.513922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-7648a10b-94b5-4c3b-b00f-447d20d773f1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4279bd31024a481d804b869dd0c76427.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4279bd31024a481d804b869dd0c76427. Jul 14 10:05:43.513922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:43.513922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:05:43.513922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:05:43.513922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:05:43.513922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:05:43.513922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:05:43.513922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:05:43.513922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:05:43.513922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:05:43.513922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:05:43.513922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:05:43.513922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application result.read() Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 10:05:43.514834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application yield resource Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise self.value Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application session.commit() Jul 14 10:05:43.515856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.session.flush() Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application compat.raise_( Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 10:05:43.516832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 10:05:43.517776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application result.read() Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:05:43.518662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [parameters: {'id': '4279bd31024a481d804b869dd0c76427', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:43.519571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:43.522038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:43.524275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:43.524275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 10:05:43.524275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 10:05:43.524275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:43.524275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:43.524275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 10:05:43.524275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 10:05:43.524275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4279bd31024a481d804b869dd0c76427. Jul 14 10:05:43.524275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:43.524275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 453/934] 10.222.0.74 () {60 vars in 1140 bytes} [Thu Jul 14 10:05:43 2022] POST /identity/v3/projects => generated 262 bytes in 253 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:43.524275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648a10b-94b5-4c3b-b00f-447d20d773f1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:43.598548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce61a2c-569e-4543-8d2e-28bec94722d7 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:43.610551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:43.641892 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1a470-ff83-4664-a3d1-d4151acaa135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:43.642715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1a470-ff83-4664-a3d1-d4151acaa135 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:43.642998 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1a470-ff83-4664-a3d1-d4151acaa135 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:43.643272 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1a470-ff83-4664-a3d1-d4151acaa135 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:43.643936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1a470-ff83-4664-a3d1-d4151acaa135 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:43.645395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1a470-ff83-4664-a3d1-d4151acaa135 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:43.649417 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648a10b-94b5-4c3b-b00f-447d20d773f1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-84a1a470-ff83-4664-a3d1-d4151acaa135 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:43.658047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:43.659361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:43.666123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 482/935] 10.222.0.74 () {56 vars in 1126 bytes} [Thu Jul 14 10:05:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:43.667483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1a470-ff83-4664-a3d1-d4151acaa135 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:43.695951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9544f-ba0e-4ee6-bec0-a4e111476db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:43.697060 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9544f-ba0e-4ee6-bec0-a4e111476db0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:43.697347 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9544f-ba0e-4ee6-bec0-a4e111476db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:43.697623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9544f-ba0e-4ee6-bec0-a4e111476db0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:43.701997 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:43.707717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9544f-ba0e-4ee6-bec0-a4e111476db0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:43.710520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9544f-ba0e-4ee6-bec0-a4e111476db0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-26e9544f-ba0e-4ee6-bec0-a4e111476db0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:43.728982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:43.729937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:43.730865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:43.730865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:43.730865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:43.730865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:43.730865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:43.730865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:43.730865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:43.730865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:43.730865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 454/936] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:43.731987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65381e2b-2004-45af-bfdd-35324c2e3eb7 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:43.731987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65381e2b-2004-45af-bfdd-35324c2e3eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:43.732280 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65381e2b-2004-45af-bfdd-35324c2e3eb7 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:43.740346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 455/937] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:43.741685 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65381e2b-2004-45af-bfdd-35324c2e3eb7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:43.784338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1a470-ff83-4664-a3d1-d4151acaa135 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:43.818596 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62825f5f-04be-41a4-94d5-fec60a3e1bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:43.819265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62825f5f-04be-41a4-94d5-fec60a3e1bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:43.819544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62825f5f-04be-41a4-94d5-fec60a3e1bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:43.819815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62825f5f-04be-41a4-94d5-fec60a3e1bc8 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:43.820647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62825f5f-04be-41a4-94d5-fec60a3e1bc8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:43.820948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62825f5f-04be-41a4-94d5-fec60a3e1bc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:43.822297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62825f5f-04be-41a4-94d5-fec60a3e1bc8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:43.832333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 483/938] 10.222.0.74 () {56 vars in 1122 bytes} [Thu Jul 14 10:05:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:43.832333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6502-2798-4588-b566-f87bcf1ee095 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:43.832333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6502-2798-4588-b566-f87bcf1ee095 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:43.832333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6502-2798-4588-b566-f87bcf1ee095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:43.846569 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-156e6502-2798-4588-b566-f87bcf1ee095 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:43.847781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-156e6502-2798-4588-b566-f87bcf1ee095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:43.863835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65381e2b-2004-45af-bfdd-35324c2e3eb7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:43.879545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:43.900152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e44a-bead-489b-8cb2-c3cc7fcaa7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:43.900819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e44a-bead-489b-8cb2-c3cc7fcaa7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:43.901101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e44a-bead-489b-8cb2-c3cc7fcaa7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:43.901374 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e44a-bead-489b-8cb2-c3cc7fcaa7a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:43.902128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8e44a-bead-489b-8cb2-c3cc7fcaa7a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:43.902431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8e44a-bead-489b-8cb2-c3cc7fcaa7a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:43.903852 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8e44a-bead-489b-8cb2-c3cc7fcaa7a0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:43.932029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 456/939] 10.222.0.74 () {56 vars in 1112 bytes} [Thu Jul 14 10:05:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:43.932249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 484/940] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:43.932348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e44a-bead-489b-8cb2-c3cc7fcaa7a0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:43.945295 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e6502-2798-4588-b566-f87bcf1ee095 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:44.005132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:44.057528 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e44a-bead-489b-8cb2-c3cc7fcaa7a0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:44.083280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e6502-2798-4588-b566-f87bcf1ee095 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:44.103241 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55d730-fe39-4501-9898-af5761fbac82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:44.104247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55d730-fe39-4501-9898-af5761fbac82 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:44.104721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55d730-fe39-4501-9898-af5761fbac82 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:44.105193 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55d730-fe39-4501-9898-af5761fbac82 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:44.105912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55d730-fe39-4501-9898-af5761fbac82 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:44.106222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55d730-fe39-4501-9898-af5761fbac82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:44.107626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55d730-fe39-4501-9898-af5761fbac82 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:44.114518 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 457/941] 10.222.0.74 () {56 vars in 1122 bytes} [Thu Jul 14 10:05:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:44.121502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55d730-fe39-4501-9898-af5761fbac82 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:44.124262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76048ad1-db44-4b16-9f5b-b28f0ae20666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:44.125093 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76048ad1-db44-4b16-9f5b-b28f0ae20666 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:44.125371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76048ad1-db44-4b16-9f5b-b28f0ae20666 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:44.125642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76048ad1-db44-4b16-9f5b-b28f0ae20666 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:44.142834 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76048ad1-db44-4b16-9f5b-b28f0ae20666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-76048ad1-db44-4b16-9f5b-b28f0ae20666 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:44.151219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:44.152257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:44.153140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:44.153140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:44.153140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:44.153140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:44.153140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:44.153140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:44.153140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:44.153140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:44.153140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:44.153140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:44.153140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:05:44.153140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:44.153810 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 485/942] 10.222.0.74 () {56 vars in 1120 bytes} [Thu Jul 14 10:05:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:44.160552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76048ad1-db44-4b16-9f5b-b28f0ae20666 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:44.191337 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:44.241709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55d730-fe39-4501-9898-af5761fbac82 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:44.263365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:44.277960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042059c5-d37d-47fe-94ed-24ac43e6ed26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:44.278603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042059c5-d37d-47fe-94ed-24ac43e6ed26 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:44.278913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042059c5-d37d-47fe-94ed-24ac43e6ed26 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:44.279191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042059c5-d37d-47fe-94ed-24ac43e6ed26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:44.280625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042059c5-d37d-47fe-94ed-24ac43e6ed26 None admin] RBAC: Adding query filter params (interface=public, service_id=7de7ccc953f745d7a6c735e799570bb2, region_id=RegionOne) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:44.280939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042059c5-d37d-47fe-94ed-24ac43e6ed26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:44.282310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042059c5-d37d-47fe-94ed-24ac43e6ed26 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:44.285508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76048ad1-db44-4b16-9f5b-b28f0ae20666 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:44.288036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 458/943] 10.222.0.74 () {56 vars in 1251 bytes} [Thu Jul 14 10:05:44 2022] GET /identity/v3/endpoints?service_id=7de7ccc953f745d7a6c735e799570bb2&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:44.293707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042059c5-d37d-47fe-94ed-24ac43e6ed26 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:44.334150 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7314b19-728d-4d3c-9176-5c2c7854e0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:44.335441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7314b19-728d-4d3c-9176-5c2c7854e0df None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:44.335731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7314b19-728d-4d3c-9176-5c2c7854e0df None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:44.336025 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7314b19-728d-4d3c-9176-5c2c7854e0df None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:44.337253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7314b19-728d-4d3c-9176-5c2c7854e0df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:44.337569 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7314b19-728d-4d3c-9176-5c2c7854e0df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:44.339661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7314b19-728d-4d3c-9176-5c2c7854e0df None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:44.352073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 486/944] 10.222.0.74 () {56 vars in 1115 bytes} [Thu Jul 14 10:05:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:44.357399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7314b19-728d-4d3c-9176-5c2c7854e0df None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:44.404173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042059c5-d37d-47fe-94ed-24ac43e6ed26 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:44.441060 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f83183-d78b-45e5-8bd1-af6623af3216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:44.441736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f83183-d78b-45e5-8bd1-af6623af3216 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:44.442016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f83183-d78b-45e5-8bd1-af6623af3216 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:44.442287 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f83183-d78b-45e5-8bd1-af6623af3216 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:44.442977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f83183-d78b-45e5-8bd1-af6623af3216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:44.444380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f83183-d78b-45e5-8bd1-af6623af3216 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:44.450889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 459/945] 10.222.0.74 () {56 vars in 1087 bytes} [Thu Jul 14 10:05:44 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:05:44.478289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:44.487553 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7314b19-728d-4d3c-9176-5c2c7854e0df None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:44.525884 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccdf94-c9b2-4725-8dbd-de7346aefda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:44.526789 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccdf94-c9b2-4725-8dbd-de7346aefda1 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:44.527077 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccdf94-c9b2-4725-8dbd-de7346aefda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:44.527350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccdf94-c9b2-4725-8dbd-de7346aefda1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:44.539756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccdf94-c9b2-4725-8dbd-de7346aefda1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:44.541340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccdf94-c9b2-4725-8dbd-de7346aefda1 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c4ccdf94-c9b2-4725-8dbd-de7346aefda1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:44.559922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:44.561865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:44.563451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:44.563451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:44.563451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:44.563451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:44.563451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 487/946] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:44.567885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f83183-d78b-45e5-8bd1-af6623af3216 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:44.628083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:44.682649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f83183-d78b-45e5-8bd1-af6623af3216 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:44.720230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b6bf7-ce95-45e2-9abc-bc83a477d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:44.721285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b6bf7-ce95-45e2-9abc-bc83a477d00c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:44.721802 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b6bf7-ce95-45e2-9abc-bc83a477d00c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:44.722302 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b6bf7-ce95-45e2-9abc-bc83a477d00c None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:44.723246 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b6bf7-ce95-45e2-9abc-bc83a477d00c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:44.723757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b6bf7-ce95-45e2-9abc-bc83a477d00c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:44.726900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b6bf7-ce95-45e2-9abc-bc83a477d00c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:44.739862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 460/947] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:44.747859 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccdf94-c9b2-4725-8dbd-de7346aefda1 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:44.804396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd52236-2090-4760-8b57-147ce4204df3 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:44.804799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd52236-2090-4760-8b57-147ce4204df3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:44.805155 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd52236-2090-4760-8b57-147ce4204df3 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:44.806853 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 461/948] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:05:44.812942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bb00f-ec8b-4dc7-b16b-334fde696533 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:44.813316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bb00f-ec8b-4dc7-b16b-334fde696533 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:44.813660 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bb00f-ec8b-4dc7-b16b-334fde696533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:44.833103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a06bb00f-ec8b-4dc7-b16b-334fde696533 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:44.835020 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a06bb00f-ec8b-4dc7-b16b-334fde696533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:44.865034 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccdf94-c9b2-4725-8dbd-de7346aefda1 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:44.907052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216fc60-56e2-4e94-a093-569a83a84d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:44.912161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216fc60-56e2-4e94-a093-569a83a84d27 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:44.912161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216fc60-56e2-4e94-a093-569a83a84d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:44.912161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216fc60-56e2-4e94-a093-569a83a84d27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:44.912900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 462/949] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:44.916685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216fc60-56e2-4e94-a093-569a83a84d27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:44.918186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216fc60-56e2-4e94-a093-569a83a84d27 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:44.933256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bb00f-ec8b-4dc7-b16b-334fde696533 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-4216fc60-56e2-4e94-a093-569a83a84d27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:44.933593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:44.934554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:44.935524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:44.935524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:44.935524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:44.935524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:44.935524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:44.935524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:44.935524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:44.935524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:44.935524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:05:44.935524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:44.935524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 488/950] 10.222.0.74 () {56 vars in 1117 bytes} [Thu Jul 14 10:05:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:44.942376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216fc60-56e2-4e94-a093-569a83a84d27 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:44.945195 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:45.004396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:45.054167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bb00f-ec8b-4dc7-b16b-334fde696533 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:45.077499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216fc60-56e2-4e94-a093-569a83a84d27 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:45.104714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdae50-f54e-45f2-a561-3920599fbd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:45.105842 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdae50-f54e-45f2-a561-3920599fbd94 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:45.106295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdae50-f54e-45f2-a561-3920599fbd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:45.106986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdae50-f54e-45f2-a561-3920599fbd94 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:45.109172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdae50-f54e-45f2-a561-3920599fbd94 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:45.110695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdae50-f54e-45f2-a561-3920599fbd94 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:45.112985 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0197fd-76a0-477e-b6a6-4c429a234880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:45.113698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0197fd-76a0-477e-b6a6-4c429a234880 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:45.114078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0197fd-76a0-477e-b6a6-4c429a234880 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:45.114640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0197fd-76a0-477e-b6a6-4c429a234880 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:45.115486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0197fd-76a0-477e-b6a6-4c429a234880 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:45.115771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0197fd-76a0-477e-b6a6-4c429a234880 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:45.117276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0197fd-76a0-477e-b6a6-4c429a234880 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:45.137657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 489/951] 10.222.0.74 () {56 vars in 1149 bytes} [Thu Jul 14 10:05:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:45.142329 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0197fd-76a0-477e-b6a6-4c429a234880 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:45.180071 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 463/952] 10.222.0.74 () {60 vars in 1141 bytes} [Thu Jul 14 10:05:44 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:05:45.222015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:45.269525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0197fd-76a0-477e-b6a6-4c429a234880 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:45.314204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5c84a-84db-4957-b6b0-f42cea226c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:45.315020 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5c84a-84db-4957-b6b0-f42cea226c92 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:45.315304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5c84a-84db-4957-b6b0-f42cea226c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:45.315577 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5c84a-84db-4957-b6b0-f42cea226c92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:45.327445 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5c84a-84db-4957-b6b0-f42cea226c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:45.329023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5c84a-84db-4957-b6b0-f42cea226c92 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c5c5c84a-84db-4957-b6b0-f42cea226c92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:45.352906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:45.353894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:45.354806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:45.354806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:45.354806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:45.354806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:45.354806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 490/953] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:45.361147 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdae50-f54e-45f2-a561-3920599fbd94 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:45.459558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:45.463972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdae50-f54e-45f2-a561-3920599fbd94 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:45.504715 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e5167-f87b-407a-ae56-7685887690d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:45.505315 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5167-f87b-407a-ae56-7685887690d7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:45.505653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5167-f87b-407a-ae56-7685887690d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:45.505933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5167-f87b-407a-ae56-7685887690d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:45.506664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e5167-f87b-407a-ae56-7685887690d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:45.506989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e5167-f87b-407a-ae56-7685887690d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:45.508363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e5167-f87b-407a-ae56-7685887690d7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:45.521455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 464/954] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:45.526558 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5c84a-84db-4957-b6b0-f42cea226c92 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:45.638187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5c84a-84db-4957-b6b0-f42cea226c92 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:45.648996 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:45.675082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7a2fd-23fd-4a4c-95f2-1d6520e54b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:45.675882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a2fd-23fd-4a4c-95f2-1d6520e54b72 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:45.676187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a2fd-23fd-4a4c-95f2-1d6520e54b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:45.676460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a2fd-23fd-4a4c-95f2-1d6520e54b72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:45.683850 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7a2fd-23fd-4a4c-95f2-1d6520e54b72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:45.685320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7a2fd-23fd-4a4c-95f2-1d6520e54b72 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c7b7a2fd-23fd-4a4c-95f2-1d6520e54b72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:45.699396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:45.700331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:45.702249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:45.702249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:45.702249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:45.702249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:45.702249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:45.702249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:45.702249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:45.702249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:45.702249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 491/955] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:45.706853 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e5167-f87b-407a-ae56-7685887690d7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:45.814162 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e5167-f87b-407a-ae56-7685887690d7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:45.849524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd85c5f-c070-4894-825e-8bec9ac17f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:45.850187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd85c5f-c070-4894-825e-8bec9ac17f26 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:45.850466 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd85c5f-c070-4894-825e-8bec9ac17f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:45.850737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd85c5f-c070-4894-825e-8bec9ac17f26 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:45.851519 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd85c5f-c070-4894-825e-8bec9ac17f26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:45.851821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd85c5f-c070-4894-825e-8bec9ac17f26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:45.853277 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd85c5f-c070-4894-825e-8bec9ac17f26 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:45.865623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 465/956] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:45.877037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7a2fd-23fd-4a4c-95f2-1d6520e54b72 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:45.981426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7a2fd-23fd-4a4c-95f2-1d6520e54b72 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:46.016147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91e8d4-1fc9-42cc-93d6-b209b07e25f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:46.017120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91e8d4-1fc9-42cc-93d6-b209b07e25f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:46.017400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91e8d4-1fc9-42cc-93d6-b209b07e25f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:46.017672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91e8d4-1fc9-42cc-93d6-b209b07e25f6 None admin] PATH_INFO: `/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/75710267bbf04b629f1fd96ca761b89d/roles/a99d4e2c5a7d4b2d947e64f622f1bb52` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:46.019879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91e8d4-1fc9-42cc-93d6-b209b07e25f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=795b6593e7b74eeda9929aba07cbaa0e, user_id=75710267bbf04b629f1fd96ca761b89d, role_id=a99d4e2c5a7d4b2d947e64f622f1bb52)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:46.021343 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91e8d4-1fc9-42cc-93d6-b209b07e25f6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:46.092717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 492/957] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:05:45 2022] PUT /identity/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/75710267bbf04b629f1fd96ca761b89d/roles/a99d4e2c5a7d4b2d947e64f622f1bb52 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:05:46.236871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6384a9-7828-4360-b9b9-905dee474498 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:46.237160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6384a9-7828-4360-b9b9-905dee474498 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:46.237443 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6384a9-7828-4360-b9b9-905dee474498 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:46.238836 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 466/958] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:46.244124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7ea19-c95a-477e-87e2-e6177b670137 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:46.244415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7ea19-c95a-477e-87e2-e6177b670137 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:46.244688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7ea19-c95a-477e-87e2-e6177b670137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:46.262514 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-adb7ea19-c95a-477e-87e2-e6177b670137 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:46.263698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-adb7ea19-c95a-477e-87e2-e6177b670137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:46.290525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:46.337711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 493/959] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:46.363383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6384a9-7828-4360-b9b9-905dee474498 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:46.383585 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:46.468783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6384a9-7828-4360-b9b9-905dee474498 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:46.506061 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9e80a-f157-4548-bb0a-7dba9cf2d2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:46.506731 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9e80a-f157-4548-bb0a-7dba9cf2d2e5 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:46.507011 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9e80a-f157-4548-bb0a-7dba9cf2d2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:46.507280 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9e80a-f157-4548-bb0a-7dba9cf2d2e5 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:46.507972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9e80a-f157-4548-bb0a-7dba9cf2d2e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:46.509420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9e80a-f157-4548-bb0a-7dba9cf2d2e5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:46.548714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.sql.core [None req-cdc9e80a-f157-4548-bb0a-7dba9cf2d2e5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 10:05:46.548714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 10:05:46.548714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [parameters: {'user_id': '9c6e90b55ac24eb597cee02be1bb9f77', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 10:05:46.548714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80503) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-cdc9e80a-f157-4548-bb0a-7dba9cf2d2e5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application result.read() Jul 14 10:05:46.556405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:05:46.557305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application yield resource Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise self.value Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application session.commit() Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 10:05:46.558331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.session.flush() Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application compat.raise_( Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 10:05:46.559260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:05:46.560222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application result.read() Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:05:46.561757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [parameters: {'user_id': '9c6e90b55ac24eb597cee02be1bb9f77', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:46.562621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 10:05:46.563650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 10:05:46.569007 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 10:05:46.569007 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 10:05:46.569007 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 10:05:46.569007 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 10:05:46.569007 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 10:05:46.569007 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:46.569007 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 467/960] 10.222.0.74 () {60 vars in 1131 bytes} [Thu Jul 14 10:05:46 2022] POST /identity/v3/users => generated 160 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:46.569502 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7ea19-c95a-477e-87e2-e6177b670137 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:46.665087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455e2e-ba5e-434b-9c9b-5718e0b183c5 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:46.665359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455e2e-ba5e-434b-9c9b-5718e0b183c5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:46.665554 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455e2e-ba5e-434b-9c9b-5718e0b183c5 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:46.675295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 468/961] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:46.676884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdce079-0a85-4288-b90a-1899f1007ee2 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:46.677171 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7ea19-c95a-477e-87e2-e6177b670137 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:46.677347 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdce079-0a85-4288-b90a-1899f1007ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:46.677499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdce079-0a85-4288-b90a-1899f1007ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:46.694948 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7bdce079-0a85-4288-b90a-1899f1007ee2 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:46.696760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7bdce079-0a85-4288-b90a-1899f1007ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:46.718410 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004e281-86a3-4a3a-8daf-8054882b25ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:46.719213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004e281-86a3-4a3a-8daf-8054882b25ee None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:46.719496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004e281-86a3-4a3a-8daf-8054882b25ee None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:46.719774 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004e281-86a3-4a3a-8daf-8054882b25ee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:46.727686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004e281-86a3-4a3a-8daf-8054882b25ee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:46.729246 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004e281-86a3-4a3a-8daf-8054882b25ee None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-5004e281-86a3-4a3a-8daf-8054882b25ee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:46.745276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:46.747348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:46.748857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:46.748857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:46.748857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:46.748857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:46.748857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:46.748857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:46.748857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:46.748857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:46.748857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:05:46.748857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:46.748857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 494/962] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:05:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:46.760920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004e281-86a3-4a3a-8daf-8054882b25ee None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:46.770438 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 469/963] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:05:46.782061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:46.801544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdce079-0a85-4288-b90a-1899f1007ee2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:46.816054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:46.885368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004e281-86a3-4a3a-8daf-8054882b25ee None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:46.932339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdce079-0a85-4288-b90a-1899f1007ee2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:46.934111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2829c1-a2ea-4343-ba58-5e0b46d0fd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:46.935749 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2829c1-a2ea-4343-ba58-5e0b46d0fd86 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:46.936151 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2829c1-a2ea-4343-ba58-5e0b46d0fd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:46.936506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2829c1-a2ea-4343-ba58-5e0b46d0fd86 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:46.937391 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2829c1-a2ea-4343-ba58-5e0b46d0fd86 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:46.937768 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2829c1-a2ea-4343-ba58-5e0b46d0fd86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:46.939275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2829c1-a2ea-4343-ba58-5e0b46d0fd86 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:46.969784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a090bf3-ca4f-4b2c-a9f6-68974ac708e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:46.970593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090bf3-ca4f-4b2c-a9f6-68974ac708e0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:46.970875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090bf3-ca4f-4b2c-a9f6-68974ac708e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:46.971149 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090bf3-ca4f-4b2c-a9f6-68974ac708e0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:46.972647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a090bf3-ca4f-4b2c-a9f6-68974ac708e0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:46.974150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a090bf3-ca4f-4b2c-a9f6-68974ac708e0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3a090bf3-ca4f-4b2c-a9f6-68974ac708e0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:46.989717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:46.990810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:46.991688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:46.991688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:46.991688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:46.991688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:46.991688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:46.991688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:46.991688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:46.991688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:46.991688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:46.991688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:46.991688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:46.991688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:46.991688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:46.991688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:46.994953 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 495/965] 10.222.0.74 () {56 vars in 1101 bytes} [Thu Jul 14 10:05:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:46.995113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 470/965] 10.222.0.74 () {56 vars in 1126 bytes} [Thu Jul 14 10:05:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:47.004112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2829c1-a2ea-4343-ba58-5e0b46d0fd86 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:47.108969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:47.134593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2829c1-a2ea-4343-ba58-5e0b46d0fd86 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:47.175903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855789c9-195f-40a4-8814-fd9fd0ce13c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:47.177074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855789c9-195f-40a4-8814-fd9fd0ce13c7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:47.177575 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855789c9-195f-40a4-8814-fd9fd0ce13c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:47.178062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855789c9-195f-40a4-8814-fd9fd0ce13c7 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:47.178980 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855789c9-195f-40a4-8814-fd9fd0ce13c7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:47.179465 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855789c9-195f-40a4-8814-fd9fd0ce13c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:47.180872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855789c9-195f-40a4-8814-fd9fd0ce13c7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:47.186298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 496/966] 10.222.0.74 () {56 vars in 1122 bytes} [Thu Jul 14 10:05:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:47.192197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a090bf3-ca4f-4b2c-a9f6-68974ac708e0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:47.276319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:47.302408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a090bf3-ca4f-4b2c-a9f6-68974ac708e0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:47.337799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc2b42-f48c-4b13-8581-4129ae701f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:47.338461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc2b42-f48c-4b13-8581-4129ae701f42 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:47.338741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc2b42-f48c-4b13-8581-4129ae701f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:47.339013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc2b42-f48c-4b13-8581-4129ae701f42 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:47.339717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc2b42-f48c-4b13-8581-4129ae701f42 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:47.340036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc2b42-f48c-4b13-8581-4129ae701f42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:47.341398 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc2b42-f48c-4b13-8581-4129ae701f42 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:47.351537 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 471/967] 10.222.0.74 () {56 vars in 1122 bytes} [Thu Jul 14 10:05:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:47.353172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855789c9-195f-40a4-8814-fd9fd0ce13c7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:47.454419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855789c9-195f-40a4-8814-fd9fd0ce13c7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:47.459575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd856ccb-3df2-473a-a319-e38706a8dcb1 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:47.460056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd856ccb-3df2-473a-a319-e38706a8dcb1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:47.460238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd856ccb-3df2-473a-a319-e38706a8dcb1 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:47.461686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 472/968] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:47.466280 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b98387-9d6e-4e0d-80d7-38a8ec8b5e85 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:47.466575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b98387-9d6e-4e0d-80d7-38a8ec8b5e85 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:47.467441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b98387-9d6e-4e0d-80d7-38a8ec8b5e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:47.483805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f5b98387-9d6e-4e0d-80d7-38a8ec8b5e85 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:47.485024 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f5b98387-9d6e-4e0d-80d7-38a8ec8b5e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:47.491518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfd9ec-a373-4fad-850e-4b924743bb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:47.492222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd9ec-a373-4fad-850e-4b924743bb49 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:47.492913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd9ec-a373-4fad-850e-4b924743bb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:47.493191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd9ec-a373-4fad-850e-4b924743bb49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:47.493924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfd9ec-a373-4fad-850e-4b924743bb49 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:47.495963 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfd9ec-a373-4fad-850e-4b924743bb49 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:47.504404 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:47.552650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 473/969] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:05:47.576019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b98387-9d6e-4e0d-80d7-38a8ec8b5e85 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:47.596030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 497/970] 10.222.0.74 () {60 vars in 1144 bytes} [Thu Jul 14 10:05:47 2022] POST /identity/v3/endpoints => generated 349 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:05:47.651649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:47.689613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b98387-9d6e-4e0d-80d7-38a8ec8b5e85 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:47.734007 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80464e14-c163-48a4-a96b-12a225c9ec77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:47.734720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80464e14-c163-48a4-a96b-12a225c9ec77 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:47.735002 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80464e14-c163-48a4-a96b-12a225c9ec77 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:47.735276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80464e14-c163-48a4-a96b-12a225c9ec77 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:47.735930 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80464e14-c163-48a4-a96b-12a225c9ec77 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:47.737599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80464e14-c163-48a4-a96b-12a225c9ec77 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-80464e14-c163-48a4-a96b-12a225c9ec77 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:47.749631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:47.750664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:47.751749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 474/971] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:47.756802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfd9ec-a373-4fad-850e-4b924743bb49 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:47.870490 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfd9ec-a373-4fad-850e-4b924743bb49 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:47.906151 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a27f09-1fc0-4aa5-ab63-95fc482d89d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:47.907104 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a27f09-1fc0-4aa5-ab63-95fc482d89d9 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:47.907574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a27f09-1fc0-4aa5-ab63-95fc482d89d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:47.908333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a27f09-1fc0-4aa5-ab63-95fc482d89d9 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:47.909225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a27f09-1fc0-4aa5-ab63-95fc482d89d9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:47.909716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a27f09-1fc0-4aa5-ab63-95fc482d89d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:47.911272 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a27f09-1fc0-4aa5-ab63-95fc482d89d9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:47.916626 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 498/972] 10.222.0.74 () {56 vars in 1112 bytes} [Thu Jul 14 10:05:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:47.922006 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80464e14-c163-48a4-a96b-12a225c9ec77 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:48.024794 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80464e14-c163-48a4-a96b-12a225c9ec77 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:48.059946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:48.069381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8a238-8469-43a9-b07a-ff67ce8e9c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:48.070057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8a238-8469-43a9-b07a-ff67ce8e9c00 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:48.083972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8a238-8469-43a9-b07a-ff67ce8e9c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:48.083972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8a238-8469-43a9-b07a-ff67ce8e9c00 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:48.083972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8a238-8469-43a9-b07a-ff67ce8e9c00 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:48.083972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8a238-8469-43a9-b07a-ff67ce8e9c00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:48.083972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8a238-8469-43a9-b07a-ff67ce8e9c00 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:48.083972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 475/973] 10.222.0.74 () {56 vars in 1112 bytes} [Thu Jul 14 10:05:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:48.084933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a27f09-1fc0-4aa5-ab63-95fc482d89d9 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:48.147289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:48.165508 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86560b-94ae-4618-9b50-7553970f4224 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:48.165827 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86560b-94ae-4618-9b50-7553970f4224 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:48.166127 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86560b-94ae-4618-9b50-7553970f4224 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:48.167641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 476/974] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:48.172309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815db5-6261-4f45-beb9-27c72fc8e7f6 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:48.172600 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815db5-6261-4f45-beb9-27c72fc8e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:48.172873 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815db5-6261-4f45-beb9-27c72fc8e7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:48.189173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c1815db5-6261-4f45-beb9-27c72fc8e7f6 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:48.190357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c1815db5-6261-4f45-beb9-27c72fc8e7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:48.192057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a27f09-1fc0-4aa5-ab63-95fc482d89d9 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:48.228995 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64b9b8-9a84-4fa2-a188-aaf65cef310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:48.229921 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64b9b8-9a84-4fa2-a188-aaf65cef310f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:48.230541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64b9b8-9a84-4fa2-a188-aaf65cef310f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:48.230823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64b9b8-9a84-4fa2-a188-aaf65cef310f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:48.231619 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64b9b8-9a84-4fa2-a188-aaf65cef310f None admin] RBAC: Adding query filter params (interface=public, service_id=b8d58fc2fd7b40319a9b013c9f61647f, region_id=RegionOne) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:48.231930 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64b9b8-9a84-4fa2-a188-aaf65cef310f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:48.233517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64b9b8-9a84-4fa2-a188-aaf65cef310f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:48.243252 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 499/975] 10.222.0.74 () {56 vars in 1251 bytes} [Thu Jul 14 10:05:48 2022] GET /identity/v3/endpoints?service_id=b8d58fc2fd7b40319a9b013c9f61647f&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:48.244267 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64b9b8-9a84-4fa2-a188-aaf65cef310f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:48.265546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 477/976] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:05:48.294360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1815db5-6261-4f45-beb9-27c72fc8e7f6 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:48.390874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64b9b8-9a84-4fa2-a188-aaf65cef310f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:48.415862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1815db5-6261-4f45-beb9-27c72fc8e7f6 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:48.419613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:48.440720 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08966811-1ef1-4f4f-b08d-5f5a9ead8c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:48.441534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08966811-1ef1-4f4f-b08d-5f5a9ead8c50 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:48.441823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08966811-1ef1-4f4f-b08d-5f5a9ead8c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:48.442105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08966811-1ef1-4f4f-b08d-5f5a9ead8c50 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:48.442798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08966811-1ef1-4f4f-b08d-5f5a9ead8c50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:48.444591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08966811-1ef1-4f4f-b08d-5f5a9ead8c50 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:48.449526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:48.454039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 500/977] 10.222.0.74 () {56 vars in 1087 bytes} [Thu Jul 14 10:05:48 2022] GET /identity/v3/services => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:05:48.461986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72a048-144f-4729-856b-c6ff11a2212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:48.463667 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72a048-144f-4729-856b-c6ff11a2212d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:48.463946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72a048-144f-4729-856b-c6ff11a2212d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:48.464271 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72a048-144f-4729-856b-c6ff11a2212d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:48.479528 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72a048-144f-4729-856b-c6ff11a2212d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-6f72a048-144f-4729-856b-c6ff11a2212d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:48.488774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:48.489840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:48.492979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:48.492979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:48.492979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:48.492979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:48.492979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:48.492979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:48.492979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:48.492979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:48.492979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:48.492979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:48.492979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:05:48.492979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:48.492979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 478/978] 10.222.0.74 () {56 vars in 1120 bytes} [Thu Jul 14 10:05:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:48.496245 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08966811-1ef1-4f4f-b08d-5f5a9ead8c50 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:48.612324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08966811-1ef1-4f4f-b08d-5f5a9ead8c50 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:48.660390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3caec-5c21-4fc2-9dc2-2606997e8a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:48.661075 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3caec-5c21-4fc2-9dc2-2606997e8a3a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:48.661363 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3caec-5c21-4fc2-9dc2-2606997e8a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:48.661642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3caec-5c21-4fc2-9dc2-2606997e8a3a None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:48.662397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3caec-5c21-4fc2-9dc2-2606997e8a3a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:48.662706 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3caec-5c21-4fc2-9dc2-2606997e8a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:48.666034 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3caec-5c21-4fc2-9dc2-2606997e8a3a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:48.675529 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 501/979] 10.222.0.74 () {56 vars in 1115 bytes} [Thu Jul 14 10:05:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:48.681412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72a048-144f-4729-856b-c6ff11a2212d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:48.790044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72a048-144f-4729-856b-c6ff11a2212d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:48.823554 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10c6e7-e381-4301-bf6f-d9a12762043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:48.824384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c6e7-e381-4301-bf6f-d9a12762043f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:48.824670 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c6e7-e381-4301-bf6f-d9a12762043f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:48.825055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c6e7-e381-4301-bf6f-d9a12762043f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:48.836251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10c6e7-e381-4301-bf6f-d9a12762043f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:48.837703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10c6e7-e381-4301-bf6f-d9a12762043f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-1d10c6e7-e381-4301-bf6f-d9a12762043f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:48.855067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:48.855988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:48.857206 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:48.857206 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:48.857206 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:48.857206 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:48.860911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 479/980] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:48.862390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3caec-5c21-4fc2-9dc2-2606997e8a3a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:48.913691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:48.968482 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3caec-5c21-4fc2-9dc2-2606997e8a3a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:49.002013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23156ed6-a0b6-4a7b-a232-b7f12b5e0ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:49.002682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23156ed6-a0b6-4a7b-a232-b7f12b5e0ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:49.002967 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23156ed6-a0b6-4a7b-a232-b7f12b5e0ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:49.003236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23156ed6-a0b6-4a7b-a232-b7f12b5e0ec2 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:49.003951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23156ed6-a0b6-4a7b-a232-b7f12b5e0ec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:49.004284 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23156ed6-a0b6-4a7b-a232-b7f12b5e0ec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:49.005642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23156ed6-a0b6-4a7b-a232-b7f12b5e0ec2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:49.018169 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 502/981] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:49.023501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10c6e7-e381-4301-bf6f-d9a12762043f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:49.066223 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:49.148069 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10c6e7-e381-4301-bf6f-d9a12762043f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:49.183174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c4a0d-82d4-4398-9a93-75bca0fee335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:49.183988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c4a0d-82d4-4398-9a93-75bca0fee335 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:49.184296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c4a0d-82d4-4398-9a93-75bca0fee335 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:49.184566 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c4a0d-82d4-4398-9a93-75bca0fee335 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:49.192225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c4a0d-82d4-4398-9a93-75bca0fee335 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:49.193672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c4a0d-82d4-4398-9a93-75bca0fee335 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-854c4a0d-82d4-4398-9a93-75bca0fee335 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:49.208222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:49.209196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:49.210184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:49.210184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:49.210184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:49.210184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:49.210184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:49.210184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:49.210184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:49.210184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:49.210184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:05:49.210184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:49.210184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 480/982] 10.222.0.74 () {56 vars in 1117 bytes} [Thu Jul 14 10:05:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:49.217179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23156ed6-a0b6-4a7b-a232-b7f12b5e0ec2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:49.318024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23156ed6-a0b6-4a7b-a232-b7f12b5e0ec2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:49.329433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:49.353072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015da35-d1db-48da-93bf-dc5ee5061f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:49.354066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015da35-d1db-48da-93bf-dc5ee5061f32 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:49.354611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015da35-d1db-48da-93bf-dc5ee5061f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:49.355252 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015da35-d1db-48da-93bf-dc5ee5061f32 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:49.356125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015da35-d1db-48da-93bf-dc5ee5061f32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:49.356438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015da35-d1db-48da-93bf-dc5ee5061f32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:49.358501 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015da35-d1db-48da-93bf-dc5ee5061f32 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:49.377184 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 503/983] 10.222.0.74 () {56 vars in 1149 bytes} [Thu Jul 14 10:05:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:49.382548 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c4a0d-82d4-4398-9a93-75bca0fee335 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:49.477513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:49.485030 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c4a0d-82d4-4398-9a93-75bca0fee335 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:49.518655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06061dd0-6b1a-4011-b308-8d4a4fdb54d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:49.519306 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061dd0-6b1a-4011-b308-8d4a4fdb54d5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:49.519587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061dd0-6b1a-4011-b308-8d4a4fdb54d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:49.519858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061dd0-6b1a-4011-b308-8d4a4fdb54d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:49.590962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06061dd0-6b1a-4011-b308-8d4a4fdb54d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:49.593044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06061dd0-6b1a-4011-b308-8d4a4fdb54d5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:49.669951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921376b7-9a52-4e0f-8165-2e5155332705 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:49.670464 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921376b7-9a52-4e0f-8165-2e5155332705 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:49.670543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921376b7-9a52-4e0f-8165-2e5155332705 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:49.671845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 504/984] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:05:49.676632 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9ab76-70b3-429e-a32a-617d4dae8462 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:49.676915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9ab76-70b3-429e-a32a-617d4dae8462 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:49.677190 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9ab76-70b3-429e-a32a-617d4dae8462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:49.687684 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:49.694218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-78f9ab76-70b3-429e-a32a-617d4dae8462 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:49.699766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 481/985] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:49 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:05:49.699938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-78f9ab76-70b3-429e-a32a-617d4dae8462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:49.700717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06061dd0-6b1a-4011-b308-8d4a4fdb54d5 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:49.776341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 505/986] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:05:49.799532 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9ab76-70b3-429e-a32a-617d4dae8462 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:49.805035 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06061dd0-6b1a-4011-b308-8d4a4fdb54d5 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:49.843258 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51741503-e7d3-4e20-9169-1fcc353d20aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:49.844013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51741503-e7d3-4e20-9169-1fcc353d20aa None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:49.844299 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51741503-e7d3-4e20-9169-1fcc353d20aa None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:49.844569 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51741503-e7d3-4e20-9169-1fcc353d20aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:49.855601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51741503-e7d3-4e20-9169-1fcc353d20aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:49.857070 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51741503-e7d3-4e20-9169-1fcc353d20aa None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-51741503-e7d3-4e20-9169-1fcc353d20aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:49.875423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:49.876387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:49.877327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:49.877327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:49.877327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:49.877327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:49.877327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 482/987] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:49.882044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51741503-e7d3-4e20-9169-1fcc353d20aa None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:49.899398 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:49.903608 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9ab76-70b3-429e-a32a-617d4dae8462 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:49.932114 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:49.939831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf162d-c4aa-4b88-8a30-bfc3f31b5a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:49.940760 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf162d-c4aa-4b88-8a30-bfc3f31b5a60 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:49.941049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf162d-c4aa-4b88-8a30-bfc3f31b5a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:49.941322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf162d-c4aa-4b88-8a30-bfc3f31b5a60 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:49.941978 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf162d-c4aa-4b88-8a30-bfc3f31b5a60 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:49.943347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf162d-c4aa-4b88-8a30-bfc3f31b5a60 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-5cdf162d-c4aa-4b88-8a30-bfc3f31b5a60 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:49.955487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:49.956557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:49.957426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 506/988] 10.222.0.74 () {56 vars in 1126 bytes} [Thu Jul 14 10:05:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:49.962535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf162d-c4aa-4b88-8a30-bfc3f31b5a60 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:49.992275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51741503-e7d3-4e20-9169-1fcc353d20aa None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:50.028297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8c39c-868f-4890-a363-8ec9238fbf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:50.028890 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c39c-868f-4890-a363-8ec9238fbf28 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:50.029767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c39c-868f-4890-a363-8ec9238fbf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:50.029992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c39c-868f-4890-a363-8ec9238fbf28 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:50.030716 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8c39c-868f-4890-a363-8ec9238fbf28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:50.031025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8c39c-868f-4890-a363-8ec9238fbf28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:50.032412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8c39c-868f-4890-a363-8ec9238fbf28 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:50.044498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 483/989] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:50.050458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8c39c-868f-4890-a363-8ec9238fbf28 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:50.079081 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf162d-c4aa-4b88-8a30-bfc3f31b5a60 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:50.115868 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac424752-d27c-4ce5-9f24-dc25c218fa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:50.116679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac424752-d27c-4ce5-9f24-dc25c218fa37 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:50.116963 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac424752-d27c-4ce5-9f24-dc25c218fa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:50.117237 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac424752-d27c-4ce5-9f24-dc25c218fa37 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:50.117968 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac424752-d27c-4ce5-9f24-dc25c218fa37 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:50.118255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac424752-d27c-4ce5-9f24-dc25c218fa37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:50.119616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac424752-d27c-4ce5-9f24-dc25c218fa37 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:50.125102 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 507/990] 10.222.0.74 () {56 vars in 1122 bytes} [Thu Jul 14 10:05:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:50.130506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac424752-d27c-4ce5-9f24-dc25c218fa37 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:50.157356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8c39c-868f-4890-a363-8ec9238fbf28 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:50.161736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:50.165816 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:50.193404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409cefa-edc5-48d2-a6f3-4f48d50ac9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:50.194192 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409cefa-edc5-48d2-a6f3-4f48d50ac9ab None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:50.194471 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409cefa-edc5-48d2-a6f3-4f48d50ac9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:50.194741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409cefa-edc5-48d2-a6f3-4f48d50ac9ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:50.202099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409cefa-edc5-48d2-a6f3-4f48d50ac9ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:50.205210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409cefa-edc5-48d2-a6f3-4f48d50ac9ab None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-5409cefa-edc5-48d2-a6f3-4f48d50ac9ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:50.219012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:50.220099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:50.221023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:50.221023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:50.221023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:50.221023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:50.221023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:50.221023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:50.221023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:50.221023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:50.223722 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 484/991] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:50.229528 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409cefa-edc5-48d2-a6f3-4f48d50ac9ab None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:50.239249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac424752-d27c-4ce5-9f24-dc25c218fa37 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:50.279865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d79c3-3e7b-4a39-a2d8-bb3373e54075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:50.280862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d79c3-3e7b-4a39-a2d8-bb3373e54075 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:50.281320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d79c3-3e7b-4a39-a2d8-bb3373e54075 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:50.281599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d79c3-3e7b-4a39-a2d8-bb3373e54075 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:50.282309 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d79c3-3e7b-4a39-a2d8-bb3373e54075 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:50.282618 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d79c3-3e7b-4a39-a2d8-bb3373e54075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:50.284265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d79c3-3e7b-4a39-a2d8-bb3373e54075 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:50.289237 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 508/992] 10.222.0.74 () {56 vars in 1122 bytes} [Thu Jul 14 10:05:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:50.295180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d79c3-3e7b-4a39-a2d8-bb3373e54075 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:50.338285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409cefa-edc5-48d2-a6f3-4f48d50ac9ab None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:50.373533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ae812-06bc-49de-aa15-f818734e9d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:50.374196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ae812-06bc-49de-aa15-f818734e9d04 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:50.374499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ae812-06bc-49de-aa15-f818734e9d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:50.374758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ae812-06bc-49de-aa15-f818734e9d04 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:50.375553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ae812-06bc-49de-aa15-f818734e9d04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:50.375864 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ae812-06bc-49de-aa15-f818734e9d04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:50.377325 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ae812-06bc-49de-aa15-f818734e9d04 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:50.388183 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:50.395052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 485/993] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:50.395879 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ae812-06bc-49de-aa15-f818734e9d04 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:50.398147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d79c3-3e7b-4a39-a2d8-bb3373e54075 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:50.425714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:50.435565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269e18e-ceb9-4a85-a3e4-9495c502af77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:50.436259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269e18e-ceb9-4a85-a3e4-9495c502af77 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:50.436546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269e18e-ceb9-4a85-a3e4-9495c502af77 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:50.436825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269e18e-ceb9-4a85-a3e4-9495c502af77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:50.437631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269e18e-ceb9-4a85-a3e4-9495c502af77 None admin] RBAC: Adding query filter params (interface=admin, service_id=7de7ccc953f745d7a6c735e799570bb2, region_id=RegionOne) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:50.437946 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269e18e-ceb9-4a85-a3e4-9495c502af77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:50.439319 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269e18e-ceb9-4a85-a3e4-9495c502af77 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:50.445135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 509/994] 10.222.0.74 () {56 vars in 1249 bytes} [Thu Jul 14 10:05:50 2022] GET /identity/v3/endpoints?service_id=7de7ccc953f745d7a6c735e799570bb2&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:50.450653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269e18e-ceb9-4a85-a3e4-9495c502af77 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:50.513712 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ae812-06bc-49de-aa15-f818734e9d04 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:50.551017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1d0ec-da54-4794-9a91-a99596656dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:50.551593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1d0ec-da54-4794-9a91-a99596656dea None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:50.551875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1d0ec-da54-4794-9a91-a99596656dea None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:50.552183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1d0ec-da54-4794-9a91-a99596656dea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:50.553016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1d0ec-da54-4794-9a91-a99596656dea None admin] RBAC: Adding query filter params (role.id=a99d4e2c5a7d4b2d947e64f622f1bb52, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=75710267bbf04b629f1fd96ca761b89d) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:50.553320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1d0ec-da54-4794-9a91-a99596656dea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:50.554778 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1d0ec-da54-4794-9a91-a99596656dea None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:50.558200 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269e18e-ceb9-4a85-a3e4-9495c502af77 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:50.561568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 486/995] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:50 2022] GET /identity/v3/role_assignments?user.id=75710267bbf04b629f1fd96ca761b89d&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=a99d4e2c5a7d4b2d947e64f622f1bb52 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:50.562501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed2431-781f-4e62-b943-a0ab47b87c3a None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:50.562790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed2431-781f-4e62-b943-a0ab47b87c3a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:50.563066 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed2431-781f-4e62-b943-a0ab47b87c3a None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:50.568710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 487/996] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:50.569935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7fb9f-02ee-4a24-a3ee-210ea0ccb502 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:50.570289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7fb9f-02ee-4a24-a3ee-210ea0ccb502 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:50.571049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7fb9f-02ee-4a24-a3ee-210ea0ccb502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:50.589089 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1da7fb9f-02ee-4a24-a3ee-210ea0ccb502 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:50.599762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1da7fb9f-02ee-4a24-a3ee-210ea0ccb502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:50.600853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ae2ac-6a97-4544-9192-d7b24a67d5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:50.601607 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ae2ac-6a97-4544-9192-d7b24a67d5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:50.601985 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ae2ac-6a97-4544-9192-d7b24a67d5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:50.602291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ae2ac-6a97-4544-9192-d7b24a67d5b1 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:50.603115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ae2ac-6a97-4544-9192-d7b24a67d5b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:50.604750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ae2ac-6a97-4544-9192-d7b24a67d5b1 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:50.612244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 510/997] 10.222.0.74 () {56 vars in 1087 bytes} [Thu Jul 14 10:05:50 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:05:50.671131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 488/998] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:05:50.695121 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ae2ac-6a97-4544-9192-d7b24a67d5b1 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:50.718535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:50.812964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ae2ac-6a97-4544-9192-d7b24a67d5b1 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:50.847819 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da670316-73e2-4fff-a205-1f5d90872e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:50.848649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da670316-73e2-4fff-a205-1f5d90872e51 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:50.848936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da670316-73e2-4fff-a205-1f5d90872e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:50.849211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da670316-73e2-4fff-a205-1f5d90872e51 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:50.849865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da670316-73e2-4fff-a205-1f5d90872e51 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:50.851231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da670316-73e2-4fff-a205-1f5d90872e51 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-da670316-73e2-4fff-a205-1f5d90872e51 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:50.863730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:50.864803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:50.865664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:50.865664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:50.865664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:50.865664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:50.865664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:50.865664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:50.865664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:50.865664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:50.865664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:50.865664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:50.865664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:50.865664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:50.865664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:05:50.865664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:50.868055 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 511/999] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:50.871219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7fb9f-02ee-4a24-a3ee-210ea0ccb502 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:50.894102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:50.974111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7fb9f-02ee-4a24-a3ee-210ea0ccb502 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:51.009094 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3ecde-b57e-472a-ae46-d61119562b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:51.009766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3ecde-b57e-472a-ae46-d61119562b50 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:51.010048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3ecde-b57e-472a-ae46-d61119562b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:51.010321 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3ecde-b57e-472a-ae46-d61119562b50 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:51.011028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3ecde-b57e-472a-ae46-d61119562b50 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:51.011332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3ecde-b57e-472a-ae46-d61119562b50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:51.012720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3ecde-b57e-472a-ae46-d61119562b50 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:51.022219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 489/1000] 10.222.0.74 () {56 vars in 1112 bytes} [Thu Jul 14 10:05:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:51.023450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da670316-73e2-4fff-a205-1f5d90872e51 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:51.119047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:51.138109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da670316-73e2-4fff-a205-1f5d90872e51 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:51.172840 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1a4e8-d68b-4131-b45e-80e94e58a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:51.173514 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1a4e8-d68b-4131-b45e-80e94e58a16c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:51.173799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1a4e8-d68b-4131-b45e-80e94e58a16c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:51.174073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1a4e8-d68b-4131-b45e-80e94e58a16c None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:51.174776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1a4e8-d68b-4131-b45e-80e94e58a16c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:51.175082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1a4e8-d68b-4131-b45e-80e94e58a16c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:51.176480 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1a4e8-d68b-4131-b45e-80e94e58a16c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:51.186509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 512/1001] 10.222.0.74 () {56 vars in 1112 bytes} [Thu Jul 14 10:05:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:51.187653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3ecde-b57e-472a-ae46-d61119562b50 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:51.271982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:51.289183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3ecde-b57e-472a-ae46-d61119562b50 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:51.324996 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817ae0c-5831-424d-baf9-5070511cf168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:51.325668 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817ae0c-5831-424d-baf9-5070511cf168 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:51.325983 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817ae0c-5831-424d-baf9-5070511cf168 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:51.326402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817ae0c-5831-424d-baf9-5070511cf168 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:51.327147 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817ae0c-5831-424d-baf9-5070511cf168 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:51.328551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817ae0c-5831-424d-baf9-5070511cf168 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:51.412111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 490/1002] 10.222.0.74 () {60 vars in 1144 bytes} [Thu Jul 14 10:05:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:05:52.651886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1551c-65e5-4645-b6a2-d37f4a0b853b None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:52.652439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1551c-65e5-4645-b6a2-d37f4a0b853b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:52.652439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1551c-65e5-4645-b6a2-d37f4a0b853b None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:52.654974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 513/1003] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:52.659780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbef7f-db70-44db-803a-2de984cb4d3f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:52.660227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbef7f-db70-44db-803a-2de984cb4d3f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:52.660510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbef7f-db70-44db-803a-2de984cb4d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:52.661356 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d0272-80b0-4335-ab24-9da0ac1697fd None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:52.661648 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d0272-80b0-4335-ab24-9da0ac1697fd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:52.661986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d0272-80b0-4335-ab24-9da0ac1697fd None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:52.663434 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 514/1004] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:52.668090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8820ad5-259a-435b-855a-4dac8781e203 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:52.668387 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8820ad5-259a-435b-855a-4dac8781e203 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:52.668668 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8820ad5-259a-435b-855a-4dac8781e203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:52.678609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-fefbef7f-db70-44db-803a-2de984cb4d3f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:52.679807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-fefbef7f-db70-44db-803a-2de984cb4d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:52.686110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e8820ad5-259a-435b-855a-4dac8781e203 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:52.687277 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e8820ad5-259a-435b-855a-4dac8781e203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:52.759743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 491/1005] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:52 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:52.763089 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 515/1006] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:52 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:05:52.783008 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbef7f-db70-44db-803a-2de984cb4d3f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:52.785246 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8820ad5-259a-435b-855a-4dac8781e203 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:52.853450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:52.857839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:52.886577 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8820ad5-259a-435b-855a-4dac8781e203 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:52.890566 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbef7f-db70-44db-803a-2de984cb4d3f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:52.922776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922e911-93f6-434a-a3cc-c853d6226d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:52.923496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922e911-93f6-434a-a3cc-c853d6226d39 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:52.923775 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922e911-93f6-434a-a3cc-c853d6226d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:52.924081 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922e911-93f6-434a-a3cc-c853d6226d39 None admin] PATH_INFO: `/v3/services/image` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:52.924795 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922e911-93f6-434a-a3cc-c853d6226d39 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:52.925944 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc9286-b986-4b2b-a57c-b6b969bc55c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:52.926180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922e911-93f6-434a-a3cc-c853d6226d39 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:52.926947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc9286-b986-4b2b-a57c-b6b969bc55c8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:52.927238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc9286-b986-4b2b-a57c-b6b969bc55c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:52.927524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc9286-b986-4b2b-a57c-b6b969bc55c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:52.928210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc9286-b986-4b2b-a57c-b6b969bc55c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:52.929664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc9286-b986-4b2b-a57c-b6b969bc55c8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a922e911-93f6-434a-a3cc-c853d6226d39 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:52.938042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:52.939060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:52.939941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 516/1007] 10.222.0.74 () {56 vars in 1105 bytes} [Thu Jul 14 10:05:52 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-0efc9286-b986-4b2b-a57c-b6b969bc55c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:52.942960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:52.945166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:52.947248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:52.947248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:52.947248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:52.947248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:52.947248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:52.947248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:52.947248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:52.947248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:52.947248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:52.947248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:52.947248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:52.947248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:52.947248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:05:52.947248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:52.949049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922e911-93f6-434a-a3cc-c853d6226d39 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:52.949195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 492/1008] 10.222.0.74 () {56 vars in 1126 bytes} [Thu Jul 14 10:05:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:52.951385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc9286-b986-4b2b-a57c-b6b969bc55c8 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:53.054925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922e911-93f6-434a-a3cc-c853d6226d39 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:53.065263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc9286-b986-4b2b-a57c-b6b969bc55c8 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:53.089529 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5594da-d3c8-4b49-a517-03feb07818e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:53.090202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5594da-d3c8-4b49-a517-03feb07818e3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:53.090485 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5594da-d3c8-4b49-a517-03feb07818e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:53.090767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5594da-d3c8-4b49-a517-03feb07818e3 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:53.092019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5594da-d3c8-4b49-a517-03feb07818e3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:53.092326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5594da-d3c8-4b49-a517-03feb07818e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:53.093704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5594da-d3c8-4b49-a517-03feb07818e3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:53.095508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:53.096753 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:53.099218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 517/1009] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:53.105229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5594da-d3c8-4b49-a517-03feb07818e3 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:53.108720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb9263-341d-4756-8f30-5e192190b3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:53.110032 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb9263-341d-4756-8f30-5e192190b3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:53.110032 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb9263-341d-4756-8f30-5e192190b3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:53.110032 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb9263-341d-4756-8f30-5e192190b3e7 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:53.110650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb9263-341d-4756-8f30-5e192190b3e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:53.110960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb9263-341d-4756-8f30-5e192190b3e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:53.112401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb9263-341d-4756-8f30-5e192190b3e7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:53.118173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 493/1010] 10.222.0.74 () {56 vars in 1122 bytes} [Thu Jul 14 10:05:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:53.123663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb9263-341d-4756-8f30-5e192190b3e7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:53.223520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5594da-d3c8-4b49-a517-03feb07818e3 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:53.238684 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb9263-341d-4756-8f30-5e192190b3e7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:53.259189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df789d-41e8-4fb0-b218-429eb4963062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:53.259848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df789d-41e8-4fb0-b218-429eb4963062 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:53.260171 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df789d-41e8-4fb0-b218-429eb4963062 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:53.260445 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df789d-41e8-4fb0-b218-429eb4963062 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:53.261146 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df789d-41e8-4fb0-b218-429eb4963062 None admin] RBAC: Adding query filter params (type=image) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:53.261446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df789d-41e8-4fb0-b218-429eb4963062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:53.262823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df789d-41e8-4fb0-b218-429eb4963062 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:53.268939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 518/1011] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:53.276249 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f985a31-996c-403e-b3f7-56d5721502bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:53.276951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985a31-996c-403e-b3f7-56d5721502bf None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:53.277231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985a31-996c-403e-b3f7-56d5721502bf None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:53.277502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985a31-996c-403e-b3f7-56d5721502bf None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:53.278231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f985a31-996c-403e-b3f7-56d5721502bf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:53.278535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f985a31-996c-403e-b3f7-56d5721502bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:53.280579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f985a31-996c-403e-b3f7-56d5721502bf None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:53.291546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 494/1012] 10.222.0.74 () {56 vars in 1122 bytes} [Thu Jul 14 10:05:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:53.292658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df789d-41e8-4fb0-b218-429eb4963062 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:53.361771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:53.403260 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df789d-41e8-4fb0-b218-429eb4963062 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:53.442424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b8efd-6d15-496e-be82-e10a76c5e2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:53.443087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8efd-6d15-496e-be82-e10a76c5e2df None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:53.443366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8efd-6d15-496e-be82-e10a76c5e2df None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:53.443635 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8efd-6d15-496e-be82-e10a76c5e2df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:53.444410 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b8efd-6d15-496e-be82-e10a76c5e2df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:53.445773 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b8efd-6d15-496e-be82-e10a76c5e2df None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:53.496933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 519/1013] 10.222.0.74 () {60 vars in 1144 bytes} [Thu Jul 14 10:05:53 2022] POST /identity/v3/endpoints => generated 325 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:05:53.516986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1cbe-7ac5-49ce-b7d7-d15cf2a11372 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:53.517421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1cbe-7ac5-49ce-b7d7-d15cf2a11372 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:53.517707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1cbe-7ac5-49ce-b7d7-d15cf2a11372 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:53.519149 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 495/1014] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:53.525206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc626f56-f50f-4505-9e00-1db8a85998bf None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:53.525547 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc626f56-f50f-4505-9e00-1db8a85998bf None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:53.525774 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc626f56-f50f-4505-9e00-1db8a85998bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:53.544052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-fc626f56-f50f-4505-9e00-1db8a85998bf None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:53.545282 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fc626f56-f50f-4505-9e00-1db8a85998bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:53.626341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 520/1015] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:53 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:53.650786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a1cbe-7ac5-49ce-b7d7-d15cf2a11372 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:53.715319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:53.761152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a1cbe-7ac5-49ce-b7d7-d15cf2a11372 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:53.795625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc81d8-07a4-4ab2-9895-54e374117776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:53.796479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc81d8-07a4-4ab2-9895-54e374117776 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:53.796761 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc81d8-07a4-4ab2-9895-54e374117776 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:53.797033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc81d8-07a4-4ab2-9895-54e374117776 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:53.807205 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc81d8-07a4-4ab2-9895-54e374117776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-e6dc81d8-07a4-4ab2-9895-54e374117776 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:53.815337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:53.816505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:53.817367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:53.817367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:53.817367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:53.817367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:53.817367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:53.817367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:53.817367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:53.817367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:53.817367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:53.817367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:53.817367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:05:53.817367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:53.817367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 496/1016] 10.222.0.74 () {56 vars in 1120 bytes} [Thu Jul 14 10:05:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:53.824113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc626f56-f50f-4505-9e00-1db8a85998bf None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:53.875171 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:53.925896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc626f56-f50f-4505-9e00-1db8a85998bf None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:53.960767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988ee70-e37d-475a-95dc-ff78aa6bbbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:53.961444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988ee70-e37d-475a-95dc-ff78aa6bbbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:53.961725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988ee70-e37d-475a-95dc-ff78aa6bbbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:53.961996 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988ee70-e37d-475a-95dc-ff78aa6bbbf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:53.962739 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988ee70-e37d-475a-95dc-ff78aa6bbbf8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:53.963043 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988ee70-e37d-475a-95dc-ff78aa6bbbf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:53.964449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988ee70-e37d-475a-95dc-ff78aa6bbbf8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:53.977972 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 521/1017] 10.222.0.74 () {56 vars in 1115 bytes} [Thu Jul 14 10:05:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:53.979873 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc81d8-07a4-4ab2-9895-54e374117776 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:54.088957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc81d8-07a4-4ab2-9895-54e374117776 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:54.106311 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:54.123529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674a14b-2058-4f89-99d1-14a076b4cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:54.124405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674a14b-2058-4f89-99d1-14a076b4cddb None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:54.124692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674a14b-2058-4f89-99d1-14a076b4cddb None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:54.124967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674a14b-2058-4f89-99d1-14a076b4cddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:54.135107 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674a14b-2058-4f89-99d1-14a076b4cddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:54.137196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674a14b-2058-4f89-99d1-14a076b4cddb None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-a674a14b-2058-4f89-99d1-14a076b4cddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:54.154475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:54.155418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:54.156370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:54.156370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:54.156370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:54.156370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:54.160138 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 497/1018] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:54.161835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988ee70-e37d-475a-95dc-ff78aa6bbbf8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:54.264009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988ee70-e37d-475a-95dc-ff78aa6bbbf8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:54.276658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:54.298822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce4d4c-22e3-41aa-9607-88caa07247fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:54.299487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce4d4c-22e3-41aa-9607-88caa07247fb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:54.299771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce4d4c-22e3-41aa-9607-88caa07247fb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:54.300071 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce4d4c-22e3-41aa-9607-88caa07247fb None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:54.300835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce4d4c-22e3-41aa-9607-88caa07247fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:54.301204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce4d4c-22e3-41aa-9607-88caa07247fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:54.302658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce4d4c-22e3-41aa-9607-88caa07247fb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:54.319567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 522/1019] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:54.321028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674a14b-2058-4f89-99d1-14a076b4cddb None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:54.425077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674a14b-2058-4f89-99d1-14a076b4cddb None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:54.457646 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57d78c-e498-4cb5-9c53-ddfb00055030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:54.458418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d78c-e498-4cb5-9c53-ddfb00055030 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:54.458699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d78c-e498-4cb5-9c53-ddfb00055030 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:54.458972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d78c-e498-4cb5-9c53-ddfb00055030 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:54.466925 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57d78c-e498-4cb5-9c53-ddfb00055030 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:54.468394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57d78c-e498-4cb5-9c53-ddfb00055030 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3c57d78c-e498-4cb5-9c53-ddfb00055030 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:54.482689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:54.483626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:54.484622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:54.484622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:54.484622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:54.484622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:54.484622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:54.484622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:54.484622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:54.484622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:54.484622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:05:54.484622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:54.485765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 498/1020] 10.222.0.74 () {56 vars in 1093 bytes} [Thu Jul 14 10:05:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:54.489584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce4d4c-22e3-41aa-9607-88caa07247fb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:54.592482 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce4d4c-22e3-41aa-9607-88caa07247fb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:54.627280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb768f5-fe65-42dc-a355-681260909bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:54.627979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb768f5-fe65-42dc-a355-681260909bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:54.628289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb768f5-fe65-42dc-a355-681260909bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:54.628562 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb768f5-fe65-42dc-a355-681260909bc7 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:54.629416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb768f5-fe65-42dc-a355-681260909bc7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:54.629727 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb768f5-fe65-42dc-a355-681260909bc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:54.631205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb768f5-fe65-42dc-a355-681260909bc7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:54.654863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 523/1021] 10.222.0.74 () {56 vars in 1133 bytes} [Thu Jul 14 10:05:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:54.656569 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57d78c-e498-4cb5-9c53-ddfb00055030 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:54.689481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:54.761109 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57d78c-e498-4cb5-9c53-ddfb00055030 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:54.794792 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a4a75-6d0e-4053-a11b-1d45bea02a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:54.795448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a4a75-6d0e-4053-a11b-1d45bea02a87 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:54.795730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a4a75-6d0e-4053-a11b-1d45bea02a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:54.796021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a4a75-6d0e-4053-a11b-1d45bea02a87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:54.862024 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a4a75-6d0e-4053-a11b-1d45bea02a87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:54.863484 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a4a75-6d0e-4053-a11b-1d45bea02a87 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:54.893611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:54.968511 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 499/1022] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:05:54 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 10:05:54.969762 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb768f5-fe65-42dc-a355-681260909bc7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:55.000674 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:55.075209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb768f5-fe65-42dc-a355-681260909bc7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:55.109825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760d438-4e5f-4c90-8f97-c9140ab54c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:55.110631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760d438-4e5f-4c90-8f97-c9140ab54c57 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:55.110908 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760d438-4e5f-4c90-8f97-c9140ab54c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:55.111177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760d438-4e5f-4c90-8f97-c9140ab54c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:55.121294 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760d438-4e5f-4c90-8f97-c9140ab54c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:55.122710 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760d438-4e5f-4c90-8f97-c9140ab54c57 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c760d438-4e5f-4c90-8f97-c9140ab54c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:55.140301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:55.141243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:55.146832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:55.146832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:55.146832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:55.146832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:55.146832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 524/1023] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:55.147135 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a4a75-6d0e-4053-a11b-1d45bea02a87 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:55.248352 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a4a75-6d0e-4053-a11b-1d45bea02a87 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:55.276545 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:55.283557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03cb7f-c08c-4b78-8f27-ff1c3a700680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:55.284256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03cb7f-c08c-4b78-8f27-ff1c3a700680 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:55.284539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03cb7f-c08c-4b78-8f27-ff1c3a700680 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:55.284814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03cb7f-c08c-4b78-8f27-ff1c3a700680 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:55.285535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03cb7f-c08c-4b78-8f27-ff1c3a700680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:55.290256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03cb7f-c08c-4b78-8f27-ff1c3a700680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:55.290256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03cb7f-c08c-4b78-8f27-ff1c3a700680 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:55.299104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 500/1024] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:55.304392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760d438-4e5f-4c90-8f97-c9140ab54c57 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:55.315356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ac402-01e3-4fd6-9377-654bad2272f0 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:55.315757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ac402-01e3-4fd6-9377-654bad2272f0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:55.316077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ac402-01e3-4fd6-9377-654bad2272f0 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:55.317463 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 501/1025] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:05:55.322294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56840361-5e44-4ff9-8f00-e82ba8b9d680 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:55.322580 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56840361-5e44-4ff9-8f00-e82ba8b9d680 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:55.322858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56840361-5e44-4ff9-8f00-e82ba8b9d680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:55.340430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-56840361-5e44-4ff9-8f00-e82ba8b9d680 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:55.342150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-56840361-5e44-4ff9-8f00-e82ba8b9d680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:55.390325 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:55.409595 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760d438-4e5f-4c90-8f97-c9140ab54c57 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:55.415390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 502/1026] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:55 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:55.437372 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56840361-5e44-4ff9-8f00-e82ba8b9d680 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:55.444349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0400c-c7d3-42c3-9fd5-cb1a08bfdc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:55.445154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0400c-c7d3-42c3-9fd5-cb1a08bfdc33 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:55.445437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0400c-c7d3-42c3-9fd5-cb1a08bfdc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:55.445712 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0400c-c7d3-42c3-9fd5-cb1a08bfdc33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:55.453059 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0400c-c7d3-42c3-9fd5-cb1a08bfdc33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:55.454504 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0400c-c7d3-42c3-9fd5-cb1a08bfdc33 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-69d0400c-c7d3-42c3-9fd5-cb1a08bfdc33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:55.469058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:55.469992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:55.470925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:55.470925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:55.470925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:55.470925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:55.470925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:55.470925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:55.470925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:55.470925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:55.470925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 525/1027] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:55.475797 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0400c-c7d3-42c3-9fd5-cb1a08bfdc33 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:55.542769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56840361-5e44-4ff9-8f00-e82ba8b9d680 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:55.563700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:55.576997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0400c-c7d3-42c3-9fd5-cb1a08bfdc33 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:55.578076 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76649f3-a419-4ba8-8316-eb3bf77748d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:55.578741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76649f3-a419-4ba8-8316-eb3bf77748d9 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:55.583671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76649f3-a419-4ba8-8316-eb3bf77748d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:55.583671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76649f3-a419-4ba8-8316-eb3bf77748d9 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:55.583671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76649f3-a419-4ba8-8316-eb3bf77748d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:55.583671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76649f3-a419-4ba8-8316-eb3bf77748d9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:55.611068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0efaae-f492-4bfe-ac9d-80d665582785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:55.611732 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0efaae-f492-4bfe-ac9d-80d665582785 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:55.612038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0efaae-f492-4bfe-ac9d-80d665582785 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:55.612317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0efaae-f492-4bfe-ac9d-80d665582785 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:55.613099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0efaae-f492-4bfe-ac9d-80d665582785 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:55.613409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0efaae-f492-4bfe-ac9d-80d665582785 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:55.614823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0efaae-f492-4bfe-ac9d-80d665582785 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:55.626767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 526/1028] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:55.628047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d986a77-81c6-41bb-b70d-500c89ac93f8 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:55.628343 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d986a77-81c6-41bb-b70d-500c89ac93f8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:55.628633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d986a77-81c6-41bb-b70d-500c89ac93f8 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:55.629846 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 527/1029] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:55.632604 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d986a77-81c6-41bb-b70d-500c89ac93f8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:55.635181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:55.640393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 503/1030] 10.222.0.74 () {60 vars in 1141 bytes} [Thu Jul 14 10:05:55 2022] POST /identity/v3/services => generated 242 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:05:55.641466 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b44ce-b715-4dc0-955a-c04e1ae84872 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:55.641968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b44ce-b715-4dc0-955a-c04e1ae84872 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:55.642081 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b44ce-b715-4dc0-955a-c04e1ae84872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:55.660506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ba8b44ce-b715-4dc0-955a-c04e1ae84872 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:55.661753 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ba8b44ce-b715-4dc0-955a-c04e1ae84872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:55.745215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 504/1031] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:55.748125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d986a77-81c6-41bb-b70d-500c89ac93f8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:55.769409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b44ce-b715-4dc0-955a-c04e1ae84872 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:55.786025 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64494175-c555-423d-a8a8-5e8d64604b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:55.786699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64494175-c555-423d-a8a8-5e8d64604b85 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:55.786983 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64494175-c555-423d-a8a8-5e8d64604b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:55.787259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64494175-c555-423d-a8a8-5e8d64604b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:55.789161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64494175-c555-423d-a8a8-5e8d64604b85 None admin] RBAC: Adding query filter params (role.id=a99d4e2c5a7d4b2d947e64f622f1bb52, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=2a0626754b40449ba2346d05c5c90a35) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:55.789484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64494175-c555-423d-a8a8-5e8d64604b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:55.790936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64494175-c555-423d-a8a8-5e8d64604b85 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:55.799259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 528/1032] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:05:55 2022] GET /identity/v3/role_assignments?user.id=2a0626754b40449ba2346d05c5c90a35&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=a99d4e2c5a7d4b2d947e64f622f1bb52 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:55.889239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b44ce-b715-4dc0-955a-c04e1ae84872 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:55.898235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:55.927343 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e0443-5124-4030-b30c-35206063cdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:55.928186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e0443-5124-4030-b30c-35206063cdfc None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:55.928472 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e0443-5124-4030-b30c-35206063cdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:55.928745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e0443-5124-4030-b30c-35206063cdfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:55.930200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e0443-5124-4030-b30c-35206063cdfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:55.932266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e0443-5124-4030-b30c-35206063cdfc None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:55.939361 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 505/1033] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:55.940971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64494175-c555-423d-a8a8-5e8d64604b85 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:56.009954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:56.048773 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64494175-c555-423d-a8a8-5e8d64604b85 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:56.085662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef5dcd-5fb2-48a8-be2a-d0261705ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:56.086629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef5dcd-5fb2-48a8-be2a-d0261705ea4b None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:56.087115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef5dcd-5fb2-48a8-be2a-d0261705ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:56.087609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef5dcd-5fb2-48a8-be2a-d0261705ea4b None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:56.088557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef5dcd-5fb2-48a8-be2a-d0261705ea4b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:56.090274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef5dcd-5fb2-48a8-be2a-d0261705ea4b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:56.208540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 529/1034] 10.222.0.74 () {60 vars in 1141 bytes} [Thu Jul 14 10:05:55 2022] POST /identity/v3/projects => generated 311 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:05:57.721755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad42093-b8de-4ca5-85ad-791bbad9b6da None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:57.722276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad42093-b8de-4ca5-85ad-791bbad9b6da None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:57.722276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad42093-b8de-4ca5-85ad-791bbad9b6da None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:57.723823 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 506/1035] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:57.728900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db798-1ce1-451f-a11b-fcde321926b5 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:57.729323 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db798-1ce1-451f-a11b-fcde321926b5 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:57.729467 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db798-1ce1-451f-a11b-fcde321926b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:57.747080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a23db798-1ce1-451f-a11b-fcde321926b5 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:57.748899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a23db798-1ce1-451f-a11b-fcde321926b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:57.813643 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d43fa-af9e-46ab-82f3-c7448aa8ea84 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:57.813928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d43fa-af9e-46ab-82f3-c7448aa8ea84 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:57.814209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d43fa-af9e-46ab-82f3-c7448aa8ea84 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:57.815717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 507/1036] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:05:57.824187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 530/1037] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:57.824332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161729-e0e1-4a0a-a649-543d6f922793 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:57.824332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161729-e0e1-4a0a-a649-543d6f922793 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:57.824332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161729-e0e1-4a0a-a649-543d6f922793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:57.837731 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e8161729-e0e1-4a0a-a649-543d6f922793 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:57.838919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e8161729-e0e1-4a0a-a649-543d6f922793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:57.841659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23db798-1ce1-451f-a11b-fcde321926b5 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:57.893858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:57.913430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 508/1038] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:05:57.937132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8161729-e0e1-4a0a-a649-543d6f922793 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:57.946377 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23db798-1ce1-451f-a11b-fcde321926b5 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:57.984286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17e83d-e74d-43f1-9f28-ec5b2716c113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:57.985002 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17e83d-e74d-43f1-9f28-ec5b2716c113 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:57.985284 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17e83d-e74d-43f1-9f28-ec5b2716c113 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:57.985558 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17e83d-e74d-43f1-9f28-ec5b2716c113 None admin] PATH_INFO: `/v3/services/image` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:57.986206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17e83d-e74d-43f1-9f28-ec5b2716c113 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:57.987564 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17e83d-e74d-43f1-9f28-ec5b2716c113 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-7a17e83d-e74d-43f1-9f28-ec5b2716c113 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:57.999399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:58.000461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:58.001322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 531/1039] 10.222.0.74 () {56 vars in 1105 bytes} [Thu Jul 14 10:05:57 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:58.006895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17e83d-e74d-43f1-9f28-ec5b2716c113 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:58.053519 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8161729-e0e1-4a0a-a649-543d6f922793 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:58.059716 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:58.095290 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362973cc-eb19-4b28-b149-bb6de7d25be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:58.096444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362973cc-eb19-4b28-b149-bb6de7d25be0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:58.096734 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362973cc-eb19-4b28-b149-bb6de7d25be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:58.097157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362973cc-eb19-4b28-b149-bb6de7d25be0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:58.108390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362973cc-eb19-4b28-b149-bb6de7d25be0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-362973cc-eb19-4b28-b149-bb6de7d25be0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:05:58.116858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:58.117967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:58.118967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:58.118967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:58.118967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:58.118967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:58.118967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:05:58.118967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:05:58.118967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:05:58.118967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:05:58.118967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:05:58.118967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:05:58.118967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:05:58.118967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:58.118967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 509/1040] 10.222.0.74 () {56 vars in 1120 bytes} [Thu Jul 14 10:05:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:58.122630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17e83d-e74d-43f1-9f28-ec5b2716c113 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:58.124203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362973cc-eb19-4b28-b149-bb6de7d25be0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:58.136454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:58.158586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6c5f0-e503-44a3-a76a-15aec43b23c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:58.159304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6c5f0-e503-44a3-a76a-15aec43b23c7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:58.159934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6c5f0-e503-44a3-a76a-15aec43b23c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:58.160760 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6c5f0-e503-44a3-a76a-15aec43b23c7 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:58.161911 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6c5f0-e503-44a3-a76a-15aec43b23c7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:58.161911 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6c5f0-e503-44a3-a76a-15aec43b23c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:58.163266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6c5f0-e503-44a3-a76a-15aec43b23c7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:58.168690 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 532/1041] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:58.174730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6c5f0-e503-44a3-a76a-15aec43b23c7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:58.232447 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362973cc-eb19-4b28-b149-bb6de7d25be0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:58.266567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151da73-f560-4d06-877a-90165a096466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:58.267480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151da73-f560-4d06-877a-90165a096466 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:58.267763 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151da73-f560-4d06-877a-90165a096466 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:58.268071 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151da73-f560-4d06-877a-90165a096466 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:58.268820 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151da73-f560-4d06-877a-90165a096466 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:58.269127 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151da73-f560-4d06-877a-90165a096466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:58.270493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151da73-f560-4d06-877a-90165a096466 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:58.284132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 510/1042] 10.222.0.74 () {56 vars in 1115 bytes} [Thu Jul 14 10:05:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:58.284132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d35e3-eb1b-4211-8cdb-4d948e80a7f5 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:58.284132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d35e3-eb1b-4211-8cdb-4d948e80a7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:58.284132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d35e3-eb1b-4211-8cdb-4d948e80a7f5 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:58.284585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6c5f0-e503-44a3-a76a-15aec43b23c7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:58.284679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 511/1043] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:05:58.285808 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d35e3-eb1b-4211-8cdb-4d948e80a7f5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:58.313889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:58.316885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb62331-c5aa-4451-8092-ae8be31c0a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:58.317553 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb62331-c5aa-4451-8092-ae8be31c0a01 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:58.317832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb62331-c5aa-4451-8092-ae8be31c0a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:58.318101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb62331-c5aa-4451-8092-ae8be31c0a01 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:58.318798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb62331-c5aa-4451-8092-ae8be31c0a01 None admin] RBAC: Adding query filter params (type=image) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:58.319097 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb62331-c5aa-4451-8092-ae8be31c0a01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:58.320506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb62331-c5aa-4451-8092-ae8be31c0a01 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:58.325251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 533/1044] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:58.326730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99185d42-ee9d-423c-aeb6-66898de49ddb None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:58.327038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99185d42-ee9d-423c-aeb6-66898de49ddb None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:58.327311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99185d42-ee9d-423c-aeb6-66898de49ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:58.343986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-99185d42-ee9d-423c-aeb6-66898de49ddb None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:05:58.345184 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-99185d42-ee9d-423c-aeb6-66898de49ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:58.378500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:58.388626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d35e3-eb1b-4211-8cdb-4d948e80a7f5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:58.411197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 534/1045] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:05:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:05:58.412017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99185d42-ee9d-423c-aeb6-66898de49ddb None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:58.427679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf9885-83e0-40ed-976e-475a5d0a3f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:58.428737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf9885-83e0-40ed-976e-475a5d0a3f8a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:58.428859 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf9885-83e0-40ed-976e-475a5d0a3f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:58.429050 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf9885-83e0-40ed-976e-475a5d0a3f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:58.440343 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf9885-83e0-40ed-976e-475a5d0a3f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:58.441777 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf9885-83e0-40ed-976e-475a5d0a3f8a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-96bf9885-83e0-40ed-976e-475a5d0a3f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:58.458989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:58.460160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:58.461068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:58.461068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:58.461068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:58.461068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:58.461068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 512/1046] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:58.461068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf9885-83e0-40ed-976e-475a5d0a3f8a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:58.517835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99185d42-ee9d-423c-aeb6-66898de49ddb None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:58.542978 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:58.552480 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ab493-4147-46a5-a351-37f5384d6f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:58.553728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ab493-4147-46a5-a351-37f5384d6f9f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:58.553728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ab493-4147-46a5-a351-37f5384d6f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:58.553728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ab493-4147-46a5-a351-37f5384d6f9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:58.554333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ab493-4147-46a5-a351-37f5384d6f9f None admin] RBAC: Adding query filter params (interface=public, service_id=fed3f46d815641b89c5d36b34b594442, region_id=RegionOne) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:58.554643 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ab493-4147-46a5-a351-37f5384d6f9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:58.556018 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ab493-4147-46a5-a351-37f5384d6f9f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:58.561149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 535/1047] 10.222.0.74 () {56 vars in 1251 bytes} [Thu Jul 14 10:05:58 2022] GET /identity/v3/endpoints?service_id=fed3f46d815641b89c5d36b34b594442&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:58.561904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ab493-4147-46a5-a351-37f5384d6f9f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:58.564168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf9885-83e0-40ed-976e-475a5d0a3f8a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:58.596368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:58.599295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57030369-88c3-47ad-889d-01e96cb31874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:58.600113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57030369-88c3-47ad-889d-01e96cb31874 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:58.600395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57030369-88c3-47ad-889d-01e96cb31874 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:58.600663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57030369-88c3-47ad-889d-01e96cb31874 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:58.601823 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57030369-88c3-47ad-889d-01e96cb31874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:58.603248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57030369-88c3-47ad-889d-01e96cb31874 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:58.611363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 513/1048] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:58.611363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57030369-88c3-47ad-889d-01e96cb31874 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:58.664877 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ab493-4147-46a5-a351-37f5384d6f9f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:58.698218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed32f9c-8c93-4f73-ab3f-d43ed7f864f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:58.698882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed32f9c-8c93-4f73-ab3f-d43ed7f864f7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:58.699163 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed32f9c-8c93-4f73-ab3f-d43ed7f864f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:58.699437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed32f9c-8c93-4f73-ab3f-d43ed7f864f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:58.700718 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed32f9c-8c93-4f73-ab3f-d43ed7f864f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:58.701021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed32f9c-8c93-4f73-ab3f-d43ed7f864f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:58.702375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed32f9c-8c93-4f73-ab3f-d43ed7f864f7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:58.707584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57030369-88c3-47ad-889d-01e96cb31874 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:58.713785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 536/1049] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:58.714552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed32f9c-8c93-4f73-ab3f-d43ed7f864f7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:58.746558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e80d82-93b1-494e-99a2-d1418d1fad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:58.747740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e80d82-93b1-494e-99a2-d1418d1fad3f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:58.748049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e80d82-93b1-494e-99a2-d1418d1fad3f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:58.748318 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e80d82-93b1-494e-99a2-d1418d1fad3f None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:58.749055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e80d82-93b1-494e-99a2-d1418d1fad3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:58.750436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e80d82-93b1-494e-99a2-d1418d1fad3f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:58.756922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 514/1050] 10.222.0.74 () {56 vars in 1087 bytes} [Thu Jul 14 10:05:58 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:05:58.757691 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e80d82-93b1-494e-99a2-d1418d1fad3f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:58.772212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:58.822942 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:58.830621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed32f9c-8c93-4f73-ab3f-d43ed7f864f7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:58.869872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f66ba1-d5c9-422f-98a7-2ec4e2183a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:58.870696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f66ba1-d5c9-422f-98a7-2ec4e2183a88 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:58.870978 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f66ba1-d5c9-422f-98a7-2ec4e2183a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:58.871255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f66ba1-d5c9-422f-98a7-2ec4e2183a88 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:58.872038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f66ba1-d5c9-422f-98a7-2ec4e2183a88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:58.873509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f66ba1-d5c9-422f-98a7-2ec4e2183a88 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:58.874314 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e80d82-93b1-494e-99a2-d1418d1fad3f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:58.912204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7c827-be09-4248-897b-720912900780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:58.912999 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7c827-be09-4248-897b-720912900780 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:58.913275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7c827-be09-4248-897b-720912900780 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:58.913542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7c827-be09-4248-897b-720912900780 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:58.921913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7c827-be09-4248-897b-720912900780 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:58.923434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7c827-be09-4248-897b-720912900780 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-ecf7c827-be09-4248-897b-720912900780 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:05:58.937673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:58.938839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:58.940082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:58.940082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:58.940082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:05:58.940082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:05:58.940082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:05:58.940082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:05:58.940082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:05:58.940082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:05:58.940082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:05:58.940082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:05:58.940082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 515/1051] 10.222.0.74 () {56 vars in 1093 bytes} [Thu Jul 14 10:05:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:58.945015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7c827-be09-4248-897b-720912900780 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:58.992866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 537/1052] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:05:58 2022] POST /identity/v3/users => generated 285 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:05:59.018504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:59.066218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7c827-be09-4248-897b-720912900780 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:59.102694 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d23e6b-d117-4e42-b148-339465429664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:59.103387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d23e6b-d117-4e42-b148-339465429664 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:59.103681 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d23e6b-d117-4e42-b148-339465429664 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:59.104035 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d23e6b-d117-4e42-b148-339465429664 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:59.104897 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d23e6b-d117-4e42-b148-339465429664 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:59.105203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d23e6b-d117-4e42-b148-339465429664 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:59.107241 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d23e6b-d117-4e42-b148-339465429664 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:59.131479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 516/1053] 10.222.0.74 () {56 vars in 1133 bytes} [Thu Jul 14 10:05:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:59.133430 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f66ba1-d5c9-422f-98a7-2ec4e2183a88 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:59.245845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f66ba1-d5c9-422f-98a7-2ec4e2183a88 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:59.279950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c92b51-7920-40ca-8e9c-a62e9bf8c525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:59.280785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92b51-7920-40ca-8e9c-a62e9bf8c525 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:59.281066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92b51-7920-40ca-8e9c-a62e9bf8c525 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:59.281336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92b51-7920-40ca-8e9c-a62e9bf8c525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:59.292393 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c92b51-7920-40ca-8e9c-a62e9bf8c525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:59.294368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c92b51-7920-40ca-8e9c-a62e9bf8c525 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c1c92b51-7920-40ca-8e9c-a62e9bf8c525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:05:59.312139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:59.313062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:59.313968 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:05:59.313968 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:05:59.313968 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:05:59.313968 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:59.316062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 538/1054] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:05:59.319300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d23e6b-d117-4e42-b148-339465429664 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:59.420301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d23e6b-d117-4e42-b148-339465429664 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:59.447300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:59.455622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aef863-cbfb-4c0e-b22b-a7e521dddc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:59.456319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aef863-cbfb-4c0e-b22b-a7e521dddc3d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:59.456606 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aef863-cbfb-4c0e-b22b-a7e521dddc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:59.456883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aef863-cbfb-4c0e-b22b-a7e521dddc3d None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:59.457606 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aef863-cbfb-4c0e-b22b-a7e521dddc3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:59.457914 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aef863-cbfb-4c0e-b22b-a7e521dddc3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:59.459283 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aef863-cbfb-4c0e-b22b-a7e521dddc3d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:59.476038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 517/1055] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:05:59.477481 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c92b51-7920-40ca-8e9c-a62e9bf8c525 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:59.480366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:59.582244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c92b51-7920-40ca-8e9c-a62e9bf8c525 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:59.616671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1974a-6e52-40e6-a805-66b7e2b9adcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:59.617469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1974a-6e52-40e6-a805-66b7e2b9adcf None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:59.617752 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1974a-6e52-40e6-a805-66b7e2b9adcf None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:59.618028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1974a-6e52-40e6-a805-66b7e2b9adcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:59.624805 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1974a-6e52-40e6-a805-66b7e2b9adcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:59.626242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1974a-6e52-40e6-a805-66b7e2b9adcf None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-71c1974a-6e52-40e6-a805-66b7e2b9adcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:05:59.640283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:05:59.641197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:05:59.647322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:05:59.647322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:05:59.647322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:05:59.647322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:05:59.647322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:05:59.647322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:05:59.647322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:05:59.647322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:05:59.647322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 539/1056] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:05:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:05:59.647834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aef863-cbfb-4c0e-b22b-a7e521dddc3d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:59.748832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aef863-cbfb-4c0e-b22b-a7e521dddc3d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:59.782495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce460d-ec2a-4126-85f4-5bfd91cf3f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:59.783157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce460d-ec2a-4126-85f4-5bfd91cf3f69 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:59.783440 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce460d-ec2a-4126-85f4-5bfd91cf3f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:59.783716 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce460d-ec2a-4126-85f4-5bfd91cf3f69 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:59.784531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce460d-ec2a-4126-85f4-5bfd91cf3f69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:05:59.784843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce460d-ec2a-4126-85f4-5bfd91cf3f69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:59.786273 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce460d-ec2a-4126-85f4-5bfd91cf3f69 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:59.803775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 518/1057] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:05:59.805047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1974a-6e52-40e6-a805-66b7e2b9adcf None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:59.867920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:59.909283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1974a-6e52-40e6-a805-66b7e2b9adcf None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:59.944351 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217c1ec-842c-4526-9d96-f5afa6b00300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:59.945233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217c1ec-842c-4526-9d96-f5afa6b00300 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:59.945511 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217c1ec-842c-4526-9d96-f5afa6b00300 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:59.945784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217c1ec-842c-4526-9d96-f5afa6b00300 None admin] PATH_INFO: `/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/2a0626754b40449ba2346d05c5c90a35/roles/a99d4e2c5a7d4b2d947e64f622f1bb52` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:59.948122 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217c1ec-842c-4526-9d96-f5afa6b00300 None admin] RBAC: Authorizing `identity:create_grant(project_id=795b6593e7b74eeda9929aba07cbaa0e, user_id=2a0626754b40449ba2346d05c5c90a35, role_id=a99d4e2c5a7d4b2d947e64f622f1bb52)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:59.949552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217c1ec-842c-4526-9d96-f5afa6b00300 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:00.058074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 540/1058] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:05:59 2022] PUT /identity/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/2a0626754b40449ba2346d05c5c90a35/roles/a99d4e2c5a7d4b2d947e64f622f1bb52 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:06:00.812705 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1cf52-d93a-4762-ab06-261f63974fb7 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:00.813229 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1cf52-d93a-4762-ab06-261f63974fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:00.813504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1cf52-d93a-4762-ab06-261f63974fb7 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:00.814795 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 519/1059] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:00.820377 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058528-06a1-4a55-8905-fd3114caf044 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:00.820671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058528-06a1-4a55-8905-fd3114caf044 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:00.820947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058528-06a1-4a55-8905-fd3114caf044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:00.837796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-42058528-06a1-4a55-8905-fd3114caf044 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:00.839301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-42058528-06a1-4a55-8905-fd3114caf044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:00.905899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 541/1060] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:00.928948 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1cf52-d93a-4762-ab06-261f63974fb7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:00.980767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:01.033304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1cf52-d93a-4762-ab06-261f63974fb7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:01.072949 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e1339-439e-4902-a569-91690fa2506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:01.073692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e1339-439e-4902-a569-91690fa2506b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:01.073972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e1339-439e-4902-a569-91690fa2506b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:01.074247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e1339-439e-4902-a569-91690fa2506b None admin] PATH_INFO: `/v3/services/image` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:01.074901 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e1339-439e-4902-a569-91690fa2506b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:01.076300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e1339-439e-4902-a569-91690fa2506b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:01.085713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cecbb1-7587-48a9-a6c2-bf1771b4476a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:01.086011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cecbb1-7587-48a9-a6c2-bf1771b4476a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:01.086293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cecbb1-7587-48a9-a6c2-bf1771b4476a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:01.087800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 542/1061] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-077e1339-439e-4902-a569-91690fa2506b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:01.088172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:01.089157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:06:01.095746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 520/1062] 10.222.0.74 () {56 vars in 1105 bytes} [Thu Jul 14 10:06:00 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:06:01.096845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe73d6-6df2-4270-8a76-ed22175e5ff3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:01.096845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe73d6-6df2-4270-8a76-ed22175e5ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:01.096845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe73d6-6df2-4270-8a76-ed22175e5ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:01.097060 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e1339-439e-4902-a569-91690fa2506b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:01.111450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f1fe73d6-6df2-4270-8a76-ed22175e5ff3 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:01.112579 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f1fe73d6-6df2-4270-8a76-ed22175e5ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:01.164054 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:01.187032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 543/1063] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:01.209704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e1339-439e-4902-a569-91690fa2506b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:01.211154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe73d6-6df2-4270-8a76-ed22175e5ff3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:01.224524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:01.252181 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235f31d-a01f-4e75-a79b-0b9a3ce29520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:01.252855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235f31d-a01f-4e75-a79b-0b9a3ce29520 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:01.253137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235f31d-a01f-4e75-a79b-0b9a3ce29520 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:01.253437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235f31d-a01f-4e75-a79b-0b9a3ce29520 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:01.254287 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235f31d-a01f-4e75-a79b-0b9a3ce29520 None admin] RBAC: Adding query filter params (name=image) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:01.254891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235f31d-a01f-4e75-a79b-0b9a3ce29520 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:01.256577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235f31d-a01f-4e75-a79b-0b9a3ce29520 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:01.262119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 521/1064] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:06:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:01.267707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235f31d-a01f-4e75-a79b-0b9a3ce29520 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:01.322167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe73d6-6df2-4270-8a76-ed22175e5ff3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:01.357823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cf69b-f4b1-447e-ae2f-5d2ee18e6c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:01.358612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cf69b-f4b1-447e-ae2f-5d2ee18e6c7b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:01.358895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cf69b-f4b1-447e-ae2f-5d2ee18e6c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:01.359163 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cf69b-f4b1-447e-ae2f-5d2ee18e6c7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:01.368662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235f31d-a01f-4e75-a79b-0b9a3ce29520 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:01.369060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cf69b-f4b1-447e-ae2f-5d2ee18e6c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-2f3cf69b-f4b1-447e-ae2f-5d2ee18e6c7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:06:01.376641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:01.377621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:01.378538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:01.378538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:01.378538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:01.378538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:01.378538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:06:01.378538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:06:01.378538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:06:01.378538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:06:01.378538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:06:01.378538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:06:01.378538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:01.378538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:06:01.378538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 544/1065] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:06:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:06:01.383515 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cf69b-f4b1-447e-ae2f-5d2ee18e6c7b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:01.409270 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8495e0-aa0f-4c20-a4ce-b3e53052dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:01.410142 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8495e0-aa0f-4c20-a4ce-b3e53052dd72 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:01.410601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8495e0-aa0f-4c20-a4ce-b3e53052dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:01.411036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8495e0-aa0f-4c20-a4ce-b3e53052dd72 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:01.411925 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8495e0-aa0f-4c20-a4ce-b3e53052dd72 None admin] RBAC: Adding query filter params (type=image) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:01.412428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8495e0-aa0f-4c20-a4ce-b3e53052dd72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:01.413797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8495e0-aa0f-4c20-a4ce-b3e53052dd72 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:01.423330 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 522/1066] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:06:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:06:01.424340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8495e0-aa0f-4c20-a4ce-b3e53052dd72 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:01.432424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:01.468609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:01.492202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cf69b-f4b1-447e-ae2f-5d2ee18e6c7b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:01.530347 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8495e0-aa0f-4c20-a4ce-b3e53052dd72 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:01.531379 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4604ec-f080-48e6-b178-16b8555dc48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:01.532466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4604ec-f080-48e6-b178-16b8555dc48f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:01.532848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4604ec-f080-48e6-b178-16b8555dc48f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:01.533141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4604ec-f080-48e6-b178-16b8555dc48f None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:01.533892 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4604ec-f080-48e6-b178-16b8555dc48f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:01.534197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4604ec-f080-48e6-b178-16b8555dc48f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:01.535571 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4604ec-f080-48e6-b178-16b8555dc48f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:01.549981 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 545/1067] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:06:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:06:01.550803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4604ec-f080-48e6-b178-16b8555dc48f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:01.570736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35083e37-f870-4c79-be10-f050871363a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:01.571396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35083e37-f870-4c79-be10-f050871363a8 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:01.571676 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35083e37-f870-4c79-be10-f050871363a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:01.571949 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35083e37-f870-4c79-be10-f050871363a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:01.572706 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35083e37-f870-4c79-be10-f050871363a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:01.574069 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35083e37-f870-4c79-be10-f050871363a8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:01.665888 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 523/1068] 10.222.0.74 () {60 vars in 1144 bytes} [Thu Jul 14 10:06:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:06:01.695498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4604ec-f080-48e6-b178-16b8555dc48f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:01.699179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:01.741980 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598516e8-8799-486f-be30-7df0a457ecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:01.742871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598516e8-8799-486f-be30-7df0a457ecc5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:01.743149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598516e8-8799-486f-be30-7df0a457ecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:01.743417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598516e8-8799-486f-be30-7df0a457ecc5 None admin] PATH_INFO: `/v3/users/a55a5917afec412584e9157c3257583f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:01.758282 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598516e8-8799-486f-be30-7df0a457ecc5 None admin] RBAC: Authorizing `identity:get_user(user_id=a55a5917afec412584e9157c3257583f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:01.759779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598516e8-8799-486f-be30-7df0a457ecc5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:01.766370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 546/1069] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:01 2022] GET /identity/v3/users/a55a5917afec412584e9157c3257583f => generated 285 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:06:01.768065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35083e37-f870-4c79-be10-f050871363a8 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:01.871131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:01.877859 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35083e37-f870-4c79-be10-f050871363a8 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:01.914082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892fd07-2af6-4b7f-b368-42f4a37e7a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:01.914733 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892fd07-2af6-4b7f-b368-42f4a37e7a18 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:01.915013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892fd07-2af6-4b7f-b368-42f4a37e7a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:01.915286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892fd07-2af6-4b7f-b368-42f4a37e7a18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:01.984456 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892fd07-2af6-4b7f-b368-42f4a37e7a18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:01.985822 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892fd07-2af6-4b7f-b368-42f4a37e7a18 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:02.084300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:02.096061 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 524/1070] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:06:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:02.100137 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598516e8-8799-486f-be30-7df0a457ecc5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:02.102751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334450e-c12f-4428-a119-9bdef7af2b8b None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:02.103044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334450e-c12f-4428-a119-9bdef7af2b8b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:02.103323 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334450e-c12f-4428-a119-9bdef7af2b8b None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:02.104908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 525/1071] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:06:02.110134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6049-1c17-45d0-8592-c96d6843223e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:02.110424 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6049-1c17-45d0-8592-c96d6843223e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:02.110704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6049-1c17-45d0-8592-c96d6843223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:02.127815 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0e9e6049-1c17-45d0-8592-c96d6843223e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:02.129055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0e9e6049-1c17-45d0-8592-c96d6843223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:02.201497 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 526/1072] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:06:02.208563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598516e8-8799-486f-be30-7df0a457ecc5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:02.225450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e6049-1c17-45d0-8592-c96d6843223e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:02.246558 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9ff83-e3b6-4f36-a66b-c61c1b1f9324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:02.247374 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9ff83-e3b6-4f36-a66b-c61c1b1f9324 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:02.247652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9ff83-e3b6-4f36-a66b-c61c1b1f9324 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:02.247925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9ff83-e3b6-4f36-a66b-c61c1b1f9324 None admin] PATH_INFO: `/v3/projects/253f81083a844eaf9975e42fb1570f90` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:02.249126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9ff83-e3b6-4f36-a66b-c61c1b1f9324 None admin] RBAC: Authorizing `identity:get_project(project_id=253f81083a844eaf9975e42fb1570f90)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:02.250561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9ff83-e3b6-4f36-a66b-c61c1b1f9324 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:02.252293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 547/1073] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:06:02 2022] GET /identity/v3/projects/253f81083a844eaf9975e42fb1570f90 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:02.259186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9ff83-e3b6-4f36-a66b-c61c1b1f9324 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:02.288387 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:02.334617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e6049-1c17-45d0-8592-c96d6843223e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:02.363436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:02.365029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9ff83-e3b6-4f36-a66b-c61c1b1f9324 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:02.373323 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd23e71-05e9-41c3-bee1-4a84c3ff8fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:02.374149 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd23e71-05e9-41c3-bee1-4a84c3ff8fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:02.374572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd23e71-05e9-41c3-bee1-4a84c3ff8fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:02.374848 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd23e71-05e9-41c3-bee1-4a84c3ff8fd6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:02.385611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd23e71-05e9-41c3-bee1-4a84c3ff8fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-4dd23e71-05e9-41c3-bee1-4a84c3ff8fd6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:06:02.394641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:02.395601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:02.396872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:02.396872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:02.396872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:02.396872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:02.396872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:06:02.396872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:06:02.396872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:06:02.396872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:06:02.396872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:06:02.396872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:06:02.396872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:06:02.396872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:06:02.396872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 527/1074] 10.222.0.74 () {56 vars in 1120 bytes} [Thu Jul 14 10:06:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:06:02.401666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd23e71-05e9-41c3-bee1-4a84c3ff8fd6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:02.404419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2df30-dff1-417a-9f57-321c7924b6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:02.405147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2df30-dff1-417a-9f57-321c7924b6ae None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:02.405429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2df30-dff1-417a-9f57-321c7924b6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:02.405711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2df30-dff1-417a-9f57-321c7924b6ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:02.406587 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2df30-dff1-417a-9f57-321c7924b6ae None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=253f81083a844eaf9975e42fb1570f90, user.id=a55a5917afec412584e9157c3257583f) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:02.407163 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2df30-dff1-417a-9f57-321c7924b6ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:02.408635 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2df30-dff1-417a-9f57-321c7924b6ae None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:02.414521 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 548/1075] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:06:02 2022] GET /identity/v3/role_assignments?user.id=a55a5917afec412584e9157c3257583f&scope.project.id=253f81083a844eaf9975e42fb1570f90&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:06:02.522259 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd23e71-05e9-41c3-bee1-4a84c3ff8fd6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:02.560349 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f4888-f7d6-4032-a781-42913cdbe862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:02.561026 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f4888-f7d6-4032-a781-42913cdbe862 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:02.561307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f4888-f7d6-4032-a781-42913cdbe862 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:02.561580 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f4888-f7d6-4032-a781-42913cdbe862 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:02.562335 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f4888-f7d6-4032-a781-42913cdbe862 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:02.562645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f4888-f7d6-4032-a781-42913cdbe862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:02.564031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f4888-f7d6-4032-a781-42913cdbe862 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:02.573288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 528/1076] 10.222.0.74 () {56 vars in 1115 bytes} [Thu Jul 14 10:06:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:06:02.579553 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2df30-dff1-417a-9f57-321c7924b6ae None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:02.679162 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:02.689483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2df30-dff1-417a-9f57-321c7924b6ae None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:02.724108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f257f75-3af8-42f1-9718-020633754f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:02.724909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f257f75-3af8-42f1-9718-020633754f9e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:02.725198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f257f75-3af8-42f1-9718-020633754f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:02.725473 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f257f75-3af8-42f1-9718-020633754f9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:02.736024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f257f75-3af8-42f1-9718-020633754f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:02.737477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f257f75-3af8-42f1-9718-020633754f9e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-6f257f75-3af8-42f1-9718-020633754f9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:06:02.755909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:02.756886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:02.757806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:06:02.757806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:06:02.757806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:06:02.757806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:06:02.761838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 549/1077] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:06:02.763819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f4888-f7d6-4032-a781-42913cdbe862 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:02.818155 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:02.872006 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f4888-f7d6-4032-a781-42913cdbe862 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:02.906682 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38962fc-9189-4ceb-bba1-b69baede68d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:02.907599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38962fc-9189-4ceb-bba1-b69baede68d5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:02.907884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38962fc-9189-4ceb-bba1-b69baede68d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:02.908191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38962fc-9189-4ceb-bba1-b69baede68d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:02.908913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38962fc-9189-4ceb-bba1-b69baede68d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:02.909222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38962fc-9189-4ceb-bba1-b69baede68d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:02.910596 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38962fc-9189-4ceb-bba1-b69baede68d5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:02.923646 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 529/1078] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:02.928992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f257f75-3af8-42f1-9718-020633754f9e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:03.026870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f257f75-3af8-42f1-9718-020633754f9e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:03.068345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306d1ad-36b7-4bfc-b5d3-6ac53c93457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:03.069089 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306d1ad-36b7-4bfc-b5d3-6ac53c93457b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:03.069368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306d1ad-36b7-4bfc-b5d3-6ac53c93457b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:03.069638 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306d1ad-36b7-4bfc-b5d3-6ac53c93457b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:03.077553 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306d1ad-36b7-4bfc-b5d3-6ac53c93457b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:03.078996 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306d1ad-36b7-4bfc-b5d3-6ac53c93457b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-6306d1ad-36b7-4bfc-b5d3-6ac53c93457b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:06:03.093975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:03.094941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:03.095894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:03.095894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:03.095894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:06:03.095894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:06:03.095894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:06:03.095894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:06:03.095894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:06:03.095894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:06:03.095894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:06:03.095894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:06:03.099792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 550/1079] 10.222.0.74 () {56 vars in 1093 bytes} [Thu Jul 14 10:06:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:06:03.101129 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38962fc-9189-4ceb-bba1-b69baede68d5 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:03.199241 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38962fc-9189-4ceb-bba1-b69baede68d5 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:03.209015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:03.234566 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb55699-add5-4829-af4e-15f5f551f367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:03.235242 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb55699-add5-4829-af4e-15f5f551f367 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:03.235523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb55699-add5-4829-af4e-15f5f551f367 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:03.235793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb55699-add5-4829-af4e-15f5f551f367 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:03.236700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb55699-add5-4829-af4e-15f5f551f367 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:03.237010 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb55699-add5-4829-af4e-15f5f551f367 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:03.238433 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb55699-add5-4829-af4e-15f5f551f367 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:03.256971 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 530/1080] 10.222.0.74 () {56 vars in 1133 bytes} [Thu Jul 14 10:06:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:03.263113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306d1ad-36b7-4bfc-b5d3-6ac53c93457b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:03.266113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:03.363281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306d1ad-36b7-4bfc-b5d3-6ac53c93457b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:03.397682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b8025-c252-44a2-ae02-5fe8a4503933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:03.398343 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b8025-c252-44a2-ae02-5fe8a4503933 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:03.398627 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b8025-c252-44a2-ae02-5fe8a4503933 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:03.398900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b8025-c252-44a2-ae02-5fe8a4503933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:03.465961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b8025-c252-44a2-ae02-5fe8a4503933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:03.467417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b8025-c252-44a2-ae02-5fe8a4503933 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:03.469308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:03.570706 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 551/1081] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:06:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:03.577470 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb55699-add5-4829-af4e-15f5f551f367 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:03.679488 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb55699-add5-4829-af4e-15f5f551f367 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:03.709229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781095-1aaa-4541-9ba9-befe0c3a1b45 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:03.709229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781095-1aaa-4541-9ba9-befe0c3a1b45 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:03.709229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781095-1aaa-4541-9ba9-befe0c3a1b45 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:03.711548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 552/1082] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:03.714787 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15baaa-85b3-4d30-859e-86c5924822a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:03.716190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15baaa-85b3-4d30-859e-86c5924822a8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:03.716476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15baaa-85b3-4d30-859e-86c5924822a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:03.716754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15baaa-85b3-4d30-859e-86c5924822a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:03.717515 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fcbee-7a70-4414-b015-b6134b02dff3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:03.718007 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fcbee-7a70-4414-b015-b6134b02dff3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:03.718671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fcbee-7a70-4414-b015-b6134b02dff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:03.727070 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15baaa-85b3-4d30-859e-86c5924822a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:03.728558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15baaa-85b3-4d30-859e-86c5924822a8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:03.737615 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-728fcbee-7a70-4414-b015-b6134b02dff3 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:03.738998 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-728fcbee-7a70-4414-b015-b6134b02dff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-ae15baaa-85b3-4d30-859e-86c5924822a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:06:03.745998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:03.746911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:03.748455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:06:03.748455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:06:03.748455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:06:03.748455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:06:03.748455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 531/1083] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:06:03.752705 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15baaa-85b3-4d30-859e-86c5924822a8 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:03.772888 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:03.809182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 553/1084] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:03.831361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fcbee-7a70-4414-b015-b6134b02dff3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:03.861862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:03.865580 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15baaa-85b3-4d30-859e-86c5924822a8 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:03.902663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4ff53-28f6-4094-80be-fa65e33bb131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:03.904639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4ff53-28f6-4094-80be-fa65e33bb131 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:03.905112 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4ff53-28f6-4094-80be-fa65e33bb131 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:03.905383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4ff53-28f6-4094-80be-fa65e33bb131 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:03.906107 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4ff53-28f6-4094-80be-fa65e33bb131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:03.906408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4ff53-28f6-4094-80be-fa65e33bb131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:03.908036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4ff53-28f6-4094-80be-fa65e33bb131 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:03.924535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 532/1085] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:06:03.925528 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4ff53-28f6-4094-80be-fa65e33bb131 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:03.940238 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fcbee-7a70-4414-b015-b6134b02dff3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:03.977278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4816c9-1902-43dd-a1e4-e1b8583a5cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:03.977963 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4816c9-1902-43dd-a1e4-e1b8583a5cbf None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:03.978253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4816c9-1902-43dd-a1e4-e1b8583a5cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:03.978522 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4816c9-1902-43dd-a1e4-e1b8583a5cbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:04.011583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:04.035601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4ff53-28f6-4094-80be-fa65e33bb131 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:04.050063 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4816c9-1902-43dd-a1e4-e1b8583a5cbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:04.051541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4816c9-1902-43dd-a1e4-e1b8583a5cbf None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:04.079380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3687738-0792-47eb-8fce-38bffbd9c37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:04.080238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3687738-0792-47eb-8fce-38bffbd9c37a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:04.080492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3687738-0792-47eb-8fce-38bffbd9c37a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:04.080766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3687738-0792-47eb-8fce-38bffbd9c37a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:04.083579 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:04.088134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3687738-0792-47eb-8fce-38bffbd9c37a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:04.089590 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3687738-0792-47eb-8fce-38bffbd9c37a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-e3687738-0792-47eb-8fce-38bffbd9c37a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:06:04.104601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:04.105865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:04.107381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:06:04.107381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:06:04.107381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:06:04.107381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:06:04.107381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:06:04.107381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:06:04.107381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:06:04.107381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:06:04.107381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 533/1086] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:06:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:06:04.111976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3687738-0792-47eb-8fce-38bffbd9c37a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:04.164035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 554/1087] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:06:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 10:06:04.169960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4816c9-1902-43dd-a1e4-e1b8583a5cbf None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:04.226356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3687738-0792-47eb-8fce-38bffbd9c37a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:04.269306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4816c9-1902-43dd-a1e4-e1b8583a5cbf None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:04.270522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff3488-c5b7-4b30-9608-072bb1a52f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:04.271341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff3488-c5b7-4b30-9608-072bb1a52f63 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:04.272281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff3488-c5b7-4b30-9608-072bb1a52f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:04.272568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff3488-c5b7-4b30-9608-072bb1a52f63 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:04.273358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff3488-c5b7-4b30-9608-072bb1a52f63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:04.273665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff3488-c5b7-4b30-9608-072bb1a52f63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:04.275088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff3488-c5b7-4b30-9608-072bb1a52f63 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:04.282733 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:04.292436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 534/1088] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:06:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:04.294016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff3488-c5b7-4b30-9608-072bb1a52f63 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:04.306817 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:04.312267 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661cafb-554a-4b45-8a38-540c2f09caaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:04.313145 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661cafb-554a-4b45-8a38-540c2f09caaa None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:04.313437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661cafb-554a-4b45-8a38-540c2f09caaa None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:04.313713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661cafb-554a-4b45-8a38-540c2f09caaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:04.323957 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661cafb-554a-4b45-8a38-540c2f09caaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:04.325541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661cafb-554a-4b45-8a38-540c2f09caaa None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c661cafb-554a-4b45-8a38-540c2f09caaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:06:04.345330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:04.346301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:04.347276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:06:04.347276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:06:04.347276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:06:04.347276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:06:04.347276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 555/1089] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:06:04.353231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661cafb-554a-4b45-8a38-540c2f09caaa None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:04.405713 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff3488-c5b7-4b30-9608-072bb1a52f63 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:04.441905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60360d31-7202-46d0-82c9-8762518b861c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:04.442588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60360d31-7202-46d0-82c9-8762518b861c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:04.442847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60360d31-7202-46d0-82c9-8762518b861c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:04.443121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60360d31-7202-46d0-82c9-8762518b861c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:04.444221 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60360d31-7202-46d0-82c9-8762518b861c None admin] RBAC: Adding query filter params (role.id=a99d4e2c5a7d4b2d947e64f622f1bb52, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=2a0626754b40449ba2346d05c5c90a35) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:04.444353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60360d31-7202-46d0-82c9-8762518b861c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:04.445707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60360d31-7202-46d0-82c9-8762518b861c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:04.452364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 535/1090] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:06:04 2022] GET /identity/v3/role_assignments?user.id=2a0626754b40449ba2346d05c5c90a35&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=a99d4e2c5a7d4b2d947e64f622f1bb52 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:06:04.454141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314292ee-bd7d-43fd-9ab1-0b69cc574900 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:04.454141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314292ee-bd7d-43fd-9ab1-0b69cc574900 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:04.454141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314292ee-bd7d-43fd-9ab1-0b69cc574900 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:04.455584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 536/1091] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:04.460986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447c6cc-6e26-4a01-ab39-efe18f3ae1bf None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:04.461276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447c6cc-6e26-4a01-ab39-efe18f3ae1bf None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:04.461558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447c6cc-6e26-4a01-ab39-efe18f3ae1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:04.468491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661cafb-554a-4b45-8a38-540c2f09caaa None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:04.479973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1447c6cc-6e26-4a01-ab39-efe18f3ae1bf None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:04.481201 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1447c6cc-6e26-4a01-ab39-efe18f3ae1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:04.506426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a833279-3b39-4e42-87ce-39e0adfdd74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:04.507114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a833279-3b39-4e42-87ce-39e0adfdd74b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:04.507413 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a833279-3b39-4e42-87ce-39e0adfdd74b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:04.507662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a833279-3b39-4e42-87ce-39e0adfdd74b None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:04.508436 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a833279-3b39-4e42-87ce-39e0adfdd74b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:04.508739 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a833279-3b39-4e42-87ce-39e0adfdd74b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:04.510255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a833279-3b39-4e42-87ce-39e0adfdd74b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:04.532026 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 556/1092] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:06:04.549613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:04.562485 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 537/1093] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:06:04.587182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a833279-3b39-4e42-87ce-39e0adfdd74b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:04.643940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:04.704585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a833279-3b39-4e42-87ce-39e0adfdd74b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:04.743155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cd789-acb5-4cc6-8ac2-3aa4d2300d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:04.743902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cd789-acb5-4cc6-8ac2-3aa4d2300d64 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:04.744243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cd789-acb5-4cc6-8ac2-3aa4d2300d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:04.744521 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cd789-acb5-4cc6-8ac2-3aa4d2300d64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:04.757407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cd789-acb5-4cc6-8ac2-3aa4d2300d64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-5f4cd789-acb5-4cc6-8ac2-3aa4d2300d64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:06:04.765783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:04.766740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:04.767853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:04.767853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:04.767853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:04.767853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:04.767853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:06:04.767853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:06:04.767853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:06:04.767853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:06:04.767853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:06:04.767853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:06:04.767853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:04.767853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:06:04.767853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 557/1094] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:06:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:06:04.773282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447c6cc-6e26-4a01-ab39-efe18f3ae1bf None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:04.883020 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447c6cc-6e26-4a01-ab39-efe18f3ae1bf None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:04.917966 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dbae4-a33e-4873-8807-91a7cb9144c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:04.919214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dbae4-a33e-4873-8807-91a7cb9144c7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:04.919493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dbae4-a33e-4873-8807-91a7cb9144c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:04.919761 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dbae4-a33e-4873-8807-91a7cb9144c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:04.920543 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14dbae4-a33e-4873-8807-91a7cb9144c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:04.920844 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14dbae4-a33e-4873-8807-91a7cb9144c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:04.922209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14dbae4-a33e-4873-8807-91a7cb9144c7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:04.930795 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 538/1095] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:06:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:04.936836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cd789-acb5-4cc6-8ac2-3aa4d2300d64 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:05.042471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cd789-acb5-4cc6-8ac2-3aa4d2300d64 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:05.044831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:05.077280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7b5e6-c4e8-473b-a12b-32ead3eb3cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:05.078173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7b5e6-c4e8-473b-a12b-32ead3eb3cab None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:05.078458 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7b5e6-c4e8-473b-a12b-32ead3eb3cab None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:05.078735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7b5e6-c4e8-473b-a12b-32ead3eb3cab None admin] PATH_INFO: `/v3/users/a55a5917afec412584e9157c3257583f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:05.079934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7b5e6-c4e8-473b-a12b-32ead3eb3cab None admin] RBAC: Authorizing `identity:get_user(user_id=a55a5917afec412584e9157c3257583f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:05.081409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7b5e6-c4e8-473b-a12b-32ead3eb3cab None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:05.083260 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 558/1096] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:04 2022] GET /identity/v3/users/a55a5917afec412584e9157c3257583f => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:06:05.088903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dbae4-a33e-4873-8807-91a7cb9144c7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:05.149136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:05.195430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dbae4-a33e-4873-8807-91a7cb9144c7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:05.230084 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9be2c-9a0f-447c-bab8-a381b1179d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:05.231490 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9be2c-9a0f-447c-bab8-a381b1179d9e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:05.231774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9be2c-9a0f-447c-bab8-a381b1179d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:05.232076 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9be2c-9a0f-447c-bab8-a381b1179d9e None admin] PATH_INFO: `/v3/projects/253f81083a844eaf9975e42fb1570f90` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:05.233279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9be2c-9a0f-447c-bab8-a381b1179d9e None admin] RBAC: Authorizing `identity:get_project(project_id=253f81083a844eaf9975e42fb1570f90)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:05.234707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9be2c-9a0f-447c-bab8-a381b1179d9e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:05.236637 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 539/1097] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:06:05 2022] GET /identity/v3/projects/253f81083a844eaf9975e42fb1570f90 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:05.242845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7b5e6-c4e8-473b-a12b-32ead3eb3cab None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:05.344615 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7b5e6-c4e8-473b-a12b-32ead3eb3cab None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:05.378833 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd649c-f4d8-4048-b15e-a79714bcfd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:05.379726 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd649c-f4d8-4048-b15e-a79714bcfd9e None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:05.380041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd649c-f4d8-4048-b15e-a79714bcfd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:05.380302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd649c-f4d8-4048-b15e-a79714bcfd9e None admin] PATH_INFO: `/v3/projects/253f81083a844eaf9975e42fb1570f90/users/a55a5917afec412584e9157c3257583f/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:05.382233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd649c-f4d8-4048-b15e-a79714bcfd9e None admin] RBAC: Authorizing `identity:create_grant(project_id=253f81083a844eaf9975e42fb1570f90, user_id=a55a5917afec412584e9157c3257583f, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:05.383653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd649c-f4d8-4048-b15e-a79714bcfd9e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:05.448634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 559/1098] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:06:05 2022] PUT /identity/v3/projects/253f81083a844eaf9975e42fb1570f90/users/a55a5917afec412584e9157c3257583f/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:06:07.414752 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904d37-e42b-4348-9dd8-86f276d52b0d None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:07.415299 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904d37-e42b-4348-9dd8-86f276d52b0d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:07.415299 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904d37-e42b-4348-9dd8-86f276d52b0d None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:07.416767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 540/1099] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:07.421928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ff0b-9a5e-4695-898b-1f76b7542e39 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:07.422309 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ff0b-9a5e-4695-898b-1f76b7542e39 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:07.422482 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ff0b-9a5e-4695-898b-1f76b7542e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:07.438871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-bd31ff0b-9a5e-4695-898b-1f76b7542e39 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:07.440074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bd31ff0b-9a5e-4695-898b-1f76b7542e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:07.465826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:07.505048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 560/1100] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:07.528917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904d37-e42b-4348-9dd8-86f276d52b0d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:07.626514 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904d37-e42b-4348-9dd8-86f276d52b0d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:07.648099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:07.659460 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adf40f-bc6b-4003-8e2b-4438f73ae2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:07.660262 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adf40f-bc6b-4003-8e2b-4438f73ae2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:07.660542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adf40f-bc6b-4003-8e2b-4438f73ae2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:07.660809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adf40f-bc6b-4003-8e2b-4438f73ae2a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:07.672331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adf40f-bc6b-4003-8e2b-4438f73ae2a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-99adf40f-bc6b-4003-8e2b-4438f73ae2a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:06:07.680166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:07.681116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:07.682133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:07.682133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:07.682133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:07.682133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:07.682133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:06:07.682133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:06:07.682133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:06:07.682133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:06:07.682133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:06:07.682133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:06:07.682133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:07.682133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:06:07.682133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 541/1101] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:06:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:06:07.688129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31ff0b-9a5e-4695-898b-1f76b7542e39 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:07.785516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31ff0b-9a5e-4695-898b-1f76b7542e39 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:07.818675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229daa2a-3629-438c-b3dc-0ac8dcd7c7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:07.819451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229daa2a-3629-438c-b3dc-0ac8dcd7c7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:07.819731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229daa2a-3629-438c-b3dc-0ac8dcd7c7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:07.820028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229daa2a-3629-438c-b3dc-0ac8dcd7c7b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:07.820778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229daa2a-3629-438c-b3dc-0ac8dcd7c7b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:07.821087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229daa2a-3629-438c-b3dc-0ac8dcd7c7b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:07.822461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229daa2a-3629-438c-b3dc-0ac8dcd7c7b2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:07.830492 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 561/1102] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:06:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:07.836216 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adf40f-bc6b-4003-8e2b-4438f73ae2a4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:07.933913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adf40f-bc6b-4003-8e2b-4438f73ae2a4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:07.966892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afed2f-a925-4f83-8447-a869455e2dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:07.967738 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afed2f-a925-4f83-8447-a869455e2dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:07.968036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afed2f-a925-4f83-8447-a869455e2dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:07.968312 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afed2f-a925-4f83-8447-a869455e2dd9 None admin] PATH_INFO: `/v3/users/a55a5917afec412584e9157c3257583f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:07.969491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afed2f-a925-4f83-8447-a869455e2dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=a55a5917afec412584e9157c3257583f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:07.970917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afed2f-a925-4f83-8447-a869455e2dd9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:07.972558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 542/1103] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:07 2022] GET /identity/v3/users/a55a5917afec412584e9157c3257583f => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:07.978194 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229daa2a-3629-438c-b3dc-0ac8dcd7c7b2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:08.005982 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:08.079016 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229daa2a-3629-438c-b3dc-0ac8dcd7c7b2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:08.112217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdfcf4-635c-4998-b9e0-09b1fda2f9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:08.112861 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdfcf4-635c-4998-b9e0-09b1fda2f9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:08.113146 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdfcf4-635c-4998-b9e0-09b1fda2f9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:08.113425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdfcf4-635c-4998-b9e0-09b1fda2f9f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:08.178236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdfcf4-635c-4998-b9e0-09b1fda2f9f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:08.179675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdfcf4-635c-4998-b9e0-09b1fda2f9f6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:08.202796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:08.274403 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 562/1104] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:06:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:08.282076 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afed2f-a925-4f83-8447-a869455e2dd9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:08.331004 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:08.379587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afed2f-a925-4f83-8447-a869455e2dd9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:08.413319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb5f23-b1bd-40bb-8382-e2176ccbf7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:08.414148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb5f23-b1bd-40bb-8382-e2176ccbf7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:08.414424 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb5f23-b1bd-40bb-8382-e2176ccbf7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:08.414689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb5f23-b1bd-40bb-8382-e2176ccbf7c2 None admin] PATH_INFO: `/v3/projects/253f81083a844eaf9975e42fb1570f90` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:08.415885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb5f23-b1bd-40bb-8382-e2176ccbf7c2 None admin] RBAC: Authorizing `identity:get_project(project_id=253f81083a844eaf9975e42fb1570f90)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:08.417336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb5f23-b1bd-40bb-8382-e2176ccbf7c2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:08.419021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 543/1105] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:06:08 2022] GET /identity/v3/projects/253f81083a844eaf9975e42fb1570f90 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:08.424903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdfcf4-635c-4998-b9e0-09b1fda2f9f6 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:08.521155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdfcf4-635c-4998-b9e0-09b1fda2f9f6 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:08.543682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:08.553856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2152c33-a51f-4fd4-be0f-9d5117ed5f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:08.554507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2152c33-a51f-4fd4-be0f-9d5117ed5f41 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:08.558050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2152c33-a51f-4fd4-be0f-9d5117ed5f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:08.558050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2152c33-a51f-4fd4-be0f-9d5117ed5f41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:08.558050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2152c33-a51f-4fd4-be0f-9d5117ed5f41 None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=253f81083a844eaf9975e42fb1570f90, user.id=a55a5917afec412584e9157c3257583f) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:08.558050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2152c33-a51f-4fd4-be0f-9d5117ed5f41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:08.558050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2152c33-a51f-4fd4-be0f-9d5117ed5f41 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:08.563762 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 563/1106] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:06:08 2022] GET /identity/v3/role_assignments?user.id=a55a5917afec412584e9157c3257583f&scope.project.id=253f81083a844eaf9975e42fb1570f90&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:10.574419 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff051-b806-4128-a394-591418f53171 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:10.574957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff051-b806-4128-a394-591418f53171 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:10.574957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff051-b806-4128-a394-591418f53171 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:10.576379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 544/1107] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:10.581722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8099d8-b8ff-4542-9503-e3d57c5836de None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:10.582121 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8099d8-b8ff-4542-9503-e3d57c5836de None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:10.582275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8099d8-b8ff-4542-9503-e3d57c5836de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:10.598836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-bf8099d8-b8ff-4542-9503-e3d57c5836de None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:10.600034 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bf8099d8-b8ff-4542-9503-e3d57c5836de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:10.665399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 564/1108] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:10.691143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ff051-b806-4128-a394-591418f53171 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:10.794054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ff051-b806-4128-a394-591418f53171 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:10.811174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:10.827439 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1235e-2590-47a6-a754-00818ff496af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:10.828176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1235e-2590-47a6-a754-00818ff496af None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:10.828461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1235e-2590-47a6-a754-00818ff496af None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:10.828736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1235e-2590-47a6-a754-00818ff496af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:10.829911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1235e-2590-47a6-a754-00818ff496af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:10.831343 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1235e-2590-47a6-a754-00818ff496af None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:10.832990 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 545/1109] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:06:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:10.838687 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8099d8-b8ff-4542-9503-e3d57c5836de None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:10.935077 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8099d8-b8ff-4542-9503-e3d57c5836de None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:10.951502 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:10.968047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a169cad-e508-4981-80dd-5d028820f25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:10.968717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a169cad-e508-4981-80dd-5d028820f25e None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:10.969002 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a169cad-e508-4981-80dd-5d028820f25e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:10.969277 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a169cad-e508-4981-80dd-5d028820f25e None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:10.969987 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a169cad-e508-4981-80dd-5d028820f25e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:10.971416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a169cad-e508-4981-80dd-5d028820f25e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:11.048525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 565/1110] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:06:10 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:06:13.111457 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09839cac-cbfd-4a4c-b94b-9c78f1188eff None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:13.111982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09839cac-cbfd-4a4c-b94b-9c78f1188eff None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:13.111982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09839cac-cbfd-4a4c-b94b-9c78f1188eff None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:13.113422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 546/1111] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:13.118464 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dfa4e-1430-4062-9a09-be6317e7ec62 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:13.118863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dfa4e-1430-4062-9a09-be6317e7ec62 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:13.119023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dfa4e-1430-4062-9a09-be6317e7ec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:13.135538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4e5dfa4e-1430-4062-9a09-be6317e7ec62 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:13.136787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4e5dfa4e-1430-4062-9a09-be6317e7ec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:13.202475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 566/1112] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:13.226039 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09839cac-cbfd-4a4c-b94b-9c78f1188eff None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:13.327607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09839cac-cbfd-4a4c-b94b-9c78f1188eff None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:13.360995 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8e1e9-5b3b-4951-a135-bceaa443feb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:13.362109 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8e1e9-5b3b-4951-a135-bceaa443feb2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:13.362389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8e1e9-5b3b-4951-a135-bceaa443feb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:13.362663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8e1e9-5b3b-4951-a135-bceaa443feb2 None admin] PATH_INFO: `/v3/roles/282334a450b54dedb0b42d678d231caf` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:13.364151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8e1e9-5b3b-4951-a135-bceaa443feb2 None admin] RBAC: Authorizing `identity:get_role(role_id=282334a450b54dedb0b42d678d231caf)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:13.365509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8e1e9-5b3b-4951-a135-bceaa443feb2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:13.366870 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 547/1113] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:13 2022] GET /identity/v3/roles/282334a450b54dedb0b42d678d231caf => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:13.372602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dfa4e-1430-4062-9a09-be6317e7ec62 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:13.468540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dfa4e-1430-4062-9a09-be6317e7ec62 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:13.470768 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:13.500664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d66ca-0ef0-411b-b3d8-6a2530fcaaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:13.501572 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d66ca-0ef0-411b-b3d8-6a2530fcaaff None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:13.501895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d66ca-0ef0-411b-b3d8-6a2530fcaaff None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:13.502174 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d66ca-0ef0-411b-b3d8-6a2530fcaaff None admin] PATH_INFO: `/v3/users/183ef3f770b04e56b7151cce37da8cb5` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:13.516015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d66ca-0ef0-411b-b3d8-6a2530fcaaff None admin] RBAC: Authorizing `identity:get_user(user_id=183ef3f770b04e56b7151cce37da8cb5)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:13.518236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d66ca-0ef0-411b-b3d8-6a2530fcaaff None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:13.519132 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 567/1114] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:13 2022] GET /identity/v3/users/183ef3f770b04e56b7151cce37da8cb5 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:13.524878 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8e1e9-5b3b-4951-a135-bceaa443feb2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:13.579086 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:13.622273 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8e1e9-5b3b-4951-a135-bceaa443feb2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:13.655547 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4e8f8-2cc3-4935-9035-579f8db14f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:13.656465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4e8f8-2cc3-4935-9035-579f8db14f4b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:13.656754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4e8f8-2cc3-4935-9035-579f8db14f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:13.657029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4e8f8-2cc3-4935-9035-579f8db14f4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:13.722992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4e8f8-2cc3-4935-9035-579f8db14f4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:13.724475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4e8f8-2cc3-4935-9035-579f8db14f4b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:13.777667 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:13.821857 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 548/1115] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:06:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:13.828254 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d66ca-0ef0-411b-b3d8-6a2530fcaaff None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:13.925320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d66ca-0ef0-411b-b3d8-6a2530fcaaff None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:13.957407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36721726-e5ce-4682-8151-035be7b098af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:13.958251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36721726-e5ce-4682-8151-035be7b098af None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:13.958531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36721726-e5ce-4682-8151-035be7b098af None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:13.958800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36721726-e5ce-4682-8151-035be7b098af None admin] PATH_INFO: `/v3/projects/253f81083a844eaf9975e42fb1570f90` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:13.959956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36721726-e5ce-4682-8151-035be7b098af None admin] RBAC: Authorizing `identity:get_project(project_id=253f81083a844eaf9975e42fb1570f90)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:13.961413 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36721726-e5ce-4682-8151-035be7b098af None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:13.963074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 568/1116] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:06:13 2022] GET /identity/v3/projects/253f81083a844eaf9975e42fb1570f90 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:13.969608 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4e8f8-2cc3-4935-9035-579f8db14f4b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:14.067314 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4e8f8-2cc3-4935-9035-579f8db14f4b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:14.100347 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4c61a-68eb-4e41-8dbd-d56e0817cb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:14.100989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4c61a-68eb-4e41-8dbd-d56e0817cb28 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:14.101270 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4c61a-68eb-4e41-8dbd-d56e0817cb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:14.101543 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4c61a-68eb-4e41-8dbd-d56e0817cb28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:14.102362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4c61a-68eb-4e41-8dbd-d56e0817cb28 None admin] RBAC: Adding query filter params (role.id=282334a450b54dedb0b42d678d231caf, scope.project.id=253f81083a844eaf9975e42fb1570f90, user.id=183ef3f770b04e56b7151cce37da8cb5) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:14.102670 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4c61a-68eb-4e41-8dbd-d56e0817cb28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:14.104118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4c61a-68eb-4e41-8dbd-d56e0817cb28 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:14.110189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 549/1117] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:06:13 2022] GET /identity/v3/role_assignments?user.id=183ef3f770b04e56b7151cce37da8cb5&scope.project.id=253f81083a844eaf9975e42fb1570f90&role.id=282334a450b54dedb0b42d678d231caf => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:16.097971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020b19-45e8-4bc0-becd-06ca594f327a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:16.098487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020b19-45e8-4bc0-becd-06ca594f327a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:16.098591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020b19-45e8-4bc0-becd-06ca594f327a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:16.099882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 569/1118] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:16.105199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f96cca-a281-4fe3-a0b3-530eb22d9c76 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:16.105590 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f96cca-a281-4fe3-a0b3-530eb22d9c76 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:16.105744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f96cca-a281-4fe3-a0b3-530eb22d9c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:16.122470 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-56f96cca-a281-4fe3-a0b3-530eb22d9c76 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:16.123637 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-56f96cca-a281-4fe3-a0b3-530eb22d9c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:16.136851 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:16.189452 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 550/1119] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:16.211420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020b19-45e8-4bc0-becd-06ca594f327a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:16.241998 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:16.311535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020b19-45e8-4bc0-becd-06ca594f327a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:16.346465 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc983a-c49a-4e4b-8be7-acc7bcefbb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:16.347313 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc983a-c49a-4e4b-8be7-acc7bcefbb84 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:16.347598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc983a-c49a-4e4b-8be7-acc7bcefbb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:16.347874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc983a-c49a-4e4b-8be7-acc7bcefbb84 None admin] PATH_INFO: `/v3/roles/282334a450b54dedb0b42d678d231caf` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:16.349375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc983a-c49a-4e4b-8be7-acc7bcefbb84 None admin] RBAC: Authorizing `identity:get_role(role_id=282334a450b54dedb0b42d678d231caf)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:16.350741 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc983a-c49a-4e4b-8be7-acc7bcefbb84 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:16.352247 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 570/1120] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:16 2022] GET /identity/v3/roles/282334a450b54dedb0b42d678d231caf => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:16.358348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f96cca-a281-4fe3-a0b3-530eb22d9c76 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:16.452631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f96cca-a281-4fe3-a0b3-530eb22d9c76 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:16.485169 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8675cd9-582e-49cd-a06b-9f3478f3b84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:16.486016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8675cd9-582e-49cd-a06b-9f3478f3b84f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:16.486288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8675cd9-582e-49cd-a06b-9f3478f3b84f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:16.486551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8675cd9-582e-49cd-a06b-9f3478f3b84f None admin] PATH_INFO: `/v3/users/183ef3f770b04e56b7151cce37da8cb5` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:16.487710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8675cd9-582e-49cd-a06b-9f3478f3b84f None admin] RBAC: Authorizing `identity:get_user(user_id=183ef3f770b04e56b7151cce37da8cb5)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:16.489146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8675cd9-582e-49cd-a06b-9f3478f3b84f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:16.490739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 551/1121] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:16 2022] GET /identity/v3/users/183ef3f770b04e56b7151cce37da8cb5 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:16.496510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc983a-c49a-4e4b-8be7-acc7bcefbb84 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:16.588802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:16.592963 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc983a-c49a-4e4b-8be7-acc7bcefbb84 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:16.625149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd074d8-afb0-4030-9094-17e0d850e9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:16.625994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd074d8-afb0-4030-9094-17e0d850e9ab None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:16.626273 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd074d8-afb0-4030-9094-17e0d850e9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:16.626547 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd074d8-afb0-4030-9094-17e0d850e9ab None admin] PATH_INFO: `/v3/projects/253f81083a844eaf9975e42fb1570f90` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:16.627710 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd074d8-afb0-4030-9094-17e0d850e9ab None admin] RBAC: Authorizing `identity:get_project(project_id=253f81083a844eaf9975e42fb1570f90)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:16.629168 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd074d8-afb0-4030-9094-17e0d850e9ab None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:16.630844 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 571/1122] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:06:16 2022] GET /identity/v3/projects/253f81083a844eaf9975e42fb1570f90 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:16.637150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8675cd9-582e-49cd-a06b-9f3478f3b84f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:16.655320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:16.733849 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8675cd9-582e-49cd-a06b-9f3478f3b84f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:16.766784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ef498-a69e-49d0-b435-8bfa5ae4b73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:16.767658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ef498-a69e-49d0-b435-8bfa5ae4b73a None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:16.767938 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ef498-a69e-49d0-b435-8bfa5ae4b73a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:16.768237 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ef498-a69e-49d0-b435-8bfa5ae4b73a None admin] PATH_INFO: `/v3/projects/253f81083a844eaf9975e42fb1570f90/users/183ef3f770b04e56b7151cce37da8cb5/roles/282334a450b54dedb0b42d678d231caf` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:16.770414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ef498-a69e-49d0-b435-8bfa5ae4b73a None admin] RBAC: Authorizing `identity:create_grant(project_id=253f81083a844eaf9975e42fb1570f90, user_id=183ef3f770b04e56b7151cce37da8cb5, role_id=282334a450b54dedb0b42d678d231caf)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:16.771836 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ef498-a69e-49d0-b435-8bfa5ae4b73a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:16.835675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 552/1123] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:06:16 2022] PUT /identity/v3/projects/253f81083a844eaf9975e42fb1570f90/users/183ef3f770b04e56b7151cce37da8cb5/roles/282334a450b54dedb0b42d678d231caf => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:06:18.792716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd661-7bd7-46e5-a3a7-81dd56e80a0c None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:18.793268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd661-7bd7-46e5-a3a7-81dd56e80a0c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:18.793268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd661-7bd7-46e5-a3a7-81dd56e80a0c None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:18.794607 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 572/1124] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:18.799686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef577c6c-ada4-4ae1-badc-f9b9bd672eea None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:18.800089 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef577c6c-ada4-4ae1-badc-f9b9bd672eea None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:18.800269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef577c6c-ada4-4ae1-badc-f9b9bd672eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:18.816724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ef577c6c-ada4-4ae1-badc-f9b9bd672eea None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:18.817911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ef577c6c-ada4-4ae1-badc-f9b9bd672eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:18.882583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 553/1125] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:06:18.906969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edd661-7bd7-46e5-a3a7-81dd56e80a0c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:19.005350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edd661-7bd7-46e5-a3a7-81dd56e80a0c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:19.038139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f01a3-fb77-4ec2-b611-e85065b8b564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:19.038979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f01a3-fb77-4ec2-b611-e85065b8b564 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:19.039263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f01a3-fb77-4ec2-b611-e85065b8b564 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:19.039534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f01a3-fb77-4ec2-b611-e85065b8b564 None admin] PATH_INFO: `/v3/roles/282334a450b54dedb0b42d678d231caf` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:19.041006 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f01a3-fb77-4ec2-b611-e85065b8b564 None admin] RBAC: Authorizing `identity:get_role(role_id=282334a450b54dedb0b42d678d231caf)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:19.042374 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f01a3-fb77-4ec2-b611-e85065b8b564 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:19.043774 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 573/1126] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:18 2022] GET /identity/v3/roles/282334a450b54dedb0b42d678d231caf => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:19.049311 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef577c6c-ada4-4ae1-badc-f9b9bd672eea None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:19.057823 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:19.147831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef577c6c-ada4-4ae1-badc-f9b9bd672eea None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:19.179964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b4105-2a46-4608-afca-e95b823f80ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:19.180846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4105-2a46-4608-afca-e95b823f80ce None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:19.181125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4105-2a46-4608-afca-e95b823f80ce None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:19.181396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4105-2a46-4608-afca-e95b823f80ce None admin] PATH_INFO: `/v3/users/183ef3f770b04e56b7151cce37da8cb5` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:19.183074 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b4105-2a46-4608-afca-e95b823f80ce None admin] RBAC: Authorizing `identity:get_user(user_id=183ef3f770b04e56b7151cce37da8cb5)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:19.184576 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b4105-2a46-4608-afca-e95b823f80ce None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:19.186192 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 554/1127] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:19 2022] GET /identity/v3/users/183ef3f770b04e56b7151cce37da8cb5 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:19.191926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f01a3-fb77-4ec2-b611-e85065b8b564 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:19.225375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:19.289938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f01a3-fb77-4ec2-b611-e85065b8b564 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:19.323881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a543c-f235-485d-8e09-62aa4703e552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:19.324494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a543c-f235-485d-8e09-62aa4703e552 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:19.324785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a543c-f235-485d-8e09-62aa4703e552 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:19.325047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a543c-f235-485d-8e09-62aa4703e552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:19.389947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a543c-f235-485d-8e09-62aa4703e552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:19.391382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a543c-f235-485d-8e09-62aa4703e552 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:19.422821 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:19.486474 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 574/1128] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:06:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:19.492324 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b4105-2a46-4608-afca-e95b823f80ce None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:19.563820 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:19.588447 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b4105-2a46-4608-afca-e95b823f80ce None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:19.622042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80db4a5-fed8-4e08-8636-f08b27b87e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:19.622873 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80db4a5-fed8-4e08-8636-f08b27b87e39 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:19.623150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80db4a5-fed8-4e08-8636-f08b27b87e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:19.623416 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80db4a5-fed8-4e08-8636-f08b27b87e39 None admin] PATH_INFO: `/v3/projects/253f81083a844eaf9975e42fb1570f90` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:19.624598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80db4a5-fed8-4e08-8636-f08b27b87e39 None admin] RBAC: Authorizing `identity:get_project(project_id=253f81083a844eaf9975e42fb1570f90)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:19.626014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80db4a5-fed8-4e08-8636-f08b27b87e39 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:19.627683 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 555/1129] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:06:19 2022] GET /identity/v3/projects/253f81083a844eaf9975e42fb1570f90 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:19.633567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a543c-f235-485d-8e09-62aa4703e552 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:19.743779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a543c-f235-485d-8e09-62aa4703e552 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:19.784071 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873763b-dde9-4a93-b6c5-b1bf2805266c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:19.784745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873763b-dde9-4a93-b6c5-b1bf2805266c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:19.785028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873763b-dde9-4a93-b6c5-b1bf2805266c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:19.785302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873763b-dde9-4a93-b6c5-b1bf2805266c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:19.786145 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873763b-dde9-4a93-b6c5-b1bf2805266c None admin] RBAC: Adding query filter params (role.id=282334a450b54dedb0b42d678d231caf, scope.project.id=253f81083a844eaf9975e42fb1570f90, user.id=183ef3f770b04e56b7151cce37da8cb5) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:19.786457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873763b-dde9-4a93-b6c5-b1bf2805266c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:19.787903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873763b-dde9-4a93-b6c5-b1bf2805266c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:19.789821 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:19.795496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 575/1130] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:06:19 2022] GET /identity/v3/role_assignments?user.id=183ef3f770b04e56b7151cce37da8cb5&scope.project.id=253f81083a844eaf9975e42fb1570f90&role.id=282334a450b54dedb0b42d678d231caf => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:21.798740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59c0d2-dc18-4bd3-b300-9f23cc8588f6 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:21.799279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59c0d2-dc18-4bd3-b300-9f23cc8588f6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:21.799279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59c0d2-dc18-4bd3-b300-9f23cc8588f6 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:21.800686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 556/1131] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:21.805654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe61da0-c296-4ab4-bb4f-4be7df7efed9 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:21.806074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe61da0-c296-4ab4-bb4f-4be7df7efed9 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:21.806211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe61da0-c296-4ab4-bb4f-4be7df7efed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:21.822508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-dbe61da0-c296-4ab4-bb4f-4be7df7efed9 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:21.824215 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-dbe61da0-c296-4ab4-bb4f-4be7df7efed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:21.887971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 576/1132] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:21.911451 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59c0d2-dc18-4bd3-b300-9f23cc8588f6 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:22.010853 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59c0d2-dc18-4bd3-b300-9f23cc8588f6 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:22.043367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88217c-0d53-41a1-b0f9-833e78532daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:22.044165 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88217c-0d53-41a1-b0f9-833e78532daf None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:22.044445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88217c-0d53-41a1-b0f9-833e78532daf None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:22.044715 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88217c-0d53-41a1-b0f9-833e78532daf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:22.045862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88217c-0d53-41a1-b0f9-833e78532daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:22.047289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88217c-0d53-41a1-b0f9-833e78532daf None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:22.048982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 557/1133] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:06:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:06:22.054768 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe61da0-c296-4ab4-bb4f-4be7df7efed9 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:22.152447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe61da0-c296-4ab4-bb4f-4be7df7efed9 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:22.177950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:22.185951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf58e6-6bc4-4137-a91a-ba8341fb84ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:22.196574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf58e6-6bc4-4137-a91a-ba8341fb84ab None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:22.196574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf58e6-6bc4-4137-a91a-ba8341fb84ab None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:22.196574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf58e6-6bc4-4137-a91a-ba8341fb84ab None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:22.196574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf58e6-6bc4-4137-a91a-ba8341fb84ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:22.196574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf58e6-6bc4-4137-a91a-ba8341fb84ab None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:22.276392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 577/1134] 10.222.0.74 () {60 vars in 1141 bytes} [Thu Jul 14 10:06:22 2022] POST /identity/v3/projects => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:06:24.313688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4253138-f868-4ecf-ab1b-b735f14b3254 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:24.314193 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4253138-f868-4ecf-ab1b-b735f14b3254 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:24.314193 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4253138-f868-4ecf-ab1b-b735f14b3254 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:24.315538 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 558/1135] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:24.320633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c00e6-117a-44f0-a2ec-3dfad8c8b9d6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:24.321079 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c00e6-117a-44f0-a2ec-3dfad8c8b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:24.321172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c00e6-117a-44f0-a2ec-3dfad8c8b9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:24.337583 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-921c00e6-117a-44f0-a2ec-3dfad8c8b9d6 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:24.339257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-921c00e6-117a-44f0-a2ec-3dfad8c8b9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:24.403706 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 578/1136] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:24.429525 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4253138-f868-4ecf-ab1b-b735f14b3254 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:24.441578 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:24.528421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4253138-f868-4ecf-ab1b-b735f14b3254 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:24.561593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a60ef-87bd-4efc-b896-fb190b97e324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:24.562371 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a60ef-87bd-4efc-b896-fb190b97e324 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:24.562652 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a60ef-87bd-4efc-b896-fb190b97e324 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:24.562926 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a60ef-87bd-4efc-b896-fb190b97e324 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:24.564174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a60ef-87bd-4efc-b896-fb190b97e324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:24.565548 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a60ef-87bd-4efc-b896-fb190b97e324 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:24.567144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 559/1137] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:06:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:24.573440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c00e6-117a-44f0-a2ec-3dfad8c8b9d6 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:24.668265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c00e6-117a-44f0-a2ec-3dfad8c8b9d6 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:24.678379 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:24.701513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fc7f7-8383-4d45-90e2-a1be6e99de83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:24.702170 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fc7f7-8383-4d45-90e2-a1be6e99de83 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:24.702447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fc7f7-8383-4d45-90e2-a1be6e99de83 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:24.702814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fc7f7-8383-4d45-90e2-a1be6e99de83 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:24.703417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fc7f7-8383-4d45-90e2-a1be6e99de83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:24.704851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fc7f7-8383-4d45-90e2-a1be6e99de83 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:24.789846 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 579/1138] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:06:24 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:06:26.828928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b57630-7146-4c69-be38-1c15d0cb3064 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:26.829463 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b57630-7146-4c69-be38-1c15d0cb3064 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:26.829463 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b57630-7146-4c69-be38-1c15d0cb3064 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:26.830827 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 560/1139] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:26.835908 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49886f0-76a8-4169-895f-27d7c45c8b8c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:26.836341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49886f0-76a8-4169-895f-27d7c45c8b8c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:26.836476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49886f0-76a8-4169-895f-27d7c45c8b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:26.853345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c49886f0-76a8-4169-895f-27d7c45c8b8c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:26.855058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c49886f0-76a8-4169-895f-27d7c45c8b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:26.919294 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 580/1140] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:06:26.942120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b57630-7146-4c69-be38-1c15d0cb3064 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:27.020088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:27.042429 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b57630-7146-4c69-be38-1c15d0cb3064 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:27.076158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30775e8-76f8-45c8-beb4-1f753948c97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:27.076950 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30775e8-76f8-45c8-beb4-1f753948c97c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:27.077231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30775e8-76f8-45c8-beb4-1f753948c97c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:27.077505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30775e8-76f8-45c8-beb4-1f753948c97c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:27.087217 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30775e8-76f8-45c8-beb4-1f753948c97c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-f30775e8-76f8-45c8-beb4-1f753948c97c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:06:27.094677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:27.095847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:27.096855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:27.096855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:27.096855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:27.096855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:27.096855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:06:27.096855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:06:27.096855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:06:27.096855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:06:27.096855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:06:27.096855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:06:27.096855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:27.096855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:06:27.096855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 561/1141] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:06:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:06:27.101836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49886f0-76a8-4169-895f-27d7c45c8b8c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:27.192621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:27.198255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49886f0-76a8-4169-895f-27d7c45c8b8c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:27.231768 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3f23a-149e-41c9-99ce-d9312cc3e010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:27.232456 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3f23a-149e-41c9-99ce-d9312cc3e010 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:27.232741 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3f23a-149e-41c9-99ce-d9312cc3e010 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:27.233017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3f23a-149e-41c9-99ce-d9312cc3e010 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:27.233779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3f23a-149e-41c9-99ce-d9312cc3e010 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:27.234090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3f23a-149e-41c9-99ce-d9312cc3e010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:27.235452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3f23a-149e-41c9-99ce-d9312cc3e010 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:27.243254 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 581/1142] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:06:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:27.249634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30775e8-76f8-45c8-beb4-1f753948c97c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:27.346801 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30775e8-76f8-45c8-beb4-1f753948c97c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:27.379219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11bb94-75a8-4bf7-839c-3514a6f54e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:27.380101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11bb94-75a8-4bf7-839c-3514a6f54e3b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:27.380383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11bb94-75a8-4bf7-839c-3514a6f54e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:27.380654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11bb94-75a8-4bf7-839c-3514a6f54e3b None admin] PATH_INFO: `/v3/users/00d66f8fda864f238a315355bc6dc172` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:27.389234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:27.394787 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11bb94-75a8-4bf7-839c-3514a6f54e3b None admin] RBAC: Authorizing `identity:get_user(user_id=00d66f8fda864f238a315355bc6dc172)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:27.396249 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11bb94-75a8-4bf7-839c-3514a6f54e3b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:27.402627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 562/1143] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:27 2022] GET /identity/v3/users/00d66f8fda864f238a315355bc6dc172 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:27.403961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3f23a-149e-41c9-99ce-d9312cc3e010 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:27.500623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3f23a-149e-41c9-99ce-d9312cc3e010 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:27.533180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c84bf5-837b-40cc-942f-13f6bd90ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:27.533816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c84bf5-837b-40cc-942f-13f6bd90ee9e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:27.534100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c84bf5-837b-40cc-942f-13f6bd90ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:27.534376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c84bf5-837b-40cc-942f-13f6bd90ee9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:27.560427 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:27.600066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c84bf5-837b-40cc-942f-13f6bd90ee9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:27.601443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c84bf5-837b-40cc-942f-13f6bd90ee9e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:27.697913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 582/1144] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:06:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:27.703986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11bb94-75a8-4bf7-839c-3514a6f54e3b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:27.802319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11bb94-75a8-4bf7-839c-3514a6f54e3b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:27.834613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2a72a-e165-4d18-833b-e73af2ec3eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:27.835518 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2a72a-e165-4d18-833b-e73af2ec3eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:27.835794 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2a72a-e165-4d18-833b-e73af2ec3eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:27.836089 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2a72a-e165-4d18-833b-e73af2ec3eb9 None admin] PATH_INFO: `/v3/projects/26955861d64b406eb511b40d70b7158e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:27.837245 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2a72a-e165-4d18-833b-e73af2ec3eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=26955861d64b406eb511b40d70b7158e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:27.838652 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2a72a-e165-4d18-833b-e73af2ec3eb9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:27.840331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 563/1145] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:06:27 2022] GET /identity/v3/projects/26955861d64b406eb511b40d70b7158e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:27.846291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c84bf5-837b-40cc-942f-13f6bd90ee9e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:27.902860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:27.943394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c84bf5-837b-40cc-942f-13f6bd90ee9e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:27.975792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86488dd-00d4-4ae4-970f-55470ccd8edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:27.976456 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86488dd-00d4-4ae4-970f-55470ccd8edc None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:27.976735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86488dd-00d4-4ae4-970f-55470ccd8edc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:27.977004 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86488dd-00d4-4ae4-970f-55470ccd8edc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:27.977818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86488dd-00d4-4ae4-970f-55470ccd8edc None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=26955861d64b406eb511b40d70b7158e, user.id=00d66f8fda864f238a315355bc6dc172) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:27.978823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86488dd-00d4-4ae4-970f-55470ccd8edc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:27.980229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86488dd-00d4-4ae4-970f-55470ccd8edc None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:27.985463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 583/1146] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:06:27 2022] GET /identity/v3/role_assignments?user.id=00d66f8fda864f238a315355bc6dc172&scope.project.id=26955861d64b406eb511b40d70b7158e&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:29.971188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2837a5-18f6-4d77-846d-19bcfa8cc469 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:29.971747 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2837a5-18f6-4d77-846d-19bcfa8cc469 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:29.971747 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2837a5-18f6-4d77-846d-19bcfa8cc469 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:29.973151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 564/1147] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:29.978497 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0d2a0-7fd6-4746-8e3c-d029456948a7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:29.978907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0d2a0-7fd6-4746-8e3c-d029456948a7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:29.979048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0d2a0-7fd6-4746-8e3c-d029456948a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:29.995350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f7a0d2a0-7fd6-4746-8e3c-d029456948a7 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:29.996556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f7a0d2a0-7fd6-4746-8e3c-d029456948a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:30.062691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 584/1148] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:30.085072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2837a5-18f6-4d77-846d-19bcfa8cc469 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:30.146738 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:30.185037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2837a5-18f6-4d77-846d-19bcfa8cc469 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:30.218332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1d915-6ef8-4810-9ad9-db691fba9102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:30.219099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1d915-6ef8-4810-9ad9-db691fba9102 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:30.219382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1d915-6ef8-4810-9ad9-db691fba9102 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:30.219659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1d915-6ef8-4810-9ad9-db691fba9102 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:30.230288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1d915-6ef8-4810-9ad9-db691fba9102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-59f1d915-6ef8-4810-9ad9-db691fba9102 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:06:30.237811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:30.238921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:30.240133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:30.240133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:30.240133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:30.240133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:30.240133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:06:30.240133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:06:30.240133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:06:30.240133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:06:30.240133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:06:30.240133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:06:30.240133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:30.240133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:06:30.240133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 565/1149] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:06:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:06:30.245228 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0d2a0-7fd6-4746-8e3c-d029456948a7 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:30.296443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:30.340926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0d2a0-7fd6-4746-8e3c-d029456948a7 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:30.373329 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f3355-38d9-4eb7-847c-9f3e4134fc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:30.373982 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f3355-38d9-4eb7-847c-9f3e4134fc3b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:30.374259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f3355-38d9-4eb7-847c-9f3e4134fc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:30.374529 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f3355-38d9-4eb7-847c-9f3e4134fc3b None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:30.375265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f3355-38d9-4eb7-847c-9f3e4134fc3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:30.375566 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f3355-38d9-4eb7-847c-9f3e4134fc3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:30.376943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f3355-38d9-4eb7-847c-9f3e4134fc3b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:30.384784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 585/1150] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:06:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:30.390351 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1d915-6ef8-4810-9ad9-db691fba9102 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:30.487153 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1d915-6ef8-4810-9ad9-db691fba9102 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:30.510209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:30.520338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fea133-c8e8-4ea7-bc57-84af51f43ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:30.525175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fea133-c8e8-4ea7-bc57-84af51f43ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:30.525175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fea133-c8e8-4ea7-bc57-84af51f43ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:30.525175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fea133-c8e8-4ea7-bc57-84af51f43ad4 None admin] PATH_INFO: `/v3/users/00d66f8fda864f238a315355bc6dc172` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:30.525175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fea133-c8e8-4ea7-bc57-84af51f43ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=00d66f8fda864f238a315355bc6dc172)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:30.525175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fea133-c8e8-4ea7-bc57-84af51f43ad4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:30.526003 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 566/1151] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:30 2022] GET /identity/v3/users/00d66f8fda864f238a315355bc6dc172 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:30.531911 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f3355-38d9-4eb7-847c-9f3e4134fc3b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:30.628616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f3355-38d9-4eb7-847c-9f3e4134fc3b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:30.641584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:30.660966 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ea0d-9ba9-42dc-943a-ba585c149bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:30.661843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ea0d-9ba9-42dc-943a-ba585c149bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:30.662126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ea0d-9ba9-42dc-943a-ba585c149bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:30.662424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ea0d-9ba9-42dc-943a-ba585c149bd5 None admin] PATH_INFO: `/v3/projects/26955861d64b406eb511b40d70b7158e` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:30.663669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61ea0d-9ba9-42dc-943a-ba585c149bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=26955861d64b406eb511b40d70b7158e)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:30.665129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61ea0d-9ba9-42dc-943a-ba585c149bd5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:30.667337 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 586/1152] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:06:30 2022] GET /identity/v3/projects/26955861d64b406eb511b40d70b7158e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:30.673161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fea133-c8e8-4ea7-bc57-84af51f43ad4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:30.771425 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fea133-c8e8-4ea7-bc57-84af51f43ad4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:30.804447 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496f57e-f83d-4d81-84ef-51bfc15d38ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:30.805312 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496f57e-f83d-4d81-84ef-51bfc15d38ed None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:30.805591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496f57e-f83d-4d81-84ef-51bfc15d38ed None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:30.805865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496f57e-f83d-4d81-84ef-51bfc15d38ed None admin] PATH_INFO: `/v3/projects/26955861d64b406eb511b40d70b7158e/users/00d66f8fda864f238a315355bc6dc172/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:30.807800 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496f57e-f83d-4d81-84ef-51bfc15d38ed None admin] RBAC: Authorizing `identity:create_grant(project_id=26955861d64b406eb511b40d70b7158e, user_id=00d66f8fda864f238a315355bc6dc172, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:30.809242 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496f57e-f83d-4d81-84ef-51bfc15d38ed None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:30.891243 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 567/1153] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:06:30 2022] PUT /identity/v3/projects/26955861d64b406eb511b40d70b7158e/users/00d66f8fda864f238a315355bc6dc172/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:06:32.868202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaca16-763b-4244-a15a-47a09e7ff723 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:32.868778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaca16-763b-4244-a15a-47a09e7ff723 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:32.868778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaca16-763b-4244-a15a-47a09e7ff723 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:32.870104 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 587/1154] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:32.875277 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb3c2b-d1be-4128-9eef-98aea2cdfaa5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:32.875658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb3c2b-d1be-4128-9eef-98aea2cdfaa5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:32.875834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb3c2b-d1be-4128-9eef-98aea2cdfaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:32.892701 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-01fb3c2b-d1be-4128-9eef-98aea2cdfaa5 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:32.893878 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-01fb3c2b-d1be-4128-9eef-98aea2cdfaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:32.938919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:32.958125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 568/1155] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:32.982137 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaca16-763b-4244-a15a-47a09e7ff723 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:33.083052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaca16-763b-4244-a15a-47a09e7ff723 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:33.116010 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a57a3-bcde-4d2c-a4a7-9957179fed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:33.116808 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a57a3-bcde-4d2c-a4a7-9957179fed5d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:33.117090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a57a3-bcde-4d2c-a4a7-9957179fed5d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:33.117362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a57a3-bcde-4d2c-a4a7-9957179fed5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:33.128367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a57a3-bcde-4d2c-a4a7-9957179fed5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c77a57a3-bcde-4d2c-a4a7-9957179fed5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:06:33.135879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:33.137114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:33.138185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:33.138185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:33.138185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:33.138185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:33.138185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:06:33.138185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:06:33.138185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:06:33.138185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:06:33.138185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:06:33.138185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:06:33.138185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:33.138185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:06:33.138185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 588/1156] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:06:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:06:33.143205 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb3c2b-d1be-4128-9eef-98aea2cdfaa5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:33.238733 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb3c2b-d1be-4128-9eef-98aea2cdfaa5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:33.272717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b116f37-6b12-4804-b564-42d79e51fb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:33.273371 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b116f37-6b12-4804-b564-42d79e51fb34 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:33.273651 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b116f37-6b12-4804-b564-42d79e51fb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:33.273924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b116f37-6b12-4804-b564-42d79e51fb34 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:33.274728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b116f37-6b12-4804-b564-42d79e51fb34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:33.275029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b116f37-6b12-4804-b564-42d79e51fb34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:33.276421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b116f37-6b12-4804-b564-42d79e51fb34 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:33.284522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 569/1157] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:06:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:33.290092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a57a3-bcde-4d2c-a4a7-9957179fed5d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:33.336850 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:33.396705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a57a3-bcde-4d2c-a4a7-9957179fed5d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:33.433747 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0af802-5825-40a7-a9da-63759dbd4c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:33.434588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0af802-5825-40a7-a9da-63759dbd4c0b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:33.434867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0af802-5825-40a7-a9da-63759dbd4c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:33.435138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0af802-5825-40a7-a9da-63759dbd4c0b None admin] PATH_INFO: `/v3/users/00d66f8fda864f238a315355bc6dc172` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:33.436431 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0af802-5825-40a7-a9da-63759dbd4c0b None admin] RBAC: Authorizing `identity:get_user(user_id=00d66f8fda864f238a315355bc6dc172)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:33.437865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0af802-5825-40a7-a9da-63759dbd4c0b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:33.439476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 589/1158] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:33 2022] GET /identity/v3/users/00d66f8fda864f238a315355bc6dc172 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:33.445187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b116f37-6b12-4804-b564-42d79e51fb34 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:33.489720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:33.542688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b116f37-6b12-4804-b564-42d79e51fb34 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:33.575635 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ab869-b1a6-467e-8ae2-841c3a3f87ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:33.576303 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab869-b1a6-467e-8ae2-841c3a3f87ed None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:33.576590 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab869-b1a6-467e-8ae2-841c3a3f87ed None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:33.576865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab869-b1a6-467e-8ae2-841c3a3f87ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:33.641473 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ab869-b1a6-467e-8ae2-841c3a3f87ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:33.642916 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ab869-b1a6-467e-8ae2-841c3a3f87ed None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:33.686186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:33.738612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 570/1159] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:06:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:33.745050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0af802-5825-40a7-a9da-63759dbd4c0b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:33.841663 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0af802-5825-40a7-a9da-63759dbd4c0b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:33.851974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:33.875314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e274-1088-4184-af9c-ac685dc507bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:33.876198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e274-1088-4184-af9c-ac685dc507bd None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:33.877849 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e274-1088-4184-af9c-ac685dc507bd None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:33.877849 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e274-1088-4184-af9c-ac685dc507bd None admin] PATH_INFO: `/v3/projects/26955861d64b406eb511b40d70b7158e` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:33.878157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792e274-1088-4184-af9c-ac685dc507bd None admin] RBAC: Authorizing `identity:get_project(project_id=26955861d64b406eb511b40d70b7158e)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:33.879326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792e274-1088-4184-af9c-ac685dc507bd None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:33.881027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 590/1160] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:06:33 2022] GET /identity/v3/projects/26955861d64b406eb511b40d70b7158e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:06:33.887542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ab869-b1a6-467e-8ae2-841c3a3f87ed None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:33.988649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ab869-b1a6-467e-8ae2-841c3a3f87ed None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:34.021897 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edb437-e74e-4b66-a39a-f95363638e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:34.022539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edb437-e74e-4b66-a39a-f95363638e02 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:34.022822 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edb437-e74e-4b66-a39a-f95363638e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:34.023096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edb437-e74e-4b66-a39a-f95363638e02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:34.023920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edb437-e74e-4b66-a39a-f95363638e02 None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=26955861d64b406eb511b40d70b7158e, user.id=00d66f8fda864f238a315355bc6dc172) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:34.024294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edb437-e74e-4b66-a39a-f95363638e02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:34.025714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edb437-e74e-4b66-a39a-f95363638e02 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:34.031678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 571/1161] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:06:33 2022] GET /identity/v3/role_assignments?user.id=00d66f8fda864f238a315355bc6dc172&scope.project.id=26955861d64b406eb511b40d70b7158e&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:36.047492 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf720e0-282c-4d23-bd37-f7553d387747 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:36.048069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf720e0-282c-4d23-bd37-f7553d387747 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:36.048069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf720e0-282c-4d23-bd37-f7553d387747 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:36.049432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 591/1162] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:36.054758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f03b0-fd28-4ce4-81d5-f1b780bd63a5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:36.055164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f03b0-fd28-4ce4-81d5-f1b780bd63a5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:36.055325 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f03b0-fd28-4ce4-81d5-f1b780bd63a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:36.072501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-195f03b0-fd28-4ce4-81d5-f1b780bd63a5 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:36.073695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-195f03b0-fd28-4ce4-81d5-f1b780bd63a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:36.075590 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:36.138699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 572/1163] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:36.160998 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf720e0-282c-4d23-bd37-f7553d387747 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:36.259959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf720e0-282c-4d23-bd37-f7553d387747 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:36.293594 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de628c9-38b0-461f-a374-4bf9025f9d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:36.294233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de628c9-38b0-461f-a374-4bf9025f9d33 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:36.294518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de628c9-38b0-461f-a374-4bf9025f9d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:36.294793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de628c9-38b0-461f-a374-4bf9025f9d33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:36.338652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:36.359818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de628c9-38b0-461f-a374-4bf9025f9d33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:36.361285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de628c9-38b0-461f-a374-4bf9025f9d33 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:36.456696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 592/1164] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:06:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:36.462645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f03b0-fd28-4ce4-81d5-f1b780bd63a5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:36.559574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f03b0-fd28-4ce4-81d5-f1b780bd63a5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:36.592468 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65e55c-2779-4f0a-9129-33ebddbfc151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:36.593199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65e55c-2779-4f0a-9129-33ebddbfc151 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:36.593498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65e55c-2779-4f0a-9129-33ebddbfc151 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:36.593775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65e55c-2779-4f0a-9129-33ebddbfc151 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:36.600326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65e55c-2779-4f0a-9129-33ebddbfc151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:36.601773 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65e55c-2779-4f0a-9129-33ebddbfc151 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:36.604029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3a65e55c-2779-4f0a-9129-33ebddbfc151 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:36.618504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:36.619772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:06:36.620893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 573/1165] 10.222.0.74 () {56 vars in 1117 bytes} [Thu Jul 14 10:06:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:06:36.625585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de628c9-38b0-461f-a374-4bf9025f9d33 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:36.700267 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:36.720437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de628c9-38b0-461f-a374-4bf9025f9d33 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:36.753979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1868a-5ca1-42b4-89f6-6ae57af29a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:36.754632 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1868a-5ca1-42b4-89f6-6ae57af29a27 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:36.754912 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1868a-5ca1-42b4-89f6-6ae57af29a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:36.755190 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1868a-5ca1-42b4-89f6-6ae57af29a27 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:36.755902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1868a-5ca1-42b4-89f6-6ae57af29a27 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:36.756235 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1868a-5ca1-42b4-89f6-6ae57af29a27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:36.757588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1868a-5ca1-42b4-89f6-6ae57af29a27 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:36.764566 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 593/1166] 10.222.0.74 () {56 vars in 1115 bytes} [Thu Jul 14 10:06:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:38.741873 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e5c0a-8896-4cac-b390-219e118fadf3 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:38.742919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e5c0a-8896-4cac-b390-219e118fadf3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:38.742919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e5c0a-8896-4cac-b390-219e118fadf3 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:38.744332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 574/1167] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:06:38.749377 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac262b2-f1f8-447c-8d8e-519ad0a5ae26 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:38.749752 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac262b2-f1f8-447c-8d8e-519ad0a5ae26 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:38.749928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac262b2-f1f8-447c-8d8e-519ad0a5ae26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:38.766773 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3ac262b2-f1f8-447c-8d8e-519ad0a5ae26 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:38.767946 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3ac262b2-f1f8-447c-8d8e-519ad0a5ae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:38.831679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 594/1168] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:38.854951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e5c0a-8896-4cac-b390-219e118fadf3 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:38.953408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e5c0a-8896-4cac-b390-219e118fadf3 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:38.985813 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f6c0d-4317-42a8-879a-f02c070e4fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:38.986454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f6c0d-4317-42a8-879a-f02c070e4fdc None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:38.986736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f6c0d-4317-42a8-879a-f02c070e4fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:38.987007 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f6c0d-4317-42a8-879a-f02c070e4fdc None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:38.987739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f6c0d-4317-42a8-879a-f02c070e4fdc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:38.989130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f6c0d-4317-42a8-879a-f02c070e4fdc None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:39.120983 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 575/1169] 10.222.0.74 () {60 vars in 1138 bytes} [Thu Jul 14 10:06:38 2022] POST /identity/v3/domains => generated 267 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:06:41.150686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4937ba-1f60-4752-9f82-b89143f1855e None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:41.151179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4937ba-1f60-4752-9f82-b89143f1855e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:41.151269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4937ba-1f60-4752-9f82-b89143f1855e None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:41.152637 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 595/1170] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:06:41.158049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289953-a203-484f-8c4e-e8857b0dfa2b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:41.158479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289953-a203-484f-8c4e-e8857b0dfa2b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:41.158620 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289953-a203-484f-8c4e-e8857b0dfa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:41.174911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-83289953-a203-484f-8c4e-e8857b0dfa2b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:41.176104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-83289953-a203-484f-8c4e-e8857b0dfa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:41.227054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:41.240053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 576/1171] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:41.264042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4937ba-1f60-4752-9f82-b89143f1855e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:41.334423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:41.363465 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4937ba-1f60-4752-9f82-b89143f1855e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:41.397070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f95836-dcfd-4cdf-aeff-c4b5491018cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:41.397925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f95836-dcfd-4cdf-aeff-c4b5491018cf None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:41.398208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f95836-dcfd-4cdf-aeff-c4b5491018cf None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:41.399038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f95836-dcfd-4cdf-aeff-c4b5491018cf None admin] PATH_INFO: `/v3/domains/ba7ca6b3aeff4b01a3766de047696b1a` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:41.409428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f95836-dcfd-4cdf-aeff-c4b5491018cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=ba7ca6b3aeff4b01a3766de047696b1a)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:41.410863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f95836-dcfd-4cdf-aeff-c4b5491018cf None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:41.412517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 596/1172] 10.222.0.74 () {56 vars in 1183 bytes} [Thu Jul 14 10:06:41 2022] GET /identity/v3/domains/ba7ca6b3aeff4b01a3766de047696b1a => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:41.418894 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83289953-a203-484f-8c4e-e8857b0dfa2b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:41.513545 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83289953-a203-484f-8c4e-e8857b0dfa2b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:41.546831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1fffe-7632-4d74-905e-f7fec1cfeda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:41.547482 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1fffe-7632-4d74-905e-f7fec1cfeda8 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:41.547764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1fffe-7632-4d74-905e-f7fec1cfeda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:41.548066 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1fffe-7632-4d74-905e-f7fec1cfeda8 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:41.548778 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1fffe-7632-4d74-905e-f7fec1cfeda8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:41.550204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1fffe-7632-4d74-905e-f7fec1cfeda8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:41.645785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 577/1173] 10.222.0.74 () {60 vars in 1141 bytes} [Thu Jul 14 10:06:41 2022] POST /identity/v3/projects => generated 361 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:06:43.686162 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58577-68b1-4719-ac5d-cd1287ed4f7c None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:43.686757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58577-68b1-4719-ac5d-cd1287ed4f7c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:43.686757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58577-68b1-4719-ac5d-cd1287ed4f7c None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:43.688101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 597/1174] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:43.693279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4874142-c1d8-4d16-9a17-e693a73f80f0 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:43.693724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4874142-c1d8-4d16-9a17-e693a73f80f0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:43.693852 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4874142-c1d8-4d16-9a17-e693a73f80f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:43.710271 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a4874142-c1d8-4d16-9a17-e693a73f80f0 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:43.711966 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a4874142-c1d8-4d16-9a17-e693a73f80f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:43.746150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:43.777664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 578/1175] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:43.802493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf58577-68b1-4719-ac5d-cd1287ed4f7c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:43.901728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf58577-68b1-4719-ac5d-cd1287ed4f7c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:43.929852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:43.934552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c616a-c4db-440e-a354-a0ac890d36c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:43.935405 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c616a-c4db-440e-a354-a0ac890d36c7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:43.935688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c616a-c4db-440e-a354-a0ac890d36c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:43.935963 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c616a-c4db-440e-a354-a0ac890d36c7 None admin] PATH_INFO: `/v3/domains/ba7ca6b3aeff4b01a3766de047696b1a` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:43.943419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c616a-c4db-440e-a354-a0ac890d36c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ba7ca6b3aeff4b01a3766de047696b1a)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:43.943419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c616a-c4db-440e-a354-a0ac890d36c7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:43.943419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 598/1176] 10.222.0.74 () {56 vars in 1183 bytes} [Thu Jul 14 10:06:43 2022] GET /identity/v3/domains/ba7ca6b3aeff4b01a3766de047696b1a => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:43.946415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4874142-c1d8-4d16-9a17-e693a73f80f0 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:44.042366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4874142-c1d8-4d16-9a17-e693a73f80f0 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:44.077145 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f88d9-f1a1-433a-8ee6-979b145a59c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:44.077805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f88d9-f1a1-433a-8ee6-979b145a59c4 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:44.078082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f88d9-f1a1-433a-8ee6-979b145a59c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:44.078350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f88d9-f1a1-433a-8ee6-979b145a59c4 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:44.079040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f88d9-f1a1-433a-8ee6-979b145a59c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:44.080490 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f88d9-f1a1-433a-8ee6-979b145a59c4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:44.147266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 579/1177] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:06:43 2022] POST /identity/v3/users => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:06:46.189164 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ba788-de5d-4c2b-bbcb-e70461d894bc None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:46.189705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ba788-de5d-4c2b-bbcb-e70461d894bc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:46.189705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ba788-de5d-4c2b-bbcb-e70461d894bc None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:46.191070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 599/1178] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:46.196155 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c7903-e813-47aa-a972-68d7bc2dd078 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:46.196570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c7903-e813-47aa-a972-68d7bc2dd078 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:46.196713 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c7903-e813-47aa-a972-68d7bc2dd078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:46.213507 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f97c7903-e813-47aa-a972-68d7bc2dd078 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:46.214686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f97c7903-e813-47aa-a972-68d7bc2dd078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:46.234675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:46.279879 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 580/1179] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:46.303700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ba788-de5d-4c2b-bbcb-e70461d894bc None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:46.403522 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ba788-de5d-4c2b-bbcb-e70461d894bc None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:46.435501 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc11a0-fb6a-465e-ae5c-a1f3f91d1178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:46.436315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc11a0-fb6a-465e-ae5c-a1f3f91d1178 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:46.436602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc11a0-fb6a-465e-ae5c-a1f3f91d1178 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:46.436879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc11a0-fb6a-465e-ae5c-a1f3f91d1178 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:46.447722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc11a0-fb6a-465e-ae5c-a1f3f91d1178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-85fc11a0-fb6a-465e-ae5c-a1f3f91d1178 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:06:46.455355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:46.456559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:46.457769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:46.457769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:46.457769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:46.457769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:46.457769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:06:46.457769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:06:46.457769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:06:46.457769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:06:46.457769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:06:46.457769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:06:46.457769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:46.457769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:06:46.457769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 600/1180] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:06:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:06:46.463011 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c7903-e813-47aa-a972-68d7bc2dd078 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:46.557407 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c7903-e813-47aa-a972-68d7bc2dd078 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:46.590462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177fe94-323b-4454-b5fa-3771b0028c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:46.594872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177fe94-323b-4454-b5fa-3771b0028c58 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:46.594872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177fe94-323b-4454-b5fa-3771b0028c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:46.594872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177fe94-323b-4454-b5fa-3771b0028c58 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:46.594872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177fe94-323b-4454-b5fa-3771b0028c58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:46.594872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177fe94-323b-4454-b5fa-3771b0028c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:46.594872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177fe94-323b-4454-b5fa-3771b0028c58 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:46.602115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 581/1181] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:06:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:46.607713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc11a0-fb6a-465e-ae5c-a1f3f91d1178 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:46.669250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:46.704048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc11a0-fb6a-465e-ae5c-a1f3f91d1178 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:46.737059 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ec31-3d1e-42ea-b448-675e28b63622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:46.737913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ec31-3d1e-42ea-b448-675e28b63622 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:46.738193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ec31-3d1e-42ea-b448-675e28b63622 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:46.738464 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ec31-3d1e-42ea-b448-675e28b63622 None admin] PATH_INFO: `/v3/users/7a9da8cccfaf4716a8e5d74e2234c08e` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:46.751463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378ec31-3d1e-42ea-b448-675e28b63622 None admin] RBAC: Authorizing `identity:get_user(user_id=7a9da8cccfaf4716a8e5d74e2234c08e)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:46.752917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378ec31-3d1e-42ea-b448-675e28b63622 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:46.754570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 601/1182] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:46 2022] GET /identity/v3/users/7a9da8cccfaf4716a8e5d74e2234c08e => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:46.760852 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177fe94-323b-4454-b5fa-3771b0028c58 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:46.780392 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:46.858985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177fe94-323b-4454-b5fa-3771b0028c58 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:46.890741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fb633-1cb7-4717-a739-715f1b9467f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:46.891361 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fb633-1cb7-4717-a739-715f1b9467f0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:46.891644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fb633-1cb7-4717-a739-715f1b9467f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:46.891917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fb633-1cb7-4717-a739-715f1b9467f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:46.956634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fb633-1cb7-4717-a739-715f1b9467f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:46.958007 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fb633-1cb7-4717-a739-715f1b9467f0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:46.975163 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:47.053561 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 582/1183] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:06:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:47.059411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ec31-3d1e-42ea-b448-675e28b63622 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:47.156014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ec31-3d1e-42ea-b448-675e28b63622 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:47.172336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:47.188259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eb2f8-2c66-48fc-af00-98eb6045cc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:47.198471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb2f8-2c66-48fc-af00-98eb6045cc9a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:47.198471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb2f8-2c66-48fc-af00-98eb6045cc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:47.198471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb2f8-2c66-48fc-af00-98eb6045cc9a None admin] PATH_INFO: `/v3/projects/5b5c0b2221d94bfd8174f87e1a99b5d0` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:47.198471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250eb2f8-2c66-48fc-af00-98eb6045cc9a None admin] RBAC: Authorizing `identity:get_project(project_id=5b5c0b2221d94bfd8174f87e1a99b5d0)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:47.198471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250eb2f8-2c66-48fc-af00-98eb6045cc9a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:47.198471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 602/1184] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:06:47 2022] GET /identity/v3/projects/5b5c0b2221d94bfd8174f87e1a99b5d0 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:47.200723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fb633-1cb7-4717-a739-715f1b9467f0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:47.300956 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fb633-1cb7-4717-a739-715f1b9467f0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:47.318010 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:47.334107 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270bf6c-d48f-461c-aad9-562ad4129da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:47.344886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270bf6c-d48f-461c-aad9-562ad4129da9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:47.344886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270bf6c-d48f-461c-aad9-562ad4129da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:47.344886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270bf6c-d48f-461c-aad9-562ad4129da9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:47.344886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270bf6c-d48f-461c-aad9-562ad4129da9 None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=5b5c0b2221d94bfd8174f87e1a99b5d0, user.id=7a9da8cccfaf4716a8e5d74e2234c08e) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:47.344886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270bf6c-d48f-461c-aad9-562ad4129da9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:47.344886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270bf6c-d48f-461c-aad9-562ad4129da9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:47.345366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 583/1185] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:06:47 2022] GET /identity/v3/role_assignments?user.id=7a9da8cccfaf4716a8e5d74e2234c08e&scope.project.id=5b5c0b2221d94bfd8174f87e1a99b5d0&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:49.329704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d4262-1b64-4dd8-b52a-593eb4469d83 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:49.330213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d4262-1b64-4dd8-b52a-593eb4469d83 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:49.330213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d4262-1b64-4dd8-b52a-593eb4469d83 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:49.331524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 603/1186] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:49.336844 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c64c3-076b-4a7f-be87-29c6fbc0a0fe None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:49.337266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c64c3-076b-4a7f-be87-29c6fbc0a0fe None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:49.337384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c64c3-076b-4a7f-be87-29c6fbc0a0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:49.354047 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0f6c64c3-076b-4a7f-be87-29c6fbc0a0fe None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:49.355211 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0f6c64c3-076b-4a7f-be87-29c6fbc0a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:49.419863 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 584/1187] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:06:49.442320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d4262-1b64-4dd8-b52a-593eb4469d83 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:49.541210 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d4262-1b64-4dd8-b52a-593eb4469d83 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:49.573822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a226527-e9b0-4bda-981c-e13c44225284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:49.574593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a226527-e9b0-4bda-981c-e13c44225284 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:49.574870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a226527-e9b0-4bda-981c-e13c44225284 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:49.575138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a226527-e9b0-4bda-981c-e13c44225284 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:49.584882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a226527-e9b0-4bda-981c-e13c44225284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-3a226527-e9b0-4bda-981c-e13c44225284 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:06:49.592407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:49.593523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:49.594423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:49.594423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:49.594423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:49.594423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:49.594423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:06:49.594423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:06:49.594423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:06:49.594423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:06:49.594423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:06:49.594423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:06:49.594423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:49.594423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:06:49.594423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 604/1188] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:06:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:06:49.599643 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c64c3-076b-4a7f-be87-29c6fbc0a0fe None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:49.695740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c64c3-076b-4a7f-be87-29c6fbc0a0fe None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:49.708163 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:49.729126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c658e9-eb8e-447f-80bd-02816bfc529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:49.731579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c658e9-eb8e-447f-80bd-02816bfc529b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:49.731579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c658e9-eb8e-447f-80bd-02816bfc529b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:49.731579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c658e9-eb8e-447f-80bd-02816bfc529b None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:49.731579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c658e9-eb8e-447f-80bd-02816bfc529b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:49.731579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c658e9-eb8e-447f-80bd-02816bfc529b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:49.732965 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c658e9-eb8e-447f-80bd-02816bfc529b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:49.740946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 585/1189] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:06:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:49.746576 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a226527-e9b0-4bda-981c-e13c44225284 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:49.792459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:49.843511 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a226527-e9b0-4bda-981c-e13c44225284 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:49.875880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986306b-d12f-4b5f-9688-d2f9788d5b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:49.876755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986306b-d12f-4b5f-9688-d2f9788d5b80 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:49.877035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986306b-d12f-4b5f-9688-d2f9788d5b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:49.877305 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986306b-d12f-4b5f-9688-d2f9788d5b80 None admin] PATH_INFO: `/v3/users/7a9da8cccfaf4716a8e5d74e2234c08e` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:49.878458 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986306b-d12f-4b5f-9688-d2f9788d5b80 None admin] RBAC: Authorizing `identity:get_user(user_id=7a9da8cccfaf4716a8e5d74e2234c08e)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:49.879935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986306b-d12f-4b5f-9688-d2f9788d5b80 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:49.881541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 605/1190] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:49 2022] GET /identity/v3/users/7a9da8cccfaf4716a8e5d74e2234c08e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:49.887219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c658e9-eb8e-447f-80bd-02816bfc529b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:49.984591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c658e9-eb8e-447f-80bd-02816bfc529b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:50.017278 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b57269-68ca-44fe-bf15-69ddfd18fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:50.018122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b57269-68ca-44fe-bf15-69ddfd18fe7b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:50.018407 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b57269-68ca-44fe-bf15-69ddfd18fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:50.018682 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b57269-68ca-44fe-bf15-69ddfd18fe7b None admin] PATH_INFO: `/v3/projects/5b5c0b2221d94bfd8174f87e1a99b5d0` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:50.019849 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b57269-68ca-44fe-bf15-69ddfd18fe7b None admin] RBAC: Authorizing `identity:get_project(project_id=5b5c0b2221d94bfd8174f87e1a99b5d0)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:50.021287 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b57269-68ca-44fe-bf15-69ddfd18fe7b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:50.022962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 586/1191] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:06:49 2022] GET /identity/v3/projects/5b5c0b2221d94bfd8174f87e1a99b5d0 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:50.029245 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986306b-d12f-4b5f-9688-d2f9788d5b80 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:50.128822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986306b-d12f-4b5f-9688-d2f9788d5b80 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:50.141773 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:50.161233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c918697-abb8-4835-b2cd-67f4852cdff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:50.162170 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c918697-abb8-4835-b2cd-67f4852cdff5 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:50.162448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c918697-abb8-4835-b2cd-67f4852cdff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:50.162720 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c918697-abb8-4835-b2cd-67f4852cdff5 None admin] PATH_INFO: `/v3/projects/5b5c0b2221d94bfd8174f87e1a99b5d0/users/7a9da8cccfaf4716a8e5d74e2234c08e/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:50.165314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c918697-abb8-4835-b2cd-67f4852cdff5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b5c0b2221d94bfd8174f87e1a99b5d0, user_id=7a9da8cccfaf4716a8e5d74e2234c08e, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:50.166725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c918697-abb8-4835-b2cd-67f4852cdff5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:50.220414 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 606/1192] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:06:50 2022] PUT /identity/v3/projects/5b5c0b2221d94bfd8174f87e1a99b5d0/users/7a9da8cccfaf4716a8e5d74e2234c08e/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:06:52.210439 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f91b3-ab0b-4d76-af13-bda736e47d2f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:52.210952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f91b3-ab0b-4d76-af13-bda736e47d2f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:52.211065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f91b3-ab0b-4d76-af13-bda736e47d2f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:52.212403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 587/1193] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:06:52.217631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799a7c5-86af-4f46-ac8d-8a7e2e10c535 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:52.218045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799a7c5-86af-4f46-ac8d-8a7e2e10c535 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:52.218192 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799a7c5-86af-4f46-ac8d-8a7e2e10c535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:52.234609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8799a7c5-86af-4f46-ac8d-8a7e2e10c535 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:06:52.235791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8799a7c5-86af-4f46-ac8d-8a7e2e10c535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:06:52.300818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 607/1194] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:06:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:06:52.324843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f91b3-ab0b-4d76-af13-bda736e47d2f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:52.368743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:52.425075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f91b3-ab0b-4d76-af13-bda736e47d2f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:52.457459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97d02c-ed2e-43f0-88b1-e84c9b00fb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:52.458242 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d02c-ed2e-43f0-88b1-e84c9b00fb8c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:52.458527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d02c-ed2e-43f0-88b1-e84c9b00fb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:52.458800 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d02c-ed2e-43f0-88b1-e84c9b00fb8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:52.468554 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97d02c-ed2e-43f0-88b1-e84c9b00fb8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-1b97d02c-ed2e-43f0-88b1-e84c9b00fb8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:06:52.476657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:06:52.477754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:06:52.478675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:06:52.478675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:06:52.478675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:06:52.478675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:06:52.478675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:06:52.478675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:06:52.478675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:06:52.478675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:06:52.478675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:06:52.478675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:06:52.478675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:06:52.478675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:06:52.478675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 588/1195] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:06:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:06:52.483770 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799a7c5-86af-4f46-ac8d-8a7e2e10c535 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:52.580628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799a7c5-86af-4f46-ac8d-8a7e2e10c535 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:52.582809 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:52.613950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9b238-ff92-499f-9890-66deed6a82d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:52.614621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9b238-ff92-499f-9890-66deed6a82d3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:52.614907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9b238-ff92-499f-9890-66deed6a82d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:52.615184 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9b238-ff92-499f-9890-66deed6a82d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:52.616530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9b238-ff92-499f-9890-66deed6a82d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:52.616838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9b238-ff92-499f-9890-66deed6a82d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:52.618202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9b238-ff92-499f-9890-66deed6a82d3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:52.626156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 608/1196] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:06:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:52.631957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97d02c-ed2e-43f0-88b1-e84c9b00fb8c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:52.729950 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97d02c-ed2e-43f0-88b1-e84c9b00fb8c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:52.731430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:52.762414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb87ac-82bf-4062-9354-5d265ba59715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:52.763265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb87ac-82bf-4062-9354-5d265ba59715 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:52.763545 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb87ac-82bf-4062-9354-5d265ba59715 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:52.763816 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb87ac-82bf-4062-9354-5d265ba59715 None admin] PATH_INFO: `/v3/users/7a9da8cccfaf4716a8e5d74e2234c08e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:52.765016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb87ac-82bf-4062-9354-5d265ba59715 None admin] RBAC: Authorizing `identity:get_user(user_id=7a9da8cccfaf4716a8e5d74e2234c08e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:52.766444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb87ac-82bf-4062-9354-5d265ba59715 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:52.768078 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 589/1197] 10.222.0.74 () {56 vars in 1177 bytes} [Thu Jul 14 10:06:52 2022] GET /identity/v3/users/7a9da8cccfaf4716a8e5d74e2234c08e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:06:52.774314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9b238-ff92-499f-9890-66deed6a82d3 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:52.871623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9b238-ff92-499f-9890-66deed6a82d3 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:52.904489 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb57db5-0536-4450-b2da-f0da6ba43dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:52.905127 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb57db5-0536-4450-b2da-f0da6ba43dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:52.905412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb57db5-0536-4450-b2da-f0da6ba43dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:52.905688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb57db5-0536-4450-b2da-f0da6ba43dc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:52.938500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:52.971495 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb57db5-0536-4450-b2da-f0da6ba43dc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:52.972956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb57db5-0536-4450-b2da-f0da6ba43dc0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:53.068595 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 609/1198] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:06:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 10:06:53.074871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb87ac-82bf-4062-9354-5d265ba59715 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:53.171784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb87ac-82bf-4062-9354-5d265ba59715 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:53.204413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6fe2d-9212-4e5b-8c3d-a0ae60b9a09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:53.205258 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6fe2d-9212-4e5b-8c3d-a0ae60b9a09d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:53.205541 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6fe2d-9212-4e5b-8c3d-a0ae60b9a09d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:53.205811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6fe2d-9212-4e5b-8c3d-a0ae60b9a09d None admin] PATH_INFO: `/v3/projects/5b5c0b2221d94bfd8174f87e1a99b5d0` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:53.206988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6fe2d-9212-4e5b-8c3d-a0ae60b9a09d None admin] RBAC: Authorizing `identity:get_project(project_id=5b5c0b2221d94bfd8174f87e1a99b5d0)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:53.208447 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6fe2d-9212-4e5b-8c3d-a0ae60b9a09d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:53.210261 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 590/1199] 10.222.0.74 () {56 vars in 1186 bytes} [Thu Jul 14 10:06:53 2022] GET /identity/v3/projects/5b5c0b2221d94bfd8174f87e1a99b5d0 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:06:53.216183 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb57db5-0536-4450-b2da-f0da6ba43dc0 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:06:53.282088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:53.315298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb57db5-0536-4450-b2da-f0da6ba43dc0 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:06:53.348410 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b34670-e468-49f1-a53b-d8b19c9c15ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:06:53.349058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b34670-e468-49f1-a53b-d8b19c9c15ef None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:06:53.349340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b34670-e468-49f1-a53b-d8b19c9c15ef None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:06:53.349612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b34670-e468-49f1-a53b-d8b19c9c15ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:06:53.350938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b34670-e468-49f1-a53b-d8b19c9c15ef None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=5b5c0b2221d94bfd8174f87e1a99b5d0, user.id=7a9da8cccfaf4716a8e5d74e2234c08e) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:06:53.351247 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b34670-e468-49f1-a53b-d8b19c9c15ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:06:53.352710 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b34670-e468-49f1-a53b-d8b19c9c15ef None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:06:53.358402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 610/1200] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:06:53 2022] GET /identity/v3/role_assignments?user.id=7a9da8cccfaf4716a8e5d74e2234c08e&scope.project.id=5b5c0b2221d94bfd8174f87e1a99b5d0&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:07:03.200233 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=81 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:07:03.355779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=35 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:03.049564 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e8551-3fc5-43a3-86a1-9dcb8f20d217 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:03.050143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e8551-3fc5-43a3-86a1-9dcb8f20d217 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:03.050143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e8551-3fc5-43a3-86a1-9dcb8f20d217 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:03.052033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 591/1201] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:08:03.057562 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4f4c8-0eef-4a8a-9286-cebbf4d46f90 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:03.059613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4f4c8-0eef-4a8a-9286-cebbf4d46f90 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:03.059613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4f4c8-0eef-4a8a-9286-cebbf4d46f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:03.075466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ebc4f4c8-0eef-4a8a-9286-cebbf4d46f90 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:08:03.080173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ebc4f4c8-0eef-4a8a-9286-cebbf4d46f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:08:03.143281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 611/1202] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:08:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:08:03.168221 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e8551-3fc5-43a3-86a1-9dcb8f20d217 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:03.269727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e8551-3fc5-43a3-86a1-9dcb8f20d217 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:03.302762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c488bc-50f0-4eaa-a12b-75c5c36971df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:03.303488 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c488bc-50f0-4eaa-a12b-75c5c36971df None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:03.303779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c488bc-50f0-4eaa-a12b-75c5c36971df None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:03.304076 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c488bc-50f0-4eaa-a12b-75c5c36971df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:03.314851 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c488bc-50f0-4eaa-a12b-75c5c36971df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:03.316319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c488bc-50f0-4eaa-a12b-75c5c36971df None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-e3c488bc-50f0-4eaa-a12b-75c5c36971df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:08:03.333612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:03.334821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:03.336116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:08:03.336116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:08:03.336116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:03.336116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:03.336116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 592/1203] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:03.340760 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4f4c8-0eef-4a8a-9286-cebbf4d46f90 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:03.436732 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4f4c8-0eef-4a8a-9286-cebbf4d46f90 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:03.464398 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:03.469967 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d4c67-2714-48ed-97c7-79f706af2673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:03.470660 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4c67-2714-48ed-97c7-79f706af2673 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:03.470941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4c67-2714-48ed-97c7-79f706af2673 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:03.471209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4c67-2714-48ed-97c7-79f706af2673 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:03.471926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d4c67-2714-48ed-97c7-79f706af2673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:03.472275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d4c67-2714-48ed-97c7-79f706af2673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:03.474155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d4c67-2714-48ed-97c7-79f706af2673 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:03.484886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 612/1204] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:03.491071 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c488bc-50f0-4eaa-a12b-75c5c36971df None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:03.545422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:03.590141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c488bc-50f0-4eaa-a12b-75c5c36971df None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:03.623483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471bc04-d529-4e2e-8c38-a76eba9e209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:03.624188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471bc04-d529-4e2e-8c38-a76eba9e209d None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:03.624475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471bc04-d529-4e2e-8c38-a76eba9e209d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:03.624755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471bc04-d529-4e2e-8c38-a76eba9e209d None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:03.625531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471bc04-d529-4e2e-8c38-a76eba9e209d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:03.626954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471bc04-d529-4e2e-8c38-a76eba9e209d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:03.694856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 593/1205] 10.222.0.74 () {60 vars in 1132 bytes} [Thu Jul 14 10:08:03 2022] POST /identity/v3/users => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:08:05.725433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea04b7-4f9a-46a5-b49b-a11354ba5b68 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:05.726091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea04b7-4f9a-46a5-b49b-a11354ba5b68 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:05.726091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea04b7-4f9a-46a5-b49b-a11354ba5b68 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:05.727335 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 613/1206] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:08:05.732473 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2930d-aad7-4e06-9ab8-7a5068f84d4e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:05.732874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2930d-aad7-4e06-9ab8-7a5068f84d4e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:05.733068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2930d-aad7-4e06-9ab8-7a5068f84d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:05.749597 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d0b2930d-aad7-4e06-9ab8-7a5068f84d4e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:08:05.750795 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d0b2930d-aad7-4e06-9ab8-7a5068f84d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:08:05.816587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 594/1207] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:08:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:08:05.840236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea04b7-4f9a-46a5-b49b-a11354ba5b68 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:05.943461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea04b7-4f9a-46a5-b49b-a11354ba5b68 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:05.976943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625c1b1-7e28-487e-9d6a-7980725ff402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:05.977670 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625c1b1-7e28-487e-9d6a-7980725ff402 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:05.977949 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625c1b1-7e28-487e-9d6a-7980725ff402 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:05.978219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625c1b1-7e28-487e-9d6a-7980725ff402 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:05.988461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625c1b1-7e28-487e-9d6a-7980725ff402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-3625c1b1-7e28-487e-9d6a-7980725ff402 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:08:05.996135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:05.997336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:05.998494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:05.998494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:05.998494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:05.998494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:05.998494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:08:05.998494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:08:05.998494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:08:05.998494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:08:05.998494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:08:05.998494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:08:05.998494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:08:05.998494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:05.998494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 614/1208] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:08:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:06.003321 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2930d-aad7-4e06-9ab8-7a5068f84d4e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:06.043352 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:06.102505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2930d-aad7-4e06-9ab8-7a5068f84d4e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:06.135790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b7d28-be7c-4bca-adf2-a804b8dd5487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:06.136530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b7d28-be7c-4bca-adf2-a804b8dd5487 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:06.136808 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b7d28-be7c-4bca-adf2-a804b8dd5487 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:06.137077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b7d28-be7c-4bca-adf2-a804b8dd5487 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:06.137815 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b7d28-be7c-4bca-adf2-a804b8dd5487 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:06.138116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b7d28-be7c-4bca-adf2-a804b8dd5487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:06.139470 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b7d28-be7c-4bca-adf2-a804b8dd5487 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:06.147759 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 595/1209] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:06.153596 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625c1b1-7e28-487e-9d6a-7980725ff402 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:06.204776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:06.253448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625c1b1-7e28-487e-9d6a-7980725ff402 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:06.286722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecc84b-f91c-4d9d-86f9-c696c53245fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:06.287503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc84b-f91c-4d9d-86f9-c696c53245fb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:06.287784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc84b-f91c-4d9d-86f9-c696c53245fb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:06.288089 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc84b-f91c-4d9d-86f9-c696c53245fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:06.297787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecc84b-f91c-4d9d-86f9-c696c53245fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:06.300832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecc84b-f91c-4d9d-86f9-c696c53245fb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-1aecc84b-f91c-4d9d-86f9-c696c53245fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:08:06.316359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:06.324311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:06.325486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:08:06.325486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:08:06.325486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:06.325486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:06.325486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 615/1210] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:06.325814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b7d28-be7c-4bca-adf2-a804b8dd5487 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:06.420666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:06.423611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b7d28-be7c-4bca-adf2-a804b8dd5487 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:06.456479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300729f-5735-4285-a611-88a6877096c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:06.457760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300729f-5735-4285-a611-88a6877096c0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:06.458054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300729f-5735-4285-a611-88a6877096c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:06.458331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300729f-5735-4285-a611-88a6877096c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:06.459061 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300729f-5735-4285-a611-88a6877096c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:06.459364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300729f-5735-4285-a611-88a6877096c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:06.460762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300729f-5735-4285-a611-88a6877096c0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:06.472285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 596/1211] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:06.478224 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecc84b-f91c-4d9d-86f9-c696c53245fb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:06.577520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecc84b-f91c-4d9d-86f9-c696c53245fb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:06.578986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:06.611049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8ae58-187d-432c-8af4-82257653ea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:06.611849 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8ae58-187d-432c-8af4-82257653ea27 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:06.612159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8ae58-187d-432c-8af4-82257653ea27 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:06.612432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8ae58-187d-432c-8af4-82257653ea27 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:06.620161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8ae58-187d-432c-8af4-82257653ea27 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:06.623891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8ae58-187d-432c-8af4-82257653ea27 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-9ff8ae58-187d-432c-8af4-82257653ea27 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:08:06.636535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:06.637686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:06.638745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:06.638745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:06.638745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:08:06.638745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:08:06.638745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:08:06.638745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:08:06.638745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:08:06.638745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:08:06.638745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:08:06.638745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:06.638745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 616/1212] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:06.643462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300729f-5735-4285-a611-88a6877096c0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:06.739378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300729f-5735-4285-a611-88a6877096c0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:06.772711 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fda004-91ef-4c3a-95d3-0bb666daf149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:06.773413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda004-91ef-4c3a-95d3-0bb666daf149 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:06.773730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda004-91ef-4c3a-95d3-0bb666daf149 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:06.774004 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda004-91ef-4c3a-95d3-0bb666daf149 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:06.774833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fda004-91ef-4c3a-95d3-0bb666daf149 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:06.775139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fda004-91ef-4c3a-95d3-0bb666daf149 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:06.776584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fda004-91ef-4c3a-95d3-0bb666daf149 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:06.794379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 597/1213] 10.222.0.74 () {56 vars in 1143 bytes} [Thu Jul 14 10:08:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:06.800265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8ae58-187d-432c-8af4-82257653ea27 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:06.898020 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8ae58-187d-432c-8af4-82257653ea27 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:06.932311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c56cfb-3554-4963-b014-c290d88614b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:06.933004 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56cfb-3554-4963-b014-c290d88614b5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:06.933289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56cfb-3554-4963-b014-c290d88614b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:06.933565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56cfb-3554-4963-b014-c290d88614b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:06.962781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:07.000411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c56cfb-3554-4963-b014-c290d88614b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:07.001905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c56cfb-3554-4963-b014-c290d88614b5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:07.099143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 617/1214] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:08:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:08:07.104937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fda004-91ef-4c3a-95d3-0bb666daf149 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:07.124102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:07.206252 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fda004-91ef-4c3a-95d3-0bb666daf149 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:07.242028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e3a4c-f00e-4d70-ac28-ef126bd90d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:07.242869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e3a4c-f00e-4d70-ac28-ef126bd90d91 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:07.243140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e3a4c-f00e-4d70-ac28-ef126bd90d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:07.243427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e3a4c-f00e-4d70-ac28-ef126bd90d91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:07.253306 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e3a4c-f00e-4d70-ac28-ef126bd90d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:07.254903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e3a4c-f00e-4d70-ac28-ef126bd90d91 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-568e3a4c-f00e-4d70-ac28-ef126bd90d91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:08:07.272462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:07.273574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:07.274772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:08:07.274772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:08:07.274772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:07.274772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:07.274772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 598/1215] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:07.279619 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c56cfb-3554-4963-b014-c290d88614b5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:07.340338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:07.377314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c56cfb-3554-4963-b014-c290d88614b5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:07.413451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dc08c-b8a3-4c8e-b8c8-a9d82fbdf1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:07.414112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dc08c-b8a3-4c8e-b8c8-a9d82fbdf1af None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:07.414395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dc08c-b8a3-4c8e-b8c8-a9d82fbdf1af None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:07.414668 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dc08c-b8a3-4c8e-b8c8-a9d82fbdf1af None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:07.415382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dc08c-b8a3-4c8e-b8c8-a9d82fbdf1af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:07.415686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dc08c-b8a3-4c8e-b8c8-a9d82fbdf1af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:07.417099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dc08c-b8a3-4c8e-b8c8-a9d82fbdf1af None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:07.428272 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 618/1216] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:08:07.433939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e3a4c-f00e-4d70-ac28-ef126bd90d91 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:07.502146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:07.531514 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e3a4c-f00e-4d70-ac28-ef126bd90d91 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:07.565528 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b6fc9-075c-4145-ab81-6cd94067ed26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:07.566313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b6fc9-075c-4145-ab81-6cd94067ed26 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:07.567097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b6fc9-075c-4145-ab81-6cd94067ed26 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:07.567370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b6fc9-075c-4145-ab81-6cd94067ed26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:07.574194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b6fc9-075c-4145-ab81-6cd94067ed26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:07.575631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b6fc9-075c-4145-ab81-6cd94067ed26 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-bc0b6fc9-075c-4145-ab81-6cd94067ed26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:08:07.589860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:07.590939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:07.592284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:08:07.592284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:08:07.592284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:08:07.592284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:08:07.592284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:08:07.592284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:08:07.592284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:08:07.592284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:07.592284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 599/1217] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:08:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:07.596899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dc08c-b8a3-4c8e-b8c8-a9d82fbdf1af None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:07.696222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dc08c-b8a3-4c8e-b8c8-a9d82fbdf1af None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:07.724554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:07.729167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6495c0-7139-43f6-a02e-7956efab3a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:07.729827 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6495c0-7139-43f6-a02e-7956efab3a6d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:07.730112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6495c0-7139-43f6-a02e-7956efab3a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:07.730390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6495c0-7139-43f6-a02e-7956efab3a6d None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:07.731174 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6495c0-7139-43f6-a02e-7956efab3a6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:07.731480 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6495c0-7139-43f6-a02e-7956efab3a6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:07.732949 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6495c0-7139-43f6-a02e-7956efab3a6d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:07.744595 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 619/1218] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:08:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:07.750659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b6fc9-075c-4145-ab81-6cd94067ed26 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:07.849240 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b6fc9-075c-4145-ab81-6cd94067ed26 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:07.876292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:07.882544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af879409-ca6a-495d-acbe-e78a192d193c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:07.883186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af879409-ca6a-495d-acbe-e78a192d193c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:07.883470 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af879409-ca6a-495d-acbe-e78a192d193c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:07.883767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af879409-ca6a-495d-acbe-e78a192d193c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:07.884633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af879409-ca6a-495d-acbe-e78a192d193c None admin] RBAC: Adding query filter params (role.id=feef3a85c1c0446590c2671a9f266cf4, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=2784d36c16d343cc961a22d956ee30f2) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:07.884946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af879409-ca6a-495d-acbe-e78a192d193c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:07.886380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af879409-ca6a-495d-acbe-e78a192d193c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:07.892323 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 600/1219] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:08:07 2022] GET /identity/v3/role_assignments?user.id=2784d36c16d343cc961a22d956ee30f2&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=feef3a85c1c0446590c2671a9f266cf4 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:09.909377 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb9c8a-198c-41ef-a3ed-d227239a92d5 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:09.909908 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb9c8a-198c-41ef-a3ed-d227239a92d5 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:09.910035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb9c8a-198c-41ef-a3ed-d227239a92d5 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:09.911824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 620/1220] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:08:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:08:09.917225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352307a-582e-4157-9945-30d5672cbe97 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:09.917631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352307a-582e-4157-9945-30d5672cbe97 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:09.917771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352307a-582e-4157-9945-30d5672cbe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:09.934741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c352307a-582e-4157-9945-30d5672cbe97 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:08:09.939564 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c352307a-582e-4157-9945-30d5672cbe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:08:10.002119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 601/1221] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:08:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:08:10.024382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb9c8a-198c-41ef-a3ed-d227239a92d5 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:10.125609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb9c8a-198c-41ef-a3ed-d227239a92d5 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:10.159191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf8893-d4ee-4cb0-8783-a139aee673c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:10.160057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf8893-d4ee-4cb0-8783-a139aee673c8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:10.160292 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf8893-d4ee-4cb0-8783-a139aee673c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:10.161090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf8893-d4ee-4cb0-8783-a139aee673c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:10.171070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf8893-d4ee-4cb0-8783-a139aee673c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a4bf8893-d4ee-4cb0-8783-a139aee673c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:08:10.179385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:10.183926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:10.185129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:10.185129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:10.185129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:10.185129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:10.185129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:08:10.185129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:08:10.185129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:08:10.185129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:08:10.185129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:08:10.185129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:08:10.185129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:08:10.185129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:10.185129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 621/1222] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:08:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:10.187035 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352307a-582e-4157-9945-30d5672cbe97 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:10.286987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352307a-582e-4157-9945-30d5672cbe97 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:10.310056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:10.320876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32661eea-524c-442c-b5fe-f5d6c6ace126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:10.321540 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32661eea-524c-442c-b5fe-f5d6c6ace126 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:10.321819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32661eea-524c-442c-b5fe-f5d6c6ace126 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:10.322162 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32661eea-524c-442c-b5fe-f5d6c6ace126 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:10.322903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32661eea-524c-442c-b5fe-f5d6c6ace126 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:10.323206 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32661eea-524c-442c-b5fe-f5d6c6ace126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:10.324605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32661eea-524c-442c-b5fe-f5d6c6ace126 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:10.332925 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 602/1223] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:08:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:10.338889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf8893-d4ee-4cb0-8783-a139aee673c8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:10.382384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:10.439390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf8893-d4ee-4cb0-8783-a139aee673c8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:10.471990 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af68af2-944f-447d-b24d-c96709c93a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:10.472792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af68af2-944f-447d-b24d-c96709c93a0a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:10.473606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af68af2-944f-447d-b24d-c96709c93a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:10.473878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af68af2-944f-447d-b24d-c96709c93a0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:10.484208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af68af2-944f-447d-b24d-c96709c93a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:10.485634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af68af2-944f-447d-b24d-c96709c93a0a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-3af68af2-944f-447d-b24d-c96709c93a0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:08:10.502974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:10.504095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:10.505376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:08:10.505376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:08:10.505376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:10.505376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:10.505376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 622/1224] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:10.510003 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32661eea-524c-442c-b5fe-f5d6c6ace126 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:10.610998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32661eea-524c-442c-b5fe-f5d6c6ace126 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:10.643825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1448d-bcbe-4800-87e1-ab9d096ad42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:10.644504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1448d-bcbe-4800-87e1-ab9d096ad42e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:10.645405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1448d-bcbe-4800-87e1-ab9d096ad42e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:10.645692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1448d-bcbe-4800-87e1-ab9d096ad42e None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:10.646409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1448d-bcbe-4800-87e1-ab9d096ad42e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:10.646716 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1448d-bcbe-4800-87e1-ab9d096ad42e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:10.648173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1448d-bcbe-4800-87e1-ab9d096ad42e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:10.659928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 603/1225] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:10.665757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af68af2-944f-447d-b24d-c96709c93a0a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:10.759430 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:10.765880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af68af2-944f-447d-b24d-c96709c93a0a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:10.798594 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b6740-e5dd-418c-9955-d88556ee68d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:10.799397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b6740-e5dd-418c-9955-d88556ee68d6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:10.799683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b6740-e5dd-418c-9955-d88556ee68d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:10.799959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b6740-e5dd-418c-9955-d88556ee68d6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:10.807462 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b6740-e5dd-418c-9955-d88556ee68d6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:10.809010 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b6740-e5dd-418c-9955-d88556ee68d6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a51b6740-e5dd-418c-9955-d88556ee68d6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:08:10.824141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:10.825274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:10.826475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:10.826475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:10.826475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:08:10.826475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:08:10.826475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:08:10.826475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:08:10.826475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:08:10.826475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:08:10.826475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:08:10.826475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:10.826475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 623/1226] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:10.833929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1448d-bcbe-4800-87e1-ab9d096ad42e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:10.878947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:10.930167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1448d-bcbe-4800-87e1-ab9d096ad42e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:10.964360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d044ab0-8a82-4399-b3e7-6bf0a158d7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:10.965019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d044ab0-8a82-4399-b3e7-6bf0a158d7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:10.965303 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d044ab0-8a82-4399-b3e7-6bf0a158d7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:10.965577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d044ab0-8a82-4399-b3e7-6bf0a158d7d7 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:10.966407 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d044ab0-8a82-4399-b3e7-6bf0a158d7d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:10.966715 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d044ab0-8a82-4399-b3e7-6bf0a158d7d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:10.968173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d044ab0-8a82-4399-b3e7-6bf0a158d7d7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:10.986235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 604/1227] 10.222.0.74 () {56 vars in 1143 bytes} [Thu Jul 14 10:08:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:10.992509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b6740-e5dd-418c-9955-d88556ee68d6 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:11.094506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b6740-e5dd-418c-9955-d88556ee68d6 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:11.127935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc41b0-4d12-4ff5-8db2-e3f64c6dc65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:11.128760 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc41b0-4d12-4ff5-8db2-e3f64c6dc65e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:11.129044 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc41b0-4d12-4ff5-8db2-e3f64c6dc65e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:11.129876 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc41b0-4d12-4ff5-8db2-e3f64c6dc65e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:11.140478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc41b0-4d12-4ff5-8db2-e3f64c6dc65e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:11.143161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc41b0-4d12-4ff5-8db2-e3f64c6dc65e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-01dc41b0-4d12-4ff5-8db2-e3f64c6dc65e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:08:11.158703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:11.159763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:11.160965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:08:11.160965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:08:11.160965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:11.160965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:11.160965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 624/1228] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:11.165744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d044ab0-8a82-4399-b3e7-6bf0a158d7d7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:11.266720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d044ab0-8a82-4399-b3e7-6bf0a158d7d7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:11.269025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:11.299781 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93d373-1762-47c2-8c9a-60df83f169cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:11.300439 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93d373-1762-47c2-8c9a-60df83f169cf None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:11.300717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93d373-1762-47c2-8c9a-60df83f169cf None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:11.300985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93d373-1762-47c2-8c9a-60df83f169cf None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:11.302297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93d373-1762-47c2-8c9a-60df83f169cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:11.302531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93d373-1762-47c2-8c9a-60df83f169cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:11.303876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93d373-1762-47c2-8c9a-60df83f169cf None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:11.315255 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 605/1229] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:11.321436 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc41b0-4d12-4ff5-8db2-e3f64c6dc65e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:11.330839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:11.420431 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc41b0-4d12-4ff5-8db2-e3f64c6dc65e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:11.453142 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649ca98-ebad-4470-87fe-a87bf4922f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:11.454220 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649ca98-ebad-4470-87fe-a87bf4922f82 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:11.454551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649ca98-ebad-4470-87fe-a87bf4922f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:11.454981 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649ca98-ebad-4470-87fe-a87bf4922f82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:11.463533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649ca98-ebad-4470-87fe-a87bf4922f82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:11.465026 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649ca98-ebad-4470-87fe-a87bf4922f82 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-d649ca98-ebad-4470-87fe-a87bf4922f82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:08:11.479779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:11.480862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:11.481917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:08:11.481917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:08:11.481917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:08:11.481917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:08:11.481917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:08:11.481917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:08:11.481917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:08:11.481917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:11.481917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 625/1230] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:11.486885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93d373-1762-47c2-8c9a-60df83f169cf None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:11.587094 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93d373-1762-47c2-8c9a-60df83f169cf None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:11.620892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039b599-f98c-485e-a6ce-640e1f0cc917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:11.621550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039b599-f98c-485e-a6ce-640e1f0cc917 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:11.621837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039b599-f98c-485e-a6ce-640e1f0cc917 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:11.622116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039b599-f98c-485e-a6ce-640e1f0cc917 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:11.622995 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039b599-f98c-485e-a6ce-640e1f0cc917 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:11.623311 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039b599-f98c-485e-a6ce-640e1f0cc917 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:11.624769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039b599-f98c-485e-a6ce-640e1f0cc917 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:11.636674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 606/1231] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:11.642694 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649ca98-ebad-4470-87fe-a87bf4922f82 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:11.707888 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:11.741446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649ca98-ebad-4470-87fe-a87bf4922f82 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:11.774185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48973647-e787-403b-bf8c-d459b6b814bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:11.775279 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48973647-e787-403b-bf8c-d459b6b814bc None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:11.775606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48973647-e787-403b-bf8c-d459b6b814bc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:11.776081 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48973647-e787-403b-bf8c-d459b6b814bc None admin] PATH_INFO: `/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/2784d36c16d343cc961a22d956ee30f2/roles/feef3a85c1c0446590c2671a9f266cf4` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:11.791317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48973647-e787-403b-bf8c-d459b6b814bc None admin] RBAC: Authorizing `identity:create_grant(project_id=795b6593e7b74eeda9929aba07cbaa0e, user_id=2784d36c16d343cc961a22d956ee30f2, role_id=feef3a85c1c0446590c2671a9f266cf4)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:11.792852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48973647-e787-403b-bf8c-d459b6b814bc None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:11.878148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 626/1232] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:08:11 2022] PUT /identity/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/2784d36c16d343cc961a22d956ee30f2/roles/feef3a85c1c0446590c2671a9f266cf4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:08:13.878826 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6babb73-8281-498c-ab4f-845090fa0474 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:13.879380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6babb73-8281-498c-ab4f-845090fa0474 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:13.879380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6babb73-8281-498c-ab4f-845090fa0474 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:13.880765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 607/1233] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:08:13.885895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f6b28-ef62-4874-9e32-e754d9832d53 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:13.888646 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f6b28-ef62-4874-9e32-e754d9832d53 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:13.888646 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f6b28-ef62-4874-9e32-e754d9832d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:13.903210 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e96f6b28-ef62-4874-9e32-e754d9832d53 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:08:13.904416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e96f6b28-ef62-4874-9e32-e754d9832d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:08:13.970516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 627/1234] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:08:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:08:13.995104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6babb73-8281-498c-ab4f-845090fa0474 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:14.021140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:14.095256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6babb73-8281-498c-ab4f-845090fa0474 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:14.130163 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5bf89-7b89-42ec-9460-6b6b28d4e1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:14.130878 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5bf89-7b89-42ec-9460-6b6b28d4e1ab None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:14.131152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5bf89-7b89-42ec-9460-6b6b28d4e1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:14.131417 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5bf89-7b89-42ec-9460-6b6b28d4e1ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:14.141476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5bf89-7b89-42ec-9460-6b6b28d4e1ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-d0b5bf89-7b89-42ec-9460-6b6b28d4e1ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:08:14.149760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:14.150973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:14.152239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:14.152239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:14.152239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:14.152239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:14.152239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:08:14.152239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:08:14.152239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:08:14.152239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:08:14.152239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:08:14.152239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:08:14.152239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:08:14.152239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:14.152239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 608/1235] 10.222.0.74 () {56 vars in 1102 bytes} [Thu Jul 14 10:08:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:14.157181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f6b28-ef62-4874-9e32-e754d9832d53 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:14.203126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:14.255509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f6b28-ef62-4874-9e32-e754d9832d53 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:14.288269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6417a-40ea-4ec0-8b54-f01c5ab326cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:14.288936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6417a-40ea-4ec0-8b54-f01c5ab326cb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:14.289221 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6417a-40ea-4ec0-8b54-f01c5ab326cb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:14.289500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6417a-40ea-4ec0-8b54-f01c5ab326cb None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:14.290273 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6417a-40ea-4ec0-8b54-f01c5ab326cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:14.290564 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6417a-40ea-4ec0-8b54-f01c5ab326cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:14.291935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6417a-40ea-4ec0-8b54-f01c5ab326cb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:14.301415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 628/1236] 10.222.0.74 () {56 vars in 1103 bytes} [Thu Jul 14 10:08:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:14.307335 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5bf89-7b89-42ec-9460-6b6b28d4e1ab None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:14.392509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:14.407660 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5bf89-7b89-42ec-9460-6b6b28d4e1ab None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:14.440406 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fdbc7-de12-43c8-9de1-f6a672cd9d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:14.441187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fdbc7-de12-43c8-9de1-f6a672cd9d9f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:14.441468 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fdbc7-de12-43c8-9de1-f6a672cd9d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:14.441740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fdbc7-de12-43c8-9de1-f6a672cd9d9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:14.452631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fdbc7-de12-43c8-9de1-f6a672cd9d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:14.454131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fdbc7-de12-43c8-9de1-f6a672cd9d9f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-f63fdbc7-de12-43c8-9de1-f6a672cd9d9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:08:14.470649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:14.471828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:14.473023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:08:14.473023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:08:14.473023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:14.473023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:14.473023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 609/1237] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:08:14.477754 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6417a-40ea-4ec0-8b54-f01c5ab326cb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:14.576327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6417a-40ea-4ec0-8b54-f01c5ab326cb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:14.585395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:14.609488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033c5d4-011e-427a-9df3-33a11d2bf4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:14.610152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033c5d4-011e-427a-9df3-33a11d2bf4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:14.610437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033c5d4-011e-427a-9df3-33a11d2bf4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:14.610716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033c5d4-011e-427a-9df3-33a11d2bf4f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:14.611435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033c5d4-011e-427a-9df3-33a11d2bf4f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:14.611742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033c5d4-011e-427a-9df3-33a11d2bf4f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:14.613144 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033c5d4-011e-427a-9df3-33a11d2bf4f2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:14.624916 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 629/1238] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:14.631139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fdbc7-de12-43c8-9de1-f6a672cd9d9f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:14.729266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fdbc7-de12-43c8-9de1-f6a672cd9d9f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:14.762204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23310a6b-5cd1-4dc3-96bc-b361a4d78097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:14.763001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23310a6b-5cd1-4dc3-96bc-b361a4d78097 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:14.763279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23310a6b-5cd1-4dc3-96bc-b361a4d78097 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:14.763548 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23310a6b-5cd1-4dc3-96bc-b361a4d78097 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:14.766282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:14.771220 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23310a6b-5cd1-4dc3-96bc-b361a4d78097 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:14.772684 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23310a6b-5cd1-4dc3-96bc-b361a4d78097 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-23310a6b-5cd1-4dc3-96bc-b361a4d78097 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:08:14.787357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:14.790098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:14.791327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:14.791327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:14.791327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:08:14.791327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:08:14.791327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:08:14.791327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:08:14.791327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:08:14.791327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:08:14.791327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:08:14.791327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:14.791327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 610/1239] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:14.794308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033c5d4-011e-427a-9df3-33a11d2bf4f2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:14.896621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033c5d4-011e-427a-9df3-33a11d2bf4f2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:14.929391 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abbaa3-4b59-40b3-b5d3-3212eabf8698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:14.930060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abbaa3-4b59-40b3-b5d3-3212eabf8698 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:14.930341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abbaa3-4b59-40b3-b5d3-3212eabf8698 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:14.930613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abbaa3-4b59-40b3-b5d3-3212eabf8698 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:14.931451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abbaa3-4b59-40b3-b5d3-3212eabf8698 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:14.931758 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abbaa3-4b59-40b3-b5d3-3212eabf8698 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:14.933216 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abbaa3-4b59-40b3-b5d3-3212eabf8698 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:14.950458 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 630/1240] 10.222.0.74 () {56 vars in 1143 bytes} [Thu Jul 14 10:08:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:14.956244 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23310a6b-5cd1-4dc3-96bc-b361a4d78097 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:15.055389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23310a6b-5cd1-4dc3-96bc-b361a4d78097 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:15.089815 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342bba9-90fd-47fc-9bcd-c8004b2c0810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:15.090478 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342bba9-90fd-47fc-9bcd-c8004b2c0810 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:15.090744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342bba9-90fd-47fc-9bcd-c8004b2c0810 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:15.091016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342bba9-90fd-47fc-9bcd-c8004b2c0810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:15.151334 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:15.157748 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342bba9-90fd-47fc-9bcd-c8004b2c0810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:15.159550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342bba9-90fd-47fc-9bcd-c8004b2c0810 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:15.256350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 611/1241] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:08:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:08:15.262323 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abbaa3-4b59-40b3-b5d3-3212eabf8698 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:15.290662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:15.359863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abbaa3-4b59-40b3-b5d3-3212eabf8698 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:15.393648 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0efb51-8b1b-4c07-9e9f-4e0b86e8fb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:15.394438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0efb51-8b1b-4c07-9e9f-4e0b86e8fb9e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:15.394720 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0efb51-8b1b-4c07-9e9f-4e0b86e8fb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:15.395022 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0efb51-8b1b-4c07-9e9f-4e0b86e8fb9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:15.405648 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0efb51-8b1b-4c07-9e9f-4e0b86e8fb9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:15.407333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0efb51-8b1b-4c07-9e9f-4e0b86e8fb9e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-2f0efb51-8b1b-4c07-9e9f-4e0b86e8fb9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:08:15.425296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:15.432242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:15.433371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:08:15.433371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:08:15.433371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:15.433371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:15.433371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 631/1242] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:15.433734 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342bba9-90fd-47fc-9bcd-c8004b2c0810 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:15.525354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:15.530949 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342bba9-90fd-47fc-9bcd-c8004b2c0810 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:15.564164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7abf97-9852-4eb7-b086-bcd7f9a771f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:15.564823 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7abf97-9852-4eb7-b086-bcd7f9a771f7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:15.565101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7abf97-9852-4eb7-b086-bcd7f9a771f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:15.565373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7abf97-9852-4eb7-b086-bcd7f9a771f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:15.566215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7abf97-9852-4eb7-b086-bcd7f9a771f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:15.566518 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7abf97-9852-4eb7-b086-bcd7f9a771f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:15.568471 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7abf97-9852-4eb7-b086-bcd7f9a771f7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:15.580025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 612/1243] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:15.586564 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0efb51-8b1b-4c07-9e9f-4e0b86e8fb9e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:15.664187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:15.685246 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0efb51-8b1b-4c07-9e9f-4e0b86e8fb9e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:15.719884 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a50f6-fb02-433a-8b9c-bc4bf1be7ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:15.720846 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a50f6-fb02-433a-8b9c-bc4bf1be7ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:15.721129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a50f6-fb02-433a-8b9c-bc4bf1be7ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:15.721403 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a50f6-fb02-433a-8b9c-bc4bf1be7ae8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:15.728009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a50f6-fb02-433a-8b9c-bc4bf1be7ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:15.729488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a50f6-fb02-433a-8b9c-bc4bf1be7ae8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-de6a50f6-fb02-433a-8b9c-bc4bf1be7ae8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:08:15.743076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:15.744315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:15.750196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:08:15.750196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:08:15.750196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:08:15.750196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:08:15.750196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:08:15.750196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:08:15.750196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:08:15.750196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:15.750196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 632/1244] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:08:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:15.750842 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7abf97-9852-4eb7-b086-bcd7f9a771f7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:15.850798 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7abf97-9852-4eb7-b086-bcd7f9a771f7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:15.884903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d6f58-ace1-4008-ac52-601d6b4e2ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:15.885559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d6f58-ace1-4008-ac52-601d6b4e2ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:15.885841 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d6f58-ace1-4008-ac52-601d6b4e2ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:15.886112 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d6f58-ace1-4008-ac52-601d6b4e2ca8 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:15.886936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d6f58-ace1-4008-ac52-601d6b4e2ca8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:15.887354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d6f58-ace1-4008-ac52-601d6b4e2ca8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:15.888890 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d6f58-ace1-4008-ac52-601d6b4e2ca8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:15.900947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 613/1245] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:08:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:15.906959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a50f6-fb02-433a-8b9c-bc4bf1be7ae8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:16.008331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a50f6-fb02-433a-8b9c-bc4bf1be7ae8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:16.041144 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7687e-6007-4d3b-b4b9-674593d31ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:16.041792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7687e-6007-4d3b-b4b9-674593d31ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:16.042073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7687e-6007-4d3b-b4b9-674593d31ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:16.042347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7687e-6007-4d3b-b4b9-674593d31ed7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:16.043230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7687e-6007-4d3b-b4b9-674593d31ed7 None admin] RBAC: Adding query filter params (role.id=feef3a85c1c0446590c2671a9f266cf4, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=2784d36c16d343cc961a22d956ee30f2) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:16.043540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7687e-6007-4d3b-b4b9-674593d31ed7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:16.044997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7687e-6007-4d3b-b4b9-674593d31ed7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:16.050922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 633/1246] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:08:15 2022] GET /identity/v3/role_assignments?user.id=2784d36c16d343cc961a22d956ee30f2&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=feef3a85c1c0446590c2671a9f266cf4 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:18.117400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cdbc7-a120-49b8-8a67-e97c4ee1538e None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:18.117934 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cdbc7-a120-49b8-8a67-e97c4ee1538e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:18.117934 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cdbc7-a120-49b8-8a67-e97c4ee1538e None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:18.119334 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 614/1247] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:08:18.124525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3691d-ccc9-494d-9652-35508c9b2214 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:18.124958 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3691d-ccc9-494d-9652-35508c9b2214 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:18.125063 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3691d-ccc9-494d-9652-35508c9b2214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:18.130108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:18.142495 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4da3691d-ccc9-494d-9652-35508c9b2214 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:08:18.143663 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4da3691d-ccc9-494d-9652-35508c9b2214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:08:18.210699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 634/1248] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:08:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:08:18.233788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cdbc7-a120-49b8-8a67-e97c4ee1538e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:18.252456 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:18.337807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cdbc7-a120-49b8-8a67-e97c4ee1538e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:18.371005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a44442-39d8-477f-9474-9ef8b7b09ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:18.371797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a44442-39d8-477f-9474-9ef8b7b09ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:18.372117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a44442-39d8-477f-9474-9ef8b7b09ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:18.372399 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a44442-39d8-477f-9474-9ef8b7b09ab0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:18.382849 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a44442-39d8-477f-9474-9ef8b7b09ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-71a44442-39d8-477f-9474-9ef8b7b09ab0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:08:18.390533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:18.391755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:18.392981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:18.392981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:18.392981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:18.392981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:18.392981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:08:18.392981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:08:18.392981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:08:18.392981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:08:18.392981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:08:18.392981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:08:18.392981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:08:18.392981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:18.392981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 615/1249] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:08:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:18.397837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3691d-ccc9-494d-9652-35508c9b2214 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:18.496112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3691d-ccc9-494d-9652-35508c9b2214 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:18.525293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:18.530079 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75089115-07d0-49f4-827d-c91a031143da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:18.530759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089115-07d0-49f4-827d-c91a031143da None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:18.531030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089115-07d0-49f4-827d-c91a031143da None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:18.531304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089115-07d0-49f4-827d-c91a031143da None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:18.532076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75089115-07d0-49f4-827d-c91a031143da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:18.532385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75089115-07d0-49f4-827d-c91a031143da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:18.534016 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75089115-07d0-49f4-827d-c91a031143da None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:18.542507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 635/1250] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:08:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:18.548300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a44442-39d8-477f-9474-9ef8b7b09ab0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:18.625719 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:18.647227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a44442-39d8-477f-9474-9ef8b7b09ab0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:18.681829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad66c8-fe91-49a1-aedc-e308a3483dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:18.682616 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad66c8-fe91-49a1-aedc-e308a3483dae None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:18.682952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad66c8-fe91-49a1-aedc-e308a3483dae None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:18.683177 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad66c8-fe91-49a1-aedc-e308a3483dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:18.693393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad66c8-fe91-49a1-aedc-e308a3483dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:18.694835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad66c8-fe91-49a1-aedc-e308a3483dae None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-01ad66c8-fe91-49a1-aedc-e308a3483dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:08:18.711204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:18.717360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:18.718498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:08:18.718498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:08:18.718498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:18.718498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:18.718498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 616/1251] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:18.718852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75089115-07d0-49f4-827d-c91a031143da None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:18.816687 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75089115-07d0-49f4-827d-c91a031143da None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:18.850694 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ce299-14a6-41db-accb-52899be4b3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:18.851364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ce299-14a6-41db-accb-52899be4b3dd None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:18.851644 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ce299-14a6-41db-accb-52899be4b3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:18.851919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ce299-14a6-41db-accb-52899be4b3dd None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:18.852677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ce299-14a6-41db-accb-52899be4b3dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:18.852983 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ce299-14a6-41db-accb-52899be4b3dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:18.854349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ce299-14a6-41db-accb-52899be4b3dd None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:18.865899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 636/1252] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:18.871534 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad66c8-fe91-49a1-aedc-e308a3483dae None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:18.970647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad66c8-fe91-49a1-aedc-e308a3483dae None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:18.995952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:19.003655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039caf57-d759-427d-90ff-eead8a22d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:19.004491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039caf57-d759-427d-90ff-eead8a22d09b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:19.004771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039caf57-d759-427d-90ff-eead8a22d09b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:19.005040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039caf57-d759-427d-90ff-eead8a22d09b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:19.012999 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039caf57-d759-427d-90ff-eead8a22d09b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:19.014585 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039caf57-d759-427d-90ff-eead8a22d09b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-039caf57-d759-427d-90ff-eead8a22d09b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:08:19.029739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:19.038158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:19.039340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:19.039340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:19.039340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:08:19.039340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:08:19.039340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:08:19.039340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:08:19.039340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:08:19.039340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:08:19.039340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:08:19.039340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:19.039340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 617/1253] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:19.040115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ce299-14a6-41db-accb-52899be4b3dd None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:19.093932 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:19.138743 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ce299-14a6-41db-accb-52899be4b3dd None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:19.172894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79227a-2edc-4cc5-807b-66903b0d7b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:19.173550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79227a-2edc-4cc5-807b-66903b0d7b27 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:19.173831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79227a-2edc-4cc5-807b-66903b0d7b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:19.174151 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79227a-2edc-4cc5-807b-66903b0d7b27 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:19.174977 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79227a-2edc-4cc5-807b-66903b0d7b27 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:19.175274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79227a-2edc-4cc5-807b-66903b0d7b27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:19.176724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79227a-2edc-4cc5-807b-66903b0d7b27 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:19.194079 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 637/1254] 10.222.0.74 () {56 vars in 1143 bytes} [Thu Jul 14 10:08:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:19.199934 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039caf57-d759-427d-90ff-eead8a22d09b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:19.298618 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039caf57-d759-427d-90ff-eead8a22d09b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:19.332247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db2732-aefd-4fb4-a594-f64b56965540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:19.332890 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db2732-aefd-4fb4-a594-f64b56965540 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:19.333174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db2732-aefd-4fb4-a594-f64b56965540 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:19.333450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db2732-aefd-4fb4-a594-f64b56965540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:19.388198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:19.401358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db2732-aefd-4fb4-a594-f64b56965540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:19.402880 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db2732-aefd-4fb4-a594-f64b56965540 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:19.500193 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 618/1255] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:08:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:08:19.506534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79227a-2edc-4cc5-807b-66903b0d7b27 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:19.603242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79227a-2edc-4cc5-807b-66903b0d7b27 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:19.618447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:19.639460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cc9f8-0e4e-47ea-abe0-4ee61b3714c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:19.640281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cc9f8-0e4e-47ea-abe0-4ee61b3714c9 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:19.640565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cc9f8-0e4e-47ea-abe0-4ee61b3714c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:19.640837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cc9f8-0e4e-47ea-abe0-4ee61b3714c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:19.650547 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cc9f8-0e4e-47ea-abe0-4ee61b3714c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:19.651984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cc9f8-0e4e-47ea-abe0-4ee61b3714c9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-984cc9f8-0e4e-47ea-abe0-4ee61b3714c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:08:19.669289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:19.670375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:19.671570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:08:19.671570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:08:19.671570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:19.671570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:19.671570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 638/1256] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:19.676234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db2732-aefd-4fb4-a594-f64b56965540 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:19.762875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:19.774456 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db2732-aefd-4fb4-a594-f64b56965540 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:19.808146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63f6c7-a1c4-4046-ad82-eb614fbbbcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:19.808853 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63f6c7-a1c4-4046-ad82-eb614fbbbcfe None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:19.809336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63f6c7-a1c4-4046-ad82-eb614fbbbcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:19.809656 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63f6c7-a1c4-4046-ad82-eb614fbbbcfe None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:19.810597 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63f6c7-a1c4-4046-ad82-eb614fbbbcfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:19.811307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63f6c7-a1c4-4046-ad82-eb614fbbbcfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:19.812711 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63f6c7-a1c4-4046-ad82-eb614fbbbcfe None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:19.824933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 619/1257] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:19.830565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cc9f8-0e4e-47ea-abe0-4ee61b3714c9 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:19.928685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cc9f8-0e4e-47ea-abe0-4ee61b3714c9 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:19.962863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c0308-86f4-4c40-b99f-620491fd0a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:19.963665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c0308-86f4-4c40-b99f-620491fd0a76 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:19.963947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c0308-86f4-4c40-b99f-620491fd0a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:19.964252 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c0308-86f4-4c40-b99f-620491fd0a76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:19.970954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c0308-86f4-4c40-b99f-620491fd0a76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:19.972435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c0308-86f4-4c40-b99f-620491fd0a76 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-210c0308-86f4-4c40-b99f-620491fd0a76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:08:19.986723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:19.988401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:19.990729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:08:19.990729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:08:19.990729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:08:19.990729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:08:19.990729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:08:19.990729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:08:19.990729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:08:19.990729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:19.990729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 639/1258] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:08:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:19.994335 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63f6c7-a1c4-4046-ad82-eb614fbbbcfe None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:20.094405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63f6c7-a1c4-4046-ad82-eb614fbbbcfe None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:20.128415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd79c0-a4b8-4e40-bc7c-283cda5a22a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:20.129076 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd79c0-a4b8-4e40-bc7c-283cda5a22a7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:20.129361 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd79c0-a4b8-4e40-bc7c-283cda5a22a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:20.129638 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd79c0-a4b8-4e40-bc7c-283cda5a22a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:20.130421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd79c0-a4b8-4e40-bc7c-283cda5a22a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:20.130730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd79c0-a4b8-4e40-bc7c-283cda5a22a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:20.132199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd79c0-a4b8-4e40-bc7c-283cda5a22a7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:20.144009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 620/1259] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:08:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:20.150069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c0308-86f4-4c40-b99f-620491fd0a76 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:20.175928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:20.248428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c0308-86f4-4c40-b99f-620491fd0a76 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:20.281073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff1108-a8f1-4e27-95ef-9b065ebfd0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:20.281717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff1108-a8f1-4e27-95ef-9b065ebfd0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:20.282000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff1108-a8f1-4e27-95ef-9b065ebfd0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:20.282274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff1108-a8f1-4e27-95ef-9b065ebfd0b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:20.283098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff1108-a8f1-4e27-95ef-9b065ebfd0b3 None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=2784d36c16d343cc961a22d956ee30f2) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:20.283670 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff1108-a8f1-4e27-95ef-9b065ebfd0b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:20.285124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff1108-a8f1-4e27-95ef-9b065ebfd0b3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:20.291091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 640/1260] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:08:20 2022] GET /identity/v3/role_assignments?user.id=2784d36c16d343cc961a22d956ee30f2&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:22.281387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42688e2-c266-4741-a8e5-c4e04a655d98 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:22.281936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42688e2-c266-4741-a8e5-c4e04a655d98 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:22.281936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42688e2-c266-4741-a8e5-c4e04a655d98 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:22.283578 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 621/1261] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:08:22.288812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d8bd6-857d-4ff9-b0c2-f7a752a730c0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:22.289232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d8bd6-857d-4ff9-b0c2-f7a752a730c0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:22.289369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d8bd6-857d-4ff9-b0c2-f7a752a730c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:22.306164 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2d3d8bd6-857d-4ff9-b0c2-f7a752a730c0 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:08:22.307338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2d3d8bd6-857d-4ff9-b0c2-f7a752a730c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:08:22.375766 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 641/1262] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:08:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:08:22.399469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42688e2-c266-4741-a8e5-c4e04a655d98 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:22.411461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:22.498546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42688e2-c266-4741-a8e5-c4e04a655d98 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:22.532913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a1263-ae86-4596-ac38-64c97199080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:22.533953 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a1263-ae86-4596-ac38-64c97199080f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:22.534272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a1263-ae86-4596-ac38-64c97199080f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:22.534509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a1263-ae86-4596-ac38-64c97199080f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:22.545675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a1263-ae86-4596-ac38-64c97199080f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-bf7a1263-ae86-4596-ac38-64c97199080f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:08:22.553843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:22.554837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:22.555708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:22.555708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:22.555708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:22.555708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:22.555708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:08:22.555708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:08:22.555708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:08:22.555708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:08:22.555708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:08:22.555708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:08:22.555708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:08:22.555708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:22.555708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 622/1263] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:08:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:22.561408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d8bd6-857d-4ff9-b0c2-f7a752a730c0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:22.580585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:22.659110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d8bd6-857d-4ff9-b0c2-f7a752a730c0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:22.691896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9405900-abe2-4867-a5c8-2ccc70465ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:22.692588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9405900-abe2-4867-a5c8-2ccc70465ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:22.692868 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9405900-abe2-4867-a5c8-2ccc70465ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:22.693142 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9405900-abe2-4867-a5c8-2ccc70465ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:22.694466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9405900-abe2-4867-a5c8-2ccc70465ec2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:22.694770 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9405900-abe2-4867-a5c8-2ccc70465ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:22.696167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9405900-abe2-4867-a5c8-2ccc70465ec2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:22.703958 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 642/1264] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:08:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:22.709929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a1263-ae86-4596-ac38-64c97199080f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:22.777476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:22.812940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a1263-ae86-4596-ac38-64c97199080f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:22.849288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae676a80-e52d-4ceb-a47e-8d55ca0b4e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:22.850118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae676a80-e52d-4ceb-a47e-8d55ca0b4e4c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:22.850395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae676a80-e52d-4ceb-a47e-8d55ca0b4e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:22.850663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae676a80-e52d-4ceb-a47e-8d55ca0b4e4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:22.861359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae676a80-e52d-4ceb-a47e-8d55ca0b4e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:22.862818 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae676a80-e52d-4ceb-a47e-8d55ca0b4e4c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-ae676a80-e52d-4ceb-a47e-8d55ca0b4e4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:08:22.880441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:22.884454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:22.885448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:08:22.885448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:08:22.885448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:22.885448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:22.885448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 623/1265] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:22.888312 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9405900-abe2-4867-a5c8-2ccc70465ec2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:22.970117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:22.988679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9405900-abe2-4867-a5c8-2ccc70465ec2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:23.020678 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd27b66-7407-453d-bf80-e510a5641272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:23.021360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd27b66-7407-453d-bf80-e510a5641272 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:23.021643 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd27b66-7407-453d-bf80-e510a5641272 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:23.021915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd27b66-7407-453d-bf80-e510a5641272 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:23.022626 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd27b66-7407-453d-bf80-e510a5641272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:23.022927 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd27b66-7407-453d-bf80-e510a5641272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:23.024311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd27b66-7407-453d-bf80-e510a5641272 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:23.036551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 643/1266] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:23.043123 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae676a80-e52d-4ceb-a47e-8d55ca0b4e4c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:23.144016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae676a80-e52d-4ceb-a47e-8d55ca0b4e4c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:23.164032 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:23.178401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179f830-5a81-4f45-b18a-676e3cdd1edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:23.179195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179f830-5a81-4f45-b18a-676e3cdd1edd None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:23.179480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179f830-5a81-4f45-b18a-676e3cdd1edd None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:23.179754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179f830-5a81-4f45-b18a-676e3cdd1edd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:23.187144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179f830-5a81-4f45-b18a-676e3cdd1edd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:23.188609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179f830-5a81-4f45-b18a-676e3cdd1edd None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-1179f830-5a81-4f45-b18a-676e3cdd1edd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:08:23.202602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:23.203557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:23.204621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:23.204621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:23.204621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:08:23.204621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:08:23.204621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:08:23.204621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:08:23.204621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:08:23.204621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:08:23.204621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:08:23.204621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:23.204621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 624/1267] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:08:23.209763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd27b66-7407-453d-bf80-e510a5641272 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:23.308153 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd27b66-7407-453d-bf80-e510a5641272 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:23.342833 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11c3e6-da27-4c75-9c52-712bb16ee026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:23.343508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11c3e6-da27-4c75-9c52-712bb16ee026 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:23.343792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11c3e6-da27-4c75-9c52-712bb16ee026 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:23.344096 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11c3e6-da27-4c75-9c52-712bb16ee026 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:23.344934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11c3e6-da27-4c75-9c52-712bb16ee026 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:23.345240 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11c3e6-da27-4c75-9c52-712bb16ee026 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:23.346705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11c3e6-da27-4c75-9c52-712bb16ee026 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:23.356904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:23.365755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 644/1268] 10.222.0.74 () {56 vars in 1143 bytes} [Thu Jul 14 10:08:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:23.371673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179f830-5a81-4f45-b18a-676e3cdd1edd None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:23.470313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179f830-5a81-4f45-b18a-676e3cdd1edd None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:23.502775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f33a8-5cd9-4d3c-b76e-8285b7869a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:23.503557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f33a8-5cd9-4d3c-b76e-8285b7869a76 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:23.503847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f33a8-5cd9-4d3c-b76e-8285b7869a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:23.504153 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f33a8-5cd9-4d3c-b76e-8285b7869a76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:23.514394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f33a8-5cd9-4d3c-b76e-8285b7869a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:23.515828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f33a8-5cd9-4d3c-b76e-8285b7869a76 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-9b7f33a8-5cd9-4d3c-b76e-8285b7869a76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:08:23.532783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:23.534096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:23.535247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:08:23.535247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:08:23.535247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:23.535247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:23.535247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 625/1269] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:23.540643 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11c3e6-da27-4c75-9c52-712bb16ee026 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:23.639698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11c3e6-da27-4c75-9c52-712bb16ee026 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:23.673258 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2561d08-a294-4955-9526-f894aba4b41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:23.673942 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2561d08-a294-4955-9526-f894aba4b41e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:23.678068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2561d08-a294-4955-9526-f894aba4b41e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:23.678068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2561d08-a294-4955-9526-f894aba4b41e None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:23.678068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2561d08-a294-4955-9526-f894aba4b41e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:23.678068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2561d08-a294-4955-9526-f894aba4b41e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:23.678068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2561d08-a294-4955-9526-f894aba4b41e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:23.688045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 645/1270] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:23.694326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f33a8-5cd9-4d3c-b76e-8285b7869a76 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:23.725913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:23.796129 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f33a8-5cd9-4d3c-b76e-8285b7869a76 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:23.828759 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949007b-dd27-4419-9133-0c2ca41f0a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:23.829549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949007b-dd27-4419-9133-0c2ca41f0a6a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:23.829833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949007b-dd27-4419-9133-0c2ca41f0a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:23.830113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949007b-dd27-4419-9133-0c2ca41f0a6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:23.837486 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949007b-dd27-4419-9133-0c2ca41f0a6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:23.838941 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949007b-dd27-4419-9133-0c2ca41f0a6a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-1949007b-dd27-4419-9133-0c2ca41f0a6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:08:23.853964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:23.855098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:23.856105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:08:23.856105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:08:23.856105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:08:23.856105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:08:23.856105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:08:23.856105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:08:23.856105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:08:23.856105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:23.856105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 626/1271] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:23.861118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2561d08-a294-4955-9526-f894aba4b41e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:23.920824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:23.961651 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2561d08-a294-4955-9526-f894aba4b41e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:23.995191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec37d8-bcec-45f0-bdbe-8df0598aa263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:23.995974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec37d8-bcec-45f0-bdbe-8df0598aa263 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:23.996289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec37d8-bcec-45f0-bdbe-8df0598aa263 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:23.996568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec37d8-bcec-45f0-bdbe-8df0598aa263 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:23.997380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec37d8-bcec-45f0-bdbe-8df0598aa263 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:23.997733 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec37d8-bcec-45f0-bdbe-8df0598aa263 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:23.999166 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec37d8-bcec-45f0-bdbe-8df0598aa263 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:24.012914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 646/1272] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:24.019029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949007b-dd27-4419-9133-0c2ca41f0a6a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:24.110398 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:24.119466 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949007b-dd27-4419-9133-0c2ca41f0a6a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:24.154036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236f0d1-4778-43a0-9f9b-6e63913af42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:24.154914 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236f0d1-4778-43a0-9f9b-6e63913af42f None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:24.155195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236f0d1-4778-43a0-9f9b-6e63913af42f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:24.155466 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236f0d1-4778-43a0-9f9b-6e63913af42f None admin] PATH_INFO: `/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/2784d36c16d343cc961a22d956ee30f2/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:24.157704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236f0d1-4778-43a0-9f9b-6e63913af42f None admin] RBAC: Authorizing `identity:create_grant(project_id=795b6593e7b74eeda9929aba07cbaa0e, user_id=2784d36c16d343cc961a22d956ee30f2, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:24.159483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236f0d1-4778-43a0-9f9b-6e63913af42f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:24.238725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 627/1273] 10.222.0.74 () {58 vars in 1439 bytes} [Thu Jul 14 10:08:24 2022] PUT /identity/v3/projects/795b6593e7b74eeda9929aba07cbaa0e/users/2784d36c16d343cc961a22d956ee30f2/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:08:26.219959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a8e21-df62-4e0c-8a7c-842bf161d3e4 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:26.220544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a8e21-df62-4e0c-8a7c-842bf161d3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:26.220544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a8e21-df62-4e0c-8a7c-842bf161d3e4 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:26.221922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 647/1274] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:08:26.227864 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee881440-e0db-4426-b7ae-f6b98d78efc8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:26.228306 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee881440-e0db-4426-b7ae-f6b98d78efc8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:26.228456 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee881440-e0db-4426-b7ae-f6b98d78efc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:26.245214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ee881440-e0db-4426-b7ae-f6b98d78efc8 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:08:26.246409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ee881440-e0db-4426-b7ae-f6b98d78efc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:08:26.312995 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 628/1275] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:08:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:08:26.337231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a8e21-df62-4e0c-8a7c-842bf161d3e4 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:26.437008 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a8e21-df62-4e0c-8a7c-842bf161d3e4 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:26.453491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:26.469901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28118d9-a676-4367-ad95-e73928f8e27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:26.470689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28118d9-a676-4367-ad95-e73928f8e27a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:26.470970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28118d9-a676-4367-ad95-e73928f8e27a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:26.471244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28118d9-a676-4367-ad95-e73928f8e27a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:26.481963 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28118d9-a676-4367-ad95-e73928f8e27a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c28118d9-a676-4367-ad95-e73928f8e27a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:08:26.489623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:26.490828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:26.491883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:26.491883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:26.491883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:26.491883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:26.491883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:08:26.491883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:08:26.491883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:08:26.491883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:08:26.491883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:08:26.491883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:08:26.491883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:08:26.491883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:26.491883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 648/1276] 10.222.0.74 () {56 vars in 1096 bytes} [Thu Jul 14 10:08:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:26.496955 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee881440-e0db-4426-b7ae-f6b98d78efc8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:26.577448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:26.595148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee881440-e0db-4426-b7ae-f6b98d78efc8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:26.628463 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd7999-0ddc-4f74-be49-122367bb731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:26.629128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd7999-0ddc-4f74-be49-122367bb731a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:26.629406 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd7999-0ddc-4f74-be49-122367bb731a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:26.629672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd7999-0ddc-4f74-be49-122367bb731a None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:26.630438 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd7999-0ddc-4f74-be49-122367bb731a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:26.630740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd7999-0ddc-4f74-be49-122367bb731a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:26.632110 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd7999-0ddc-4f74-be49-122367bb731a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:26.640104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 629/1277] 10.222.0.74 () {56 vars in 1099 bytes} [Thu Jul 14 10:08:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:26.645727 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28118d9-a676-4367-ad95-e73928f8e27a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:26.747108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28118d9-a676-4367-ad95-e73928f8e27a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:26.781017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e998aff-a031-4654-939a-0b1e33d99e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:26.781794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e998aff-a031-4654-939a-0b1e33d99e67 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:26.782070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e998aff-a031-4654-939a-0b1e33d99e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:26.782339 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e998aff-a031-4654-939a-0b1e33d99e67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:26.793005 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e998aff-a031-4654-939a-0b1e33d99e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:26.797706 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e998aff-a031-4654-939a-0b1e33d99e67 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-0e998aff-a031-4654-939a-0b1e33d99e67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:08:26.811396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:26.812503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:26.813586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:08:26.813586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:08:26.813586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:26.813586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:26.813586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 649/1278] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:26.818959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd7999-0ddc-4f74-be49-122367bb731a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:26.917943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd7999-0ddc-4f74-be49-122367bb731a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:26.950760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7bbfc-93ff-487d-ae0e-d84f0d80c5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:26.951466 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7bbfc-93ff-487d-ae0e-d84f0d80c5eb None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:26.951750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7bbfc-93ff-487d-ae0e-d84f0d80c5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:26.952046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7bbfc-93ff-487d-ae0e-d84f0d80c5eb None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:26.952769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7bbfc-93ff-487d-ae0e-d84f0d80c5eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:26.953076 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7bbfc-93ff-487d-ae0e-d84f0d80c5eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:26.954434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7bbfc-93ff-487d-ae0e-d84f0d80c5eb None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:26.966440 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 630/1279] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:26.972070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e998aff-a031-4654-939a-0b1e33d99e67 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:27.002223 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:27.070154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e998aff-a031-4654-939a-0b1e33d99e67 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:27.103691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4efff-ad65-4aca-a569-3fe61be593ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:27.104527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4efff-ad65-4aca-a569-3fe61be593ff None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:27.104825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4efff-ad65-4aca-a569-3fe61be593ff None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:27.105084 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4efff-ad65-4aca-a569-3fe61be593ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:27.112621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4efff-ad65-4aca-a569-3fe61be593ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:27.114098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4efff-ad65-4aca-a569-3fe61be593ff None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-32f4efff-ad65-4aca-a569-3fe61be593ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:08:27.128573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:27.129814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:27.131523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:27.131523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:27.131523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:08:27.131523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:08:27.131523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:08:27.131523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:08:27.131523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:08:27.131523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:08:27.131523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:08:27.131523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:27.131523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 650/1280] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:27.136222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7bbfc-93ff-487d-ae0e-d84f0d80c5eb None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:27.139938 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:27.232749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7bbfc-93ff-487d-ae0e-d84f0d80c5eb None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:27.266393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434f1fb-903d-4ec2-8ef9-825210bcdc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:27.267058 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f1fb-903d-4ec2-8ef9-825210bcdc6c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:27.267345 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f1fb-903d-4ec2-8ef9-825210bcdc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:27.267622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f1fb-903d-4ec2-8ef9-825210bcdc6c None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:27.268485 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434f1fb-903d-4ec2-8ef9-825210bcdc6c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:27.268798 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434f1fb-903d-4ec2-8ef9-825210bcdc6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:27.270228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434f1fb-903d-4ec2-8ef9-825210bcdc6c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:27.287771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 631/1281] 10.222.0.74 () {56 vars in 1143 bytes} [Thu Jul 14 10:08:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:27.293498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4efff-ad65-4aca-a569-3fe61be593ff None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:27.385419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:27.394764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4efff-ad65-4aca-a569-3fe61be593ff None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:27.427206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7ee45-1bb8-4655-a294-52ce643e4967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:27.428472 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ee45-1bb8-4655-a294-52ce643e4967 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:27.428755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ee45-1bb8-4655-a294-52ce643e4967 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:27.429030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ee45-1bb8-4655-a294-52ce643e4967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:27.498004 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7ee45-1bb8-4655-a294-52ce643e4967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:27.499379 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7ee45-1bb8-4655-a294-52ce643e4967 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:27.590965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:27.602044 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 651/1282] 10.222.0.74 () {58 vars in 1282 bytes} [Thu Jul 14 10:08:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:08:27.608444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434f1fb-903d-4ec2-8ef9-825210bcdc6c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:27.677414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:27.718496 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434f1fb-903d-4ec2-8ef9-825210bcdc6c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:27.757753 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfeff8-4ac9-440b-b0ad-dd25eff816ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:27.758489 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfeff8-4ac9-440b-b0ad-dd25eff816ad None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:27.758766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfeff8-4ac9-440b-b0ad-dd25eff816ad None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:27.759036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfeff8-4ac9-440b-b0ad-dd25eff816ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:27.770506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfeff8-4ac9-440b-b0ad-dd25eff816ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:27.772063 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfeff8-4ac9-440b-b0ad-dd25eff816ad None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-48bfeff8-4ac9-440b-b0ad-dd25eff816ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:08:27.792104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:27.793119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:27.794296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:08:27.794296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:08:27.794296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:08:27.794296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:27.794296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 632/1283] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:27.799429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7ee45-1bb8-4655-a294-52ce643e4967 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:27.904448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7ee45-1bb8-4655-a294-52ce643e4967 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:27.939478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c982576-a3b0-45df-9efc-6afffcce5389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:27.940227 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982576-a3b0-45df-9efc-6afffcce5389 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:27.940512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982576-a3b0-45df-9efc-6afffcce5389 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:27.940787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982576-a3b0-45df-9efc-6afffcce5389 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:27.941509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c982576-a3b0-45df-9efc-6afffcce5389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:27.941815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c982576-a3b0-45df-9efc-6afffcce5389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:27.943200 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c982576-a3b0-45df-9efc-6afffcce5389 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:27.954742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 652/1284] 10.222.0.74 () {56 vars in 1109 bytes} [Thu Jul 14 10:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:27.960890 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfeff8-4ac9-440b-b0ad-dd25eff816ad None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:28.072877 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfeff8-4ac9-440b-b0ad-dd25eff816ad None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:28.087096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:28.107055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b5fd0-5b41-4e96-b9a7-862a2f007070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:28.107844 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b5fd0-5b41-4e96-b9a7-862a2f007070 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:28.108164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b5fd0-5b41-4e96-b9a7-862a2f007070 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:28.108458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b5fd0-5b41-4e96-b9a7-862a2f007070 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:28.114887 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b5fd0-5b41-4e96-b9a7-862a2f007070 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:28.116387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b5fd0-5b41-4e96-b9a7-862a2f007070 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-4f1b5fd0-5b41-4e96-b9a7-862a2f007070 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:08:28.130137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:28.131189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:28.132503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:08:28.132503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:08:28.132503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:08:28.132503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:08:28.132503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:08:28.132503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:08:28.132503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:08:28.132503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Jul 14 10:08:28.132503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 633/1285] 10.222.0.74 () {56 vars in 1111 bytes} [Thu Jul 14 10:08:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:28.137364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c982576-a3b0-45df-9efc-6afffcce5389 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:28.187709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:28.236598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c982576-a3b0-45df-9efc-6afffcce5389 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:28.268596 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc69f5-8ff8-470b-a043-9797abc45edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:28.269251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc69f5-8ff8-470b-a043-9797abc45edf None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:28.269531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc69f5-8ff8-470b-a043-9797abc45edf None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:28.269802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc69f5-8ff8-470b-a043-9797abc45edf None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:28.270579 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc69f5-8ff8-470b-a043-9797abc45edf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:28.270885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc69f5-8ff8-470b-a043-9797abc45edf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:28.272925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc69f5-8ff8-470b-a043-9797abc45edf None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:28.284755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 653/1286] 10.222.0.74 () {56 vars in 1148 bytes} [Thu Jul 14 10:08:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:28.290901 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b5fd0-5b41-4e96-b9a7-862a2f007070 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:28.389542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b5fd0-5b41-4e96-b9a7-862a2f007070 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:28.423525 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df548d-6d79-4e50-988b-cb66acc4156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:28.424198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df548d-6d79-4e50-988b-cb66acc4156b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:28.424487 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df548d-6d79-4e50-988b-cb66acc4156b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:28.424757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df548d-6d79-4e50-988b-cb66acc4156b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:28.425575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df548d-6d79-4e50-988b-cb66acc4156b None admin] RBAC: Adding query filter params (role.id=7115f1ae20554afab761f71a2c30ba8d, scope.project.id=795b6593e7b74eeda9929aba07cbaa0e, user.id=2784d36c16d343cc961a22d956ee30f2) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:28.425880 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df548d-6d79-4e50-988b-cb66acc4156b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:28.427335 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df548d-6d79-4e50-988b-cb66acc4156b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:28.434497 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 634/1287] 10.222.0.74 () {56 vars in 1374 bytes} [Thu Jul 14 10:08:28 2022] GET /identity/v3/role_assignments?user.id=2784d36c16d343cc961a22d956ee30f2&scope.project.id=795b6593e7b74eeda9929aba07cbaa0e&role.id=7115f1ae20554afab761f71a2c30ba8d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:30.454303 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6555c2-4727-4376-96ba-7d11bce6dede None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:30.454882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6555c2-4727-4376-96ba-7d11bce6dede None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:30.454882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6555c2-4727-4376-96ba-7d11bce6dede None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:30.456266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 654/1288] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:08:30.461362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cdcb2-d52b-43e2-9633-b66db1aa081c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:30.461797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cdcb2-d52b-43e2-9633-b66db1aa081c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:30.461920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cdcb2-d52b-43e2-9633-b66db1aa081c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:30.478954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5c2cdcb2-d52b-43e2-9633-b66db1aa081c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:08:30.482903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5c2cdcb2-d52b-43e2-9633-b66db1aa081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:08:30.509931 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:30.545794 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 635/1289] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:08:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:08:30.567340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6555c2-4727-4376-96ba-7d11bce6dede None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:30.669352 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6555c2-4727-4376-96ba-7d11bce6dede None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:30.680177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:30.703457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780041f5-2778-40fd-8025-0954a5026ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:30.709979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780041f5-2778-40fd-8025-0954a5026ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:30.709979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780041f5-2778-40fd-8025-0954a5026ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:30.709979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780041f5-2778-40fd-8025-0954a5026ff9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:30.709979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780041f5-2778-40fd-8025-0954a5026ff9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:30.709979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780041f5-2778-40fd-8025-0954a5026ff9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-780041f5-2778-40fd-8025-0954a5026ff9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:30.719422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:30.720698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:30.721837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 655/1290] 10.222.0.74 () {56 vars in 1117 bytes} [Thu Jul 14 10:08:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:30.726801 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cdcb2-d52b-43e2-9633-b66db1aa081c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:30.826139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cdcb2-d52b-43e2-9633-b66db1aa081c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:30.860339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708cf29-90cb-42f9-8709-811f9a62f82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:30.860993 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708cf29-90cb-42f9-8709-811f9a62f82d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:30.861278 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708cf29-90cb-42f9-8709-811f9a62f82d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:30.861554 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708cf29-90cb-42f9-8709-811f9a62f82d None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:30.862257 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708cf29-90cb-42f9-8709-811f9a62f82d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:30.862562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708cf29-90cb-42f9-8709-811f9a62f82d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:30.863950 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708cf29-90cb-42f9-8709-811f9a62f82d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:30.869335 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 636/1291] 10.222.0.74 () {56 vars in 1116 bytes} [Thu Jul 14 10:08:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:30.874934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780041f5-2778-40fd-8025-0954a5026ff9 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:30.974676 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780041f5-2778-40fd-8025-0954a5026ff9 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:31.008179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8314f13-7456-439f-9e49-6ae14d2c1ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:31.008876 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8314f13-7456-439f-9e49-6ae14d2c1ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:31.009160 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8314f13-7456-439f-9e49-6ae14d2c1ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:31.009439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8314f13-7456-439f-9e49-6ae14d2c1ea2 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:31.010144 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8314f13-7456-439f-9e49-6ae14d2c1ea2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:31.010451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8314f13-7456-439f-9e49-6ae14d2c1ea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:31.011814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8314f13-7456-439f-9e49-6ae14d2c1ea2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:31.016393 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 656/1292] 10.222.0.74 () {56 vars in 1116 bytes} [Thu Jul 14 10:08:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:33.021140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd1ad-e332-429b-bf4b-e2906c2f1a55 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:33.021696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd1ad-e332-429b-bf4b-e2906c2f1a55 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:33.021696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd1ad-e332-429b-bf4b-e2906c2f1a55 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:33.023090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 637/1293] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:08:33.028437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1961ffc-ac18-4a03-a2d8-708d85cf6fd2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:33.028836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1961ffc-ac18-4a03-a2d8-708d85cf6fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:33.029000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1961ffc-ac18-4a03-a2d8-708d85cf6fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:33.046463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d1961ffc-ac18-4a03-a2d8-708d85cf6fd2 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:08:33.047667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d1961ffc-ac18-4a03-a2d8-708d85cf6fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:08:33.077848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:33.114370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 657/1294] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:08:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:08:33.137011 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfd1ad-e332-429b-bf4b-e2906c2f1a55 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:33.168900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:33.239034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfd1ad-e332-429b-bf4b-e2906c2f1a55 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:33.272945 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b354a-0ad0-434c-a977-e679a4e79b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:33.273537 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b354a-0ad0-434c-a977-e679a4e79b96 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:33.273819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b354a-0ad0-434c-a977-e679a4e79b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:33.274094 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b354a-0ad0-434c-a977-e679a4e79b96 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:33.274803 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b354a-0ad0-434c-a977-e679a4e79b96 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:33.276189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b354a-0ad0-434c-a977-e679a4e79b96 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:33.387143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 638/1295] 10.222.0.74 () {60 vars in 1141 bytes} [Thu Jul 14 10:08:33 2022] POST /identity/v3/services => generated 246 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:08:35.407614 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfa4a0-f7e0-4ec8-a29e-6a9dde57adbb None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:35.408172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfa4a0-f7e0-4ec8-a29e-6a9dde57adbb None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:35.408172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfa4a0-f7e0-4ec8-a29e-6a9dde57adbb None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:35.409813 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 658/1296] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:08:35.415103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b988-ac06-47da-a952-cfcd251e0c49 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:35.418105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b988-ac06-47da-a952-cfcd251e0c49 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:35.418105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b988-ac06-47da-a952-cfcd251e0c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:35.432992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5060b988-ac06-47da-a952-cfcd251e0c49 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:08:35.434180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5060b988-ac06-47da-a952-cfcd251e0c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:08:35.506885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 639/1297] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:08:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:08:35.529994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfa4a0-f7e0-4ec8-a29e-6a9dde57adbb None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:35.629773 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfa4a0-f7e0-4ec8-a29e-6a9dde57adbb None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:35.663141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a81b7-6c0d-4102-9a5f-b7129289d653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:35.663872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a81b7-6c0d-4102-9a5f-b7129289d653 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:35.664183 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a81b7-6c0d-4102-9a5f-b7129289d653 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:35.664455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a81b7-6c0d-4102-9a5f-b7129289d653 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:35.665096 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a81b7-6c0d-4102-9a5f-b7129289d653 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:35.666498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a81b7-6c0d-4102-9a5f-b7129289d653 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-5c6a81b7-6c0d-4102-9a5f-b7129289d653 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:35.678503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:35.679745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:35.680872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 659/1298] 10.222.0.74 () {56 vars in 1117 bytes} [Thu Jul 14 10:08:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:35.685954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060b988-ac06-47da-a952-cfcd251e0c49 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:35.704187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:35.784379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060b988-ac06-47da-a952-cfcd251e0c49 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:35.818433 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96668fa4-574f-4057-9e1c-722130da6b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:35.819096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96668fa4-574f-4057-9e1c-722130da6b74 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:35.819380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96668fa4-574f-4057-9e1c-722130da6b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:35.819654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96668fa4-574f-4057-9e1c-722130da6b74 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:35.820424 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96668fa4-574f-4057-9e1c-722130da6b74 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:35.820729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96668fa4-574f-4057-9e1c-722130da6b74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:35.822102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96668fa4-574f-4057-9e1c-722130da6b74 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:35.827254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 640/1299] 10.222.0.74 () {56 vars in 1116 bytes} [Thu Jul 14 10:08:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:35.833187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a81b7-6c0d-4102-9a5f-b7129289d653 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:35.864303 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:35.932647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a81b7-6c0d-4102-9a5f-b7129289d653 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:35.965134 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6fad9-e9d0-41f5-aefe-d2840bfc43e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:35.965792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6fad9-e9d0-41f5-aefe-d2840bfc43e5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:35.966074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6fad9-e9d0-41f5-aefe-d2840bfc43e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:35.966345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6fad9-e9d0-41f5-aefe-d2840bfc43e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:35.967130 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6fad9-e9d0-41f5-aefe-d2840bfc43e5 None admin] RBAC: Adding query filter params (interface=public, service_id=98856c8ee87d4d8c9db93002a050d367, region_id=RegionOne) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:35.967437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6fad9-e9d0-41f5-aefe-d2840bfc43e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:35.968868 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6fad9-e9d0-41f5-aefe-d2840bfc43e5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:35.973834 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 660/1300] 10.222.0.74 () {56 vars in 1251 bytes} [Thu Jul 14 10:08:35 2022] GET /identity/v3/endpoints?service_id=98856c8ee87d4d8c9db93002a050d367&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:35.979907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96668fa4-574f-4057-9e1c-722130da6b74 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:36.061911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:36.079549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96668fa4-574f-4057-9e1c-722130da6b74 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:36.114122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e6f13-da0e-4130-bcb7-2ad0966e9712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:36.114787 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e6f13-da0e-4130-bcb7-2ad0966e9712 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:36.115071 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e6f13-da0e-4130-bcb7-2ad0966e9712 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:36.115372 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e6f13-da0e-4130-bcb7-2ad0966e9712 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:36.116087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e6f13-da0e-4130-bcb7-2ad0966e9712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:36.117459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e6f13-da0e-4130-bcb7-2ad0966e9712 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:36.124338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 641/1301] 10.222.0.74 () {56 vars in 1087 bytes} [Thu Jul 14 10:08:35 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:08:38.196778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e625fb5-ac78-4d5d-82bc-a1dff8a36716 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:38.197435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e625fb5-ac78-4d5d-82bc-a1dff8a36716 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:38.197435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e625fb5-ac78-4d5d-82bc-a1dff8a36716 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:38.198719 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 661/1302] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:08:38.203953 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cfa47-6485-4cdd-afb9-e1329bb39874 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:38.204397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cfa47-6485-4cdd-afb9-e1329bb39874 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:38.204532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cfa47-6485-4cdd-afb9-e1329bb39874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:38.220812 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f15cfa47-6485-4cdd-afb9-e1329bb39874 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:08:38.222014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f15cfa47-6485-4cdd-afb9-e1329bb39874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:08:38.291344 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 642/1303] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:08:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:08:38.316425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e625fb5-ac78-4d5d-82bc-a1dff8a36716 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:38.408763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:38.416003 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e625fb5-ac78-4d5d-82bc-a1dff8a36716 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:38.449465 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156cc18-71a8-4c14-9254-192c23a5948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:38.450287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156cc18-71a8-4c14-9254-192c23a5948a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:38.450576 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156cc18-71a8-4c14-9254-192c23a5948a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:38.450845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156cc18-71a8-4c14-9254-192c23a5948a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:38.451492 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156cc18-71a8-4c14-9254-192c23a5948a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:38.452917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156cc18-71a8-4c14-9254-192c23a5948a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-2156cc18-71a8-4c14-9254-192c23a5948a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:08:38.465156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:08:38.466248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Jul 14 10:08:38.467116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 662/1304] 10.222.0.74 () {56 vars in 1117 bytes} [Thu Jul 14 10:08:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:08:38.472427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cfa47-6485-4cdd-afb9-e1329bb39874 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:38.548276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:38.570047 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cfa47-6485-4cdd-afb9-e1329bb39874 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:38.603924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac4c96-84cd-4f74-8667-8936d74747f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:38.604626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4c96-84cd-4f74-8667-8936d74747f0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:38.604904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4c96-84cd-4f74-8667-8936d74747f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:38.605183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4c96-84cd-4f74-8667-8936d74747f0 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:38.605887 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac4c96-84cd-4f74-8667-8936d74747f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:08:38.606279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac4c96-84cd-4f74-8667-8936d74747f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:38.607660 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac4c96-84cd-4f74-8667-8936d74747f0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:38.612871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 643/1305] 10.222.0.74 () {56 vars in 1116 bytes} [Thu Jul 14 10:08:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:08:38.618563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156cc18-71a8-4c14-9254-192c23a5948a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:38.716733 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156cc18-71a8-4c14-9254-192c23a5948a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:38.748943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253523e-4a80-4ac4-8194-7d8ffab78248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:38.749590 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253523e-4a80-4ac4-8194-7d8ffab78248 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:38.749872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253523e-4a80-4ac4-8194-7d8ffab78248 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:38.750146 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253523e-4a80-4ac4-8194-7d8ffab78248 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:38.750878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253523e-4a80-4ac4-8194-7d8ffab78248 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:38.752263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253523e-4a80-4ac4-8194-7d8ffab78248 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:38.839417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 663/1306] 10.222.0.74 () {60 vars in 1144 bytes} [Thu Jul 14 10:08:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:08:48.609838 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=30 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:48.834052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:10.305893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5d7d7-c754-4189-9817-41283ae97082 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:10.306481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5d7d7-c754-4189-9817-41283ae97082 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:10.306481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5d7d7-c754-4189-9817-41283ae97082 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:10.315979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698570-1290-4108-bd6e-4ca1eab28172 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:10.315979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698570-1290-4108-bd6e-4ca1eab28172 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:10.315979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698570-1290-4108-bd6e-4ca1eab28172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:10.317567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 644/1307] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:14:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:10.393031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f2698570-1290-4108-bd6e-4ca1eab28172 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:10.394289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f2698570-1290-4108-bd6e-4ca1eab28172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:10.512238 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 664/1308] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:14:10.554505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a965c-bd03-4c27-b456-76fa5eb83ceb None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:10.554917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a965c-bd03-4c27-b456-76fa5eb83ceb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:10.555473 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a965c-bd03-4c27-b456-76fa5eb83ceb None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:10.561306 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 645/1309] 10.222.0.74 () {54 vars in 964 bytes} [Thu Jul 14 10:14:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:10.574527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895322e8-b0e9-4e9d-9f8d-e9d562b06781 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:10.574527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895322e8-b0e9-4e9d-9f8d-e9d562b06781 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:10.574527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895322e8-b0e9-4e9d-9f8d-e9d562b06781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:10.709665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-895322e8-b0e9-4e9d-9f8d-e9d562b06781 None None] MFA Rules not processed for user `bf41e7a4968e4ab9bce98f6e1c050b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:10.711140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-895322e8-b0e9-4e9d-9f8d-e9d562b06781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:10.733209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:10.797812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 665/1310] 10.222.0.74 () {58 vars in 1061 bytes} [Thu Jul 14 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:10.807009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a965c-bd03-4c27-b456-76fa5eb83ceb None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:10.808856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ca7a965c-bd03-4c27-b456-76fa5eb83ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:10.929615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a965c-bd03-4c27-b456-76fa5eb83ceb None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:11.007606 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c788d-3112-42a1-a9e7-3dfe370633d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:11.008298 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c788d-3112-42a1-a9e7-3dfe370633d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:11.008582 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c788d-3112-42a1-a9e7-3dfe370633d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:11.008854 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c788d-3112-42a1-a9e7-3dfe370633d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:11.010548 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-929c788d-3112-42a1-a9e7-3dfe370633d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:11.074429 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:11.132926 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c788d-3112-42a1-a9e7-3dfe370633d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:11.134373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c788d-3112-42a1-a9e7-3dfe370633d0 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:11.154628 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 646/1311] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:13.481672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c81b1-a8a2-4de9-9db1-80ce4590943e None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:13.482235 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c81b1-a8a2-4de9-9db1-80ce4590943e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:13.482235 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c81b1-a8a2-4de9-9db1-80ce4590943e None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:13.483768 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 666/1312] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:13.488775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d7fe-a9ea-4fe8-8922-40af47c59db6 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:13.489175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d7fe-a9ea-4fe8-8922-40af47c59db6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:13.489334 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d7fe-a9ea-4fe8-8922-40af47c59db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:13.574050 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0584d7fe-a9ea-4fe8-8922-40af47c59db6 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:13.575577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0584d7fe-a9ea-4fe8-8922-40af47c59db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:13.685874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 647/1313] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:13.725731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c81b1-a8a2-4de9-9db1-80ce4590943e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:13.727419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0f5c81b1-a8a2-4de9-9db1-80ce4590943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:13.850127 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c81b1-a8a2-4de9-9db1-80ce4590943e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:13.925461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:13.928783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf67bf-a906-48f1-a7af-56b7a4041eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:13.929437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf67bf-a906-48f1-a7af-56b7a4041eeb service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:13.929722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf67bf-a906-48f1-a7af-56b7a4041eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:13.930000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf67bf-a906-48f1-a7af-56b7a4041eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:13.931730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-32bf67bf-a906-48f1-a7af-56b7a4041eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:14.050128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf67bf-a906-48f1-a7af-56b7a4041eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:14.052194 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf67bf-a906-48f1-a7af-56b7a4041eeb service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:14.074058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 667/1314] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:16.658494 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a9209-d249-4bd7-897b-eac7a97dfa83 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:16.659034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a9209-d249-4bd7-897b-eac7a97dfa83 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:16.659034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a9209-d249-4bd7-897b-eac7a97dfa83 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:16.660536 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 648/1315] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:16.665537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc174850-5a08-469d-971d-95559b12a154 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:16.665952 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc174850-5a08-469d-971d-95559b12a154 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:16.666102 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc174850-5a08-469d-971d-95559b12a154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:16.729896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-dc174850-5a08-469d-971d-95559b12a154 None None] MFA Rules not processed for user `b11eb85688a44fb992995321f605104f`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:16.731116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-dc174850-5a08-469d-971d-95559b12a154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:16.783036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:16.829370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 668/1316] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:14:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:16.868793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a9209-d249-4bd7-897b-eac7a97dfa83 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:16.870346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1f4a9209-d249-4bd7-897b-eac7a97dfa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:16.880742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:16.973534 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a9209-d249-4bd7-897b-eac7a97dfa83 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:17.045796 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e819d-ca60-4fb0-a37f-ac18cd43d990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:17.046386 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e819d-ca60-4fb0-a37f-ac18cd43d990 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:17.046671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e819d-ca60-4fb0-a37f-ac18cd43d990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:17.046945 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e819d-ca60-4fb0-a37f-ac18cd43d990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:17.048642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-de1e819d-ca60-4fb0-a37f-ac18cd43d990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:17.111030 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:17.157393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e819d-ca60-4fb0-a37f-ac18cd43d990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:17.158850 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e819d-ca60-4fb0-a37f-ac18cd43d990 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:17.177310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 649/1317] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:20.072880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145170d9-dcc9-4aec-b4f3-0a3da1716701 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.073373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145170d9-dcc9-4aec-b4f3-0a3da1716701 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.073479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145170d9-dcc9-4aec-b4f3-0a3da1716701 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.074796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 669/1318] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:20.080094 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc0bde-9551-479f-9db0-0a7c281fce21 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.080515 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc0bde-9551-479f-9db0-0a7c281fce21 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.080654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc0bde-9551-479f-9db0-0a7c281fce21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.143862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-cedc0bde-9551-479f-9db0-0a7c281fce21 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:20.145644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-cedc0bde-9551-479f-9db0-0a7c281fce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:20.240782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 650/1319] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:14:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:20.279490 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145170d9-dcc9-4aec-b4f3-0a3da1716701 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:20.281048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-145170d9-dcc9-4aec-b4f3-0a3da1716701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:20.381872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145170d9-dcc9-4aec-b4f3-0a3da1716701 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:20.453682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ca734-7887-44fe-8a37-565eea3cbb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:20.454330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ca734-7887-44fe-8a37-565eea3cbb28 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.454614 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ca734-7887-44fe-8a37-565eea3cbb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.454890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ca734-7887-44fe-8a37-565eea3cbb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.456627 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-513ca734-7887-44fe-8a37-565eea3cbb28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:20.464030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:20.564436 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ca734-7887-44fe-8a37-565eea3cbb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:20.565887 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ca734-7887-44fe-8a37-565eea3cbb28 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:20.584513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 670/1320] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:23.626369 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c3d0b-e032-449f-bddd-d7207419a293 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:23.627054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c3d0b-e032-449f-bddd-d7207419a293 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:23.627054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c3d0b-e032-449f-bddd-d7207419a293 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:23.628368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 651/1321] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:23.633502 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1ba0f-2625-40fe-875b-fd8f6d75af21 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:23.633952 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1ba0f-2625-40fe-875b-fd8f6d75af21 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:23.634065 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1ba0f-2625-40fe-875b-fd8f6d75af21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:23.701549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-61d1ba0f-2625-40fe-875b-fd8f6d75af21 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:23.702797 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-61d1ba0f-2625-40fe-875b-fd8f6d75af21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:23.766186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:23.809811 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 671/1322] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:23.846532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c3d0b-e032-449f-bddd-d7207419a293 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:23.848134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b84c3d0b-e032-449f-bddd-d7207419a293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:23.867613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:23.953666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c3d0b-e032-449f-bddd-d7207419a293 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:24.026673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae7182-ceba-45f4-b76e-8ce4355c2176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:24.027324 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae7182-ceba-45f4-b76e-8ce4355c2176 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:24.027616 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae7182-ceba-45f4-b76e-8ce4355c2176 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:24.027887 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae7182-ceba-45f4-b76e-8ce4355c2176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:24.029562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ceae7182-ceba-45f4-b76e-8ce4355c2176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:24.101792 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:24.139384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae7182-ceba-45f4-b76e-8ce4355c2176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:24.140961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae7182-ceba-45f4-b76e-8ce4355c2176 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:24.160467 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 652/1323] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:26.238546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa7aab-7f59-4570-b639-5f2fb8144225 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.239076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa7aab-7f59-4570-b639-5f2fb8144225 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.239076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa7aab-7f59-4570-b639-5f2fb8144225 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:26.240521 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 672/1324] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:26.245481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403424ab-a32c-4ece-b4ab-86464e5bf824 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.245917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403424ab-a32c-4ece-b4ab-86464e5bf824 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.246023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403424ab-a32c-4ece-b4ab-86464e5bf824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:26.309880 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-403424ab-a32c-4ece-b4ab-86464e5bf824 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:26.311088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-403424ab-a32c-4ece-b4ab-86464e5bf824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:26.408330 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 653/1325] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:26.444113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa7aab-7f59-4570-b639-5f2fb8144225 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:26.445682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2cfa7aab-7f59-4570-b639-5f2fb8144225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:26.552316 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa7aab-7f59-4570-b639-5f2fb8144225 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:26.631988 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640e6b1-3767-451b-95a5-877edf3cdaf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:26.632671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640e6b1-3767-451b-95a5-877edf3cdaf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.632959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640e6b1-3767-451b-95a5-877edf3cdaf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.633231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640e6b1-3767-451b-95a5-877edf3cdaf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:26.634880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e640e6b1-3767-451b-95a5-877edf3cdaf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:26.652414 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:26.746011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640e6b1-3767-451b-95a5-877edf3cdaf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:26.747584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640e6b1-3767-451b-95a5-877edf3cdaf2 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:26.773775 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 673/1326] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:28.854469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c62d5-8a7a-49a5-965e-0c4ca7148771 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:28.855042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c62d5-8a7a-49a5-965e-0c4ca7148771 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:28.855042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c62d5-8a7a-49a5-965e-0c4ca7148771 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:28.856501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 654/1327] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:28.861698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1573b-59b2-436b-a26b-542128bd86f0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:28.862714 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1573b-59b2-436b-a26b-542128bd86f0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:28.862888 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1573b-59b2-436b-a26b-542128bd86f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:28.930755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4ac1573b-59b2-436b-a26b-542128bd86f0 None None] MFA Rules not processed for user `b11eb85688a44fb992995321f605104f`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:28.931968 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4ac1573b-59b2-436b-a26b-542128bd86f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:29.009572 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:29.041488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 674/1328] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:14:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:29.093432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1328a-b25a-4674-ade7-3b738cf6a707 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:29.093716 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1328a-b25a-4674-ade7-3b738cf6a707 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:29.093989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1328a-b25a-4674-ade7-3b738cf6a707 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:29.095359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 655/1329] 10.222.0.74 () {54 vars in 964 bytes} [Thu Jul 14 10:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:29.101801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb59983-000f-4c95-90ce-c41df9225848 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:29.102166 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb59983-000f-4c95-90ce-c41df9225848 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:29.102545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb59983-000f-4c95-90ce-c41df9225848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:29.178694 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9fb59983-000f-4c95-90ce-c41df9225848 None None] MFA Rules not processed for user `bf41e7a4968e4ab9bce98f6e1c050b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:29.179890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9fb59983-000f-4c95-90ce-c41df9225848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:29.258895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 675/1330] 10.222.0.74 () {58 vars in 1061 bytes} [Thu Jul 14 10:14:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:29.267951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1328a-b25a-4674-ade7-3b738cf6a707 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:29.269581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f9f1328a-b25a-4674-ade7-3b738cf6a707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:29.300567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:29.387462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1328a-b25a-4674-ade7-3b738cf6a707 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:29.470524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67d2ae-e5cc-4c82-bd33-c088de73aef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:29.471214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67d2ae-e5cc-4c82-bd33-c088de73aef1 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:29.472069 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67d2ae-e5cc-4c82-bd33-c088de73aef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:29.472353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67d2ae-e5cc-4c82-bd33-c088de73aef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:29.474064 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2a67d2ae-e5cc-4c82-bd33-c088de73aef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:29.551199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:29.583087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67d2ae-e5cc-4c82-bd33-c088de73aef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:29.584616 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67d2ae-e5cc-4c82-bd33-c088de73aef1 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:29.604680 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 656/1331] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:32.439973 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b327806-9834-4577-b0a9-298b88aadd5e None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.440571 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b327806-9834-4577-b0a9-298b88aadd5e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.440571 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b327806-9834-4577-b0a9-298b88aadd5e None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.441922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 676/1332] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:32.447360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e29975-a53c-40f9-90a5-1a90b3390140 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.447770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e29975-a53c-40f9-90a5-1a90b3390140 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.447915 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e29975-a53c-40f9-90a5-1a90b3390140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.510994 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-14e29975-a53c-40f9-90a5-1a90b3390140 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:32.512211 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-14e29975-a53c-40f9-90a5-1a90b3390140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:32.605854 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 657/1333] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:32.641242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b327806-9834-4577-b0a9-298b88aadd5e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:32.643341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7b327806-9834-4577-b0a9-298b88aadd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:32.712310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:32.746498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b327806-9834-4577-b0a9-298b88aadd5e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:32.817932 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012533a1-4427-4cd0-ab37-d84554673a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:32.818573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012533a1-4427-4cd0-ab37-d84554673a01 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.818851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012533a1-4427-4cd0-ab37-d84554673a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.819120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012533a1-4427-4cd0-ab37-d84554673a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.820797 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-012533a1-4427-4cd0-ab37-d84554673a01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:32.926066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012533a1-4427-4cd0-ab37-d84554673a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:32.927484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012533a1-4427-4cd0-ab37-d84554673a01 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:32.937181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:32.945630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 677/1334] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:35.006124 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84055ce9-9a35-4fa2-9209-8d351d25c183 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:35.006730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84055ce9-9a35-4fa2-9209-8d351d25c183 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:35.006730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84055ce9-9a35-4fa2-9209-8d351d25c183 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:35.008099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 658/1335] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:35.013533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acf494-3542-4508-bc27-3fab44125a61 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:35.013956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acf494-3542-4508-bc27-3fab44125a61 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:35.014091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acf494-3542-4508-bc27-3fab44125a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:35.078628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-42acf494-3542-4508-bc27-3fab44125a61 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:35.079820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-42acf494-3542-4508-bc27-3fab44125a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:35.174397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 678/1336] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:35.214656 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84055ce9-9a35-4fa2-9209-8d351d25c183 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:35.216257 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-84055ce9-9a35-4fa2-9209-8d351d25c183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:35.256573 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:35.319981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84055ce9-9a35-4fa2-9209-8d351d25c183 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:35.392093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa10103-d6ca-4538-a755-ce5855c7169b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:35.393362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa10103-d6ca-4538-a755-ce5855c7169b service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:35.393642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa10103-d6ca-4538-a755-ce5855c7169b service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:35.393923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa10103-d6ca-4538-a755-ce5855c7169b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:35.395564 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-aaa10103-d6ca-4538-a755-ce5855c7169b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:35.477787 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:35.503046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa10103-d6ca-4538-a755-ce5855c7169b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:35.504502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa10103-d6ca-4538-a755-ce5855c7169b service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:35.522373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 659/1337] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:38.034373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04924ded-7f86-421e-a3e1-75d0fbbdd8e6 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:38.034940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04924ded-7f86-421e-a3e1-75d0fbbdd8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:38.034940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04924ded-7f86-421e-a3e1-75d0fbbdd8e6 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:38.036344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 679/1338] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:38.041710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92963b09-a246-4325-9dcc-8b4f4778a481 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:38.042140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92963b09-a246-4325-9dcc-8b4f4778a481 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:38.042264 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92963b09-a246-4325-9dcc-8b4f4778a481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:38.105985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-92963b09-a246-4325-9dcc-8b4f4778a481 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:38.107212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-92963b09-a246-4325-9dcc-8b4f4778a481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:38.201766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 660/1339] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:14:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:38.237325 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04924ded-7f86-421e-a3e1-75d0fbbdd8e6 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:38.238856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-04924ded-7f86-421e-a3e1-75d0fbbdd8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:38.315254 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:38.343483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04924ded-7f86-421e-a3e1-75d0fbbdd8e6 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:38.415519 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd16a8b-26cf-4605-9da6-4c08de02a838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:38.416201 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd16a8b-26cf-4605-9da6-4c08de02a838 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:38.416485 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd16a8b-26cf-4605-9da6-4c08de02a838 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:38.416764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd16a8b-26cf-4605-9da6-4c08de02a838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:38.418418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2dd16a8b-26cf-4605-9da6-4c08de02a838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:38.526312 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd16a8b-26cf-4605-9da6-4c08de02a838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:38.527751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd16a8b-26cf-4605-9da6-4c08de02a838 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:38.546029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 680/1340] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:42.811675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58892c-cdd5-42bb-a3ea-006db4eaa094 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:42.812187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58892c-cdd5-42bb-a3ea-006db4eaa094 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:42.812281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58892c-cdd5-42bb-a3ea-006db4eaa094 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:42.814156 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 661/1341] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:42.819620 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15cb4d-7f83-46c9-8282-7824859ae629 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:42.820087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15cb4d-7f83-46c9-8282-7824859ae629 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:42.820244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15cb4d-7f83-46c9-8282-7824859ae629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:42.824530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:42.887598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-5d15cb4d-7f83-46c9-8282-7824859ae629 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:42.888839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5d15cb4d-7f83-46c9-8282-7824859ae629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:42.992740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 681/1342] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:43.031142 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58892c-cdd5-42bb-a3ea-006db4eaa094 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:43.032743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ba58892c-cdd5-42bb-a3ea-006db4eaa094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:43.087261 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:43.143110 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58892c-cdd5-42bb-a3ea-006db4eaa094 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:43.214499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7bbb5-49c8-42ba-bae8-68c9a2477ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:43.215152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7bbb5-49c8-42ba-bae8-68c9a2477ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:43.215431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7bbb5-49c8-42ba-bae8-68c9a2477ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:43.215703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7bbb5-49c8-42ba-bae8-68c9a2477ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:43.217356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b0f7bbb5-49c8-42ba-bae8-68c9a2477ba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:43.311049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:43.326937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7bbb5-49c8-42ba-bae8-68c9a2477ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:43.328414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7bbb5-49c8-42ba-bae8-68c9a2477ba4 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:43.347067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 662/1343] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:14:46.526612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c5d4b-47c0-43e3-9d34-a92a450c1c2c None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:46.527149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c5d4b-47c0-43e3-9d34-a92a450c1c2c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:46.527149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c5d4b-47c0-43e3-9d34-a92a450c1c2c None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:46.528483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 682/1344] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:46.534604 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ee62f-4ffb-4a27-9988-9b9d22c51223 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:46.535379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ee62f-4ffb-4a27-9988-9b9d22c51223 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:46.535806 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ee62f-4ffb-4a27-9988-9b9d22c51223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:46.601139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-dc5ee62f-4ffb-4a27-9988-9b9d22c51223 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:46.602360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-dc5ee62f-4ffb-4a27-9988-9b9d22c51223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:46.698517 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 663/1345] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:14:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:46.735905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c5d4b-47c0-43e3-9d34-a92a450c1c2c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:46.737450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3a6c5d4b-47c0-43e3-9d34-a92a450c1c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:46.824316 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:46.841974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c5d4b-47c0-43e3-9d34-a92a450c1c2c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:46.923913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbe8ed-995e-4e67-ba8f-663c7d522202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:46.924601 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbe8ed-995e-4e67-ba8f-663c7d522202 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:46.924885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbe8ed-995e-4e67-ba8f-663c7d522202 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:46.925160 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbe8ed-995e-4e67-ba8f-663c7d522202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:46.926844 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e8dbe8ed-995e-4e67-ba8f-663c7d522202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:47.036719 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbe8ed-995e-4e67-ba8f-663c7d522202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:47.038176 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbe8ed-995e-4e67-ba8f-663c7d522202 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:47.058140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 683/1346] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:51.422664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22910c-442c-4859-a6c8-b03dc4f8db84 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:51.423212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22910c-442c-4859-a6c8-b03dc4f8db84 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:51.423212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22910c-442c-4859-a6c8-b03dc4f8db84 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:51.424611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 664/1347] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:14:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:51.430058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4d3cd-effa-4740-98d4-cf35c2e3c186 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:51.430503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4d3cd-effa-4740-98d4-cf35c2e3c186 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:51.430596 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4d3cd-effa-4740-98d4-cf35c2e3c186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:51.446363 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:51.501989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-32e4d3cd-effa-4740-98d4-cf35c2e3c186 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:51.503214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-32e4d3cd-effa-4740-98d4-cf35c2e3c186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:51.602688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 684/1348] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:51.641211 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22910c-442c-4859-a6c8-b03dc4f8db84 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:51.642742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3c22910c-442c-4859-a6c8-b03dc4f8db84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:51.701809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:51.748266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22910c-442c-4859-a6c8-b03dc4f8db84 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:51.819798 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996d2f7-ab6e-4c2b-a6b3-6f26a08aa038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:51.820402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996d2f7-ab6e-4c2b-a6b3-6f26a08aa038 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:51.820685 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996d2f7-ab6e-4c2b-a6b3-6f26a08aa038 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:51.820958 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996d2f7-ab6e-4c2b-a6b3-6f26a08aa038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:51.822588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0996d2f7-ab6e-4c2b-a6b3-6f26a08aa038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:51.926402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:51.930056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996d2f7-ab6e-4c2b-a6b3-6f26a08aa038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:51.931497 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996d2f7-ab6e-4c2b-a6b3-6f26a08aa038 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:51.949252 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 665/1349] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:56.845711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9759-2489-4fd5-a316-d2c54708f39e None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:56.846202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9759-2489-4fd5-a316-d2c54708f39e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:56.846298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9759-2489-4fd5-a316-d2c54708f39e None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:56.847788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 685/1350] 10.222.0.74 () {54 vars in 921 bytes} [Thu Jul 14 10:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:14:56.853060 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5daaa-340b-4106-8a45-c13f853e62d7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:56.853492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5daaa-340b-4106-8a45-c13f853e62d7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:56.853683 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5daaa-340b-4106-8a45-c13f853e62d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:56.975618 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1fa5daaa-340b-4106-8a45-c13f853e62d7 None None] MFA Rules not processed for user `2784d36c16d343cc961a22d956ee30f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:56.976893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1fa5daaa-340b-4106-8a45-c13f853e62d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:57.115905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 666/1351] 10.222.0.74 () {58 vars in 1018 bytes} [Thu Jul 14 10:14:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:01.291288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02ab10-33aa-4f11-bf0c-7410ecd03a55 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:01.291858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02ab10-33aa-4f11-bf0c-7410ecd03a55 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:01.291858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02ab10-33aa-4f11-bf0c-7410ecd03a55 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:01.293442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 686/1352] 10.222.0.74 () {54 vars in 921 bytes} [Thu Jul 14 10:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:01.298925 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00f7d0-42ee-45a2-8f93-c969cf3bcd96 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:01.299340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00f7d0-42ee-45a2-8f93-c969cf3bcd96 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:01.299483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00f7d0-42ee-45a2-8f93-c969cf3bcd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:01.359105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:01.384642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9b00f7d0-42ee-45a2-8f93-c969cf3bcd96 None None] MFA Rules not processed for user `2784d36c16d343cc961a22d956ee30f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:01.386137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9b00f7d0-42ee-45a2-8f93-c969cf3bcd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:01.511354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 667/1353] 10.222.0.74 () {58 vars in 1018 bytes} [Thu Jul 14 10:15:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:01.602696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=59 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:02.804964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e6f3f-e02b-4427-b893-c13d3fdb79a4 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:02.806045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e6f3f-e02b-4427-b893-c13d3fdb79a4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:02.806315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e6f3f-e02b-4427-b893-c13d3fdb79a4 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:02.807722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 687/1354] 10.222.0.74 () {54 vars in 921 bytes} [Thu Jul 14 10:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:02.813153 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e13c5-ac3c-47c9-9a67-b5aee46d103c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:02.813588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e13c5-ac3c-47c9-9a67-b5aee46d103c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:02.813691 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e13c5-ac3c-47c9-9a67-b5aee46d103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:02.887014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7a6e13c5-ac3c-47c9-9a67-b5aee46d103c None None] MFA Rules not processed for user `2784d36c16d343cc961a22d956ee30f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:02.888254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7a6e13c5-ac3c-47c9-9a67-b5aee46d103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:02.930927 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:02.995788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 668/1355] 10.222.0.74 () {58 vars in 1018 bytes} [Thu Jul 14 10:15:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:06.445364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a575519-9e38-4542-a75a-8ffca794eb4a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:06.446331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a575519-9e38-4542-a75a-8ffca794eb4a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:06.446832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a575519-9e38-4542-a75a-8ffca794eb4a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:06.448530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 688/1356] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:06.454874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4da49-452b-44bb-962b-5511abddb184 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:06.455366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4da49-452b-44bb-962b-5511abddb184 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:06.455472 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4da49-452b-44bb-962b-5511abddb184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:06.527970 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-fdf4da49-452b-44bb-962b-5511abddb184 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:06.529186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-fdf4da49-452b-44bb-962b-5511abddb184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:06.634752 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 669/1357] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:06.689871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecbf6e-79ae-4516-ac85-aa02ae7092db None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:06.690449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecbf6e-79ae-4516-ac85-aa02ae7092db None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:06.690960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecbf6e-79ae-4516-ac85-aa02ae7092db None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:06.692786 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 689/1358] 10.222.0.74 () {54 vars in 961 bytes} [Thu Jul 14 10:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:06.701286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409d522-6bfd-4264-a823-a74f0db85aa4 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:06.702513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409d522-6bfd-4264-a823-a74f0db85aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:06.707849 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409d522-6bfd-4264-a823-a74f0db85aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:06.720265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:06.786339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d409d522-6bfd-4264-a823-a74f0db85aa4 None None] MFA Rules not processed for user `2a0626754b40449ba2346d05c5c90a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:06.788079 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d409d522-6bfd-4264-a823-a74f0db85aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:06.914131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 670/1359] 10.222.0.74 () {58 vars in 1058 bytes} [Thu Jul 14 10:15:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:06.922408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecbf6e-79ae-4516-ac85-aa02ae7092db None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:06.923970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c2ecbf6e-79ae-4516-ac85-aa02ae7092db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:07.088788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecbf6e-79ae-4516-ac85-aa02ae7092db None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:07.180083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:07.221222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdda178-6fab-411d-855d-a126ae2e4627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:07.221879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdda178-6fab-411d-855d-a126ae2e4627 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:07.222150 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdda178-6fab-411d-855d-a126ae2e4627 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:07.222426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdda178-6fab-411d-855d-a126ae2e4627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:07.224331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-afdda178-6fab-411d-855d-a126ae2e4627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:07.324784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdda178-6fab-411d-855d-a126ae2e4627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:07.329229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdda178-6fab-411d-855d-a126ae2e4627 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:07.353213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 690/1360] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:09.605835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c37c7-410b-419e-837a-800232495655 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:09.606393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c37c7-410b-419e-837a-800232495655 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:09.606393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c37c7-410b-419e-837a-800232495655 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:09.607962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 671/1361] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:09.613132 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142e2b-0597-4a75-8fb0-c2a72abaa38f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:09.613605 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142e2b-0597-4a75-8fb0-c2a72abaa38f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:09.613690 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142e2b-0597-4a75-8fb0-c2a72abaa38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:09.681585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-71142e2b-0597-4a75-8fb0-c2a72abaa38f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:09.682785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-71142e2b-0597-4a75-8fb0-c2a72abaa38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:09.724463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:09.787187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 691/1362] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:09.834862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c37c7-410b-419e-837a-800232495655 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:09.836430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1d3c37c7-410b-419e-837a-800232495655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:09.914008 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:10.006369 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c37c7-410b-419e-837a-800232495655 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:10.152537 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a22ee-ab44-4e15-9ffd-aea12f1734ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:10.153199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a22ee-ab44-4e15-9ffd-aea12f1734ec service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:10.153483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a22ee-ab44-4e15-9ffd-aea12f1734ec service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:10.153952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a22ee-ab44-4e15-9ffd-aea12f1734ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:10.155661 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-fc5a22ee-ab44-4e15-9ffd-aea12f1734ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:10.180760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:10.253110 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a22ee-ab44-4e15-9ffd-aea12f1734ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:10.254855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a22ee-ab44-4e15-9ffd-aea12f1734ec service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:10.274410 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 672/1363] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:12.757322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564a6a4-6061-47db-9dec-9dbcec135075 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:12.758181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564a6a4-6061-47db-9dec-9dbcec135075 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:12.758463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564a6a4-6061-47db-9dec-9dbcec135075 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:12.759846 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 692/1364] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:12.765913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4400574-8e50-4d17-949f-306508fa2772 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:12.766342 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4400574-8e50-4d17-949f-306508fa2772 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:12.766493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4400574-8e50-4d17-949f-306508fa2772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:12.841234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a4400574-8e50-4d17-949f-306508fa2772 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:12.842730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a4400574-8e50-4d17-949f-306508fa2772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:12.944395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:12.946607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 673/1365] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:12.993106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35354ea7-947d-4462-9d0c-96b4bf2ca0cc None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:12.993760 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35354ea7-947d-4462-9d0c-96b4bf2ca0cc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:12.994111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35354ea7-947d-4462-9d0c-96b4bf2ca0cc None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:12.995559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 693/1366] 10.222.0.74 () {54 vars in 961 bytes} [Thu Jul 14 10:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:13.001906 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dad09-91e7-474a-b7ed-a05b26592059 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:13.002269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dad09-91e7-474a-b7ed-a05b26592059 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:13.002625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dad09-91e7-474a-b7ed-a05b26592059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:13.090645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6f3dad09-91e7-474a-b7ed-a05b26592059 None None] MFA Rules not processed for user `2a0626754b40449ba2346d05c5c90a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:13.091985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6f3dad09-91e7-474a-b7ed-a05b26592059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:13.224903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 674/1367] 10.222.0.74 () {58 vars in 1058 bytes} [Thu Jul 14 10:15:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:13.233722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35354ea7-947d-4462-9d0c-96b4bf2ca0cc None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:13.237798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-35354ea7-947d-4462-9d0c-96b4bf2ca0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:13.398319 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35354ea7-947d-4462-9d0c-96b4bf2ca0cc None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:13.420180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:13.518709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64858216-5186-48c6-b68d-eb4e8e3bb9d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:13.519359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858216-5186-48c6-b68d-eb4e8e3bb9d9 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:13.519636 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858216-5186-48c6-b68d-eb4e8e3bb9d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:13.519904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858216-5186-48c6-b68d-eb4e8e3bb9d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:13.521601 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-64858216-5186-48c6-b68d-eb4e8e3bb9d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:13.615793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64858216-5186-48c6-b68d-eb4e8e3bb9d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:13.617420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64858216-5186-48c6-b68d-eb4e8e3bb9d9 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:13.637720 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 694/1368] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:14.613039 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972db792-0e11-4aa9-a71a-6641b45a8442 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:14.613039 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972db792-0e11-4aa9-a71a-6641b45a8442 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:14.613039 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972db792-0e11-4aa9-a71a-6641b45a8442 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:14.614430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 675/1369] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:15:14.619571 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d0197-49ee-4b4d-9a33-a146e524f5c7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:14.619975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d0197-49ee-4b4d-9a33-a146e524f5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:14.620188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d0197-49ee-4b4d-9a33-a146e524f5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:14.652403 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:14.688252 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1b6d0197-49ee-4b4d-9a33-a146e524f5c7 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:14.689503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1b6d0197-49ee-4b4d-9a33-a146e524f5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:14.790841 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 695/1370] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:15.138978 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71388190-b336-4569-b1c2-c75877b11a82 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:15.139265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71388190-b336-4569-b1c2-c75877b11a82 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:15.139582 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71388190-b336-4569-b1c2-c75877b11a82 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:15.141239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 676/1371] 10.222.0.74 () {54 vars in 963 bytes} [Thu Jul 14 10:15:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:15.146461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dbaf9-4475-4425-9f75-4603008dbce0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:15.146748 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dbaf9-4475-4425-9f75-4603008dbce0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:15.147021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dbaf9-4475-4425-9f75-4603008dbce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:15.227780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-907dbaf9-4475-4425-9f75-4603008dbce0 None None] MFA Rules not processed for user `12abc4b2a8d348d992e0bb00a1218929`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:15.229314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-907dbaf9-4475-4425-9f75-4603008dbce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:15.279939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:15.311468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 696/1372] 10.222.0.74 () {58 vars in 1060 bytes} [Thu Jul 14 10:15:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:15.319500 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71388190-b336-4569-b1c2-c75877b11a82 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:15.321173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-71388190-b336-4569-b1c2-c75877b11a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:15.374852 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:15.434830 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71388190-b336-4569-b1c2-c75877b11a82 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:15.514196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68b561-ea73-4809-b151-f13f4807ad12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:15.514855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68b561-ea73-4809-b151-f13f4807ad12 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:15.515134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68b561-ea73-4809-b151-f13f4807ad12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:15.515409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68b561-ea73-4809-b151-f13f4807ad12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:15.517079 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-db68b561-ea73-4809-b151-f13f4807ad12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:15.620881 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:15.635716 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68b561-ea73-4809-b151-f13f4807ad12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:15.637209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68b561-ea73-4809-b151-f13f4807ad12 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:15.659562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 677/1373] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:15:15.859399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6357f-cf9e-4149-a864-9688f54e8480 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:15.859841 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6357f-cf9e-4149-a864-9688f54e8480 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:15.860132 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6357f-cf9e-4149-a864-9688f54e8480 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:15.861419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 697/1374] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:15.866675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db335-c334-4bdd-a76a-59122ddab584 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:15.867111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db335-c334-4bdd-a76a-59122ddab584 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:15.867280 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db335-c334-4bdd-a76a-59122ddab584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:15.935889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b33db335-c334-4bdd-a76a-59122ddab584 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:15.936940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b33db335-c334-4bdd-a76a-59122ddab584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:16.038619 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 678/1375] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:16.084060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6357f-cf9e-4149-a864-9688f54e8480 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:16.085794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-16f6357f-cf9e-4149-a864-9688f54e8480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:16.233727 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6357f-cf9e-4149-a864-9688f54e8480 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:16.286727 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:16.352352 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac5bc-822d-4765-9393-cc62e67ae2b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:16.353000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac5bc-822d-4765-9393-cc62e67ae2b9 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:16.353279 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac5bc-822d-4765-9393-cc62e67ae2b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:16.353549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac5bc-822d-4765-9393-cc62e67ae2b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:16.355174 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e6bac5bc-822d-4765-9393-cc62e67ae2b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:16.445487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bac5bc-822d-4765-9393-cc62e67ae2b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:16.447197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bac5bc-822d-4765-9393-cc62e67ae2b9 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:16.464977 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 698/1376] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:18.611946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4bee0-4b15-470d-bb8a-3ea37d481581 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:18.612553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4bee0-4b15-470d-bb8a-3ea37d481581 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:18.612553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4bee0-4b15-470d-bb8a-3ea37d481581 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:18.613896 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 679/1377] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:18.619282 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b896f7-9acf-4ff2-a75d-530cd27845f9 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:18.619693 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b896f7-9acf-4ff2-a75d-530cd27845f9 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:18.619845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b896f7-9acf-4ff2-a75d-530cd27845f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:18.691091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-17b896f7-9acf-4ff2-a75d-530cd27845f9 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:18.692332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-17b896f7-9acf-4ff2-a75d-530cd27845f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:18.699616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:18.812548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 699/1378] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:15:18.856556 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4bee0-4b15-470d-bb8a-3ea37d481581 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:18.858104 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7ce4bee0-4b15-470d-bb8a-3ea37d481581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:18.919727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:19.005882 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4bee0-4b15-470d-bb8a-3ea37d481581 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:19.139495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f84d9d-3687-4804-b3ef-b37df47fdf55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:19.140180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f84d9d-3687-4804-b3ef-b37df47fdf55 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:19.140467 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f84d9d-3687-4804-b3ef-b37df47fdf55 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:19.140743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f84d9d-3687-4804-b3ef-b37df47fdf55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:19.142402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-94f84d9d-3687-4804-b3ef-b37df47fdf55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:19.160551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:19.266146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f84d9d-3687-4804-b3ef-b37df47fdf55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:19.267693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f84d9d-3687-4804-b3ef-b37df47fdf55 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:19.293156 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 680/1379] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:21.487486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3105-7c7b-4662-9276-5aba71189e6d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:21.488082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3105-7c7b-4662-9276-5aba71189e6d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:21.488082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3105-7c7b-4662-9276-5aba71189e6d None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:21.489634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 700/1380] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:21.494531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c99b52-e702-4108-95a8-e9f29c446657 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:21.494944 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c99b52-e702-4108-95a8-e9f29c446657 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:21.495171 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c99b52-e702-4108-95a8-e9f29c446657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:21.561315 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a7c99b52-e702-4108-95a8-e9f29c446657 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:21.562501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a7c99b52-e702-4108-95a8-e9f29c446657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:21.660692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:21.668050 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 681/1381] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:21.712018 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b3105-7c7b-4662-9276-5aba71189e6d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:21.713598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6e0b3105-7c7b-4662-9276-5aba71189e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:21.850736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:21.861764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b3105-7c7b-4662-9276-5aba71189e6d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:21.977327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dedfe-0b14-48dc-9d51-a614d32eb649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:21.977986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dedfe-0b14-48dc-9d51-a614d32eb649 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:21.978271 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dedfe-0b14-48dc-9d51-a614d32eb649 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:21.978542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dedfe-0b14-48dc-9d51-a614d32eb649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:21.980223 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ed6dedfe-0b14-48dc-9d51-a614d32eb649 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:22.076303 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dedfe-0b14-48dc-9d51-a614d32eb649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:22.077993 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dedfe-0b14-48dc-9d51-a614d32eb649 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:22.089059 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:22.098394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 701/1382] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:24.600926 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa6ca3-4a29-4b99-9f43-2ffbdc5bf3eb None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:24.601550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa6ca3-4a29-4b99-9f43-2ffbdc5bf3eb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:24.601550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa6ca3-4a29-4b99-9f43-2ffbdc5bf3eb None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:24.602917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 682/1383] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:24.611731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca3a9-3c30-4284-96e3-f5cc3446029f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:24.612360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca3a9-3c30-4284-96e3-f5cc3446029f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:24.612360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca3a9-3c30-4284-96e3-f5cc3446029f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:24.685566 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a59ca3a9-3c30-4284-96e3-f5cc3446029f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:24.687205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a59ca3a9-3c30-4284-96e3-f5cc3446029f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:24.808053 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 702/1384] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:24.848643 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa6ca3-4a29-4b99-9f43-2ffbdc5bf3eb None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:24.850170 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bcaa6ca3-4a29-4b99-9f43-2ffbdc5bf3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:25.002081 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa6ca3-4a29-4b99-9f43-2ffbdc5bf3eb None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:25.077795 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:25.123487 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c2f21-d32f-49c3-a970-34469f7f999a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:25.124212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2f21-d32f-49c3-a970-34469f7f999a service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:25.124499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2f21-d32f-49c3-a970-34469f7f999a service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:25.124794 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2f21-d32f-49c3-a970-34469f7f999a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:25.126502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b29c2f21-d32f-49c3-a970-34469f7f999a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:25.220748 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c2f21-d32f-49c3-a970-34469f7f999a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:25.222352 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c2f21-d32f-49c3-a970-34469f7f999a service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:25.241285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 683/1385] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:27.405693 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4aeb0-4203-43e5-bffe-e02b5002d9c4 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:27.406383 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4aeb0-4203-43e5-bffe-e02b5002d9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:27.406383 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4aeb0-4203-43e5-bffe-e02b5002d9c4 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:27.407660 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 703/1386] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:27.413263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d14edf-9173-4bc5-bfcd-53e6c01de3ce None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:27.417078 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d14edf-9173-4bc5-bfcd-53e6c01de3ce None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:27.417078 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d14edf-9173-4bc5-bfcd-53e6c01de3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:27.496629 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-94d14edf-9173-4bc5-bfcd-53e6c01de3ce None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:27.498385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-94d14edf-9173-4bc5-bfcd-53e6c01de3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:27.541863 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:27.612306 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 684/1387] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:27.669172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4aeb0-4203-43e5-bffe-e02b5002d9c4 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:27.670798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fee4aeb0-4203-43e5-bffe-e02b5002d9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:27.765905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:27.846382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4aeb0-4203-43e5-bffe-e02b5002d9c4 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:27.973528 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc7052-5d42-48da-b990-df74e54f94a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:27.974311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc7052-5d42-48da-b990-df74e54f94a0 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:27.974671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc7052-5d42-48da-b990-df74e54f94a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:27.975010 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc7052-5d42-48da-b990-df74e54f94a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:27.977229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9adc7052-5d42-48da-b990-df74e54f94a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:28.025539 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:28.085610 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc7052-5d42-48da-b990-df74e54f94a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:28.088527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc7052-5d42-48da-b990-df74e54f94a0 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:28.109761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 704/1388] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:30.329162 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd57235-60fb-4eed-93be-bd3ef6be00ae None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:30.329689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd57235-60fb-4eed-93be-bd3ef6be00ae None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:30.329689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd57235-60fb-4eed-93be-bd3ef6be00ae None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:30.331043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 685/1389] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:30.336224 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79756e9-a052-40ad-9dc4-dadf08366092 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:30.336687 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79756e9-a052-40ad-9dc4-dadf08366092 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:30.336910 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79756e9-a052-40ad-9dc4-dadf08366092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:30.402624 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d79756e9-a052-40ad-9dc4-dadf08366092 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:30.403827 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d79756e9-a052-40ad-9dc4-dadf08366092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:30.501750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 705/1390] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:30.546730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd57235-60fb-4eed-93be-bd3ef6be00ae None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:30.548413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3cd57235-60fb-4eed-93be-bd3ef6be00ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:30.696823 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd57235-60fb-4eed-93be-bd3ef6be00ae None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:30.713566 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:30.812489 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b4b5e-f874-43e2-9484-5eb3e2ce9c26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:30.813149 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b4b5e-f874-43e2-9484-5eb3e2ce9c26 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:30.813436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b4b5e-f874-43e2-9484-5eb3e2ce9c26 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:30.813722 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b4b5e-f874-43e2-9484-5eb3e2ce9c26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:30.815374 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0c8b4b5e-f874-43e2-9484-5eb3e2ce9c26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:30.906330 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b4b5e-f874-43e2-9484-5eb3e2ce9c26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:30.907974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b4b5e-f874-43e2-9484-5eb3e2ce9c26 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:30.925908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 686/1391] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:31.168515 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e17b0a-bc50-4094-b4df-9a0312b7d49d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:31.168813 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e17b0a-bc50-4094-b4df-9a0312b7d49d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:31.169096 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e17b0a-bc50-4094-b4df-9a0312b7d49d None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:31.170547 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 706/1392] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:31.176586 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d38d3d-362f-419e-afe7-805e05bb348c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:31.176887 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d38d3d-362f-419e-afe7-805e05bb348c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:31.177168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d38d3d-362f-419e-afe7-805e05bb348c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:31.204769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:31.248401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-98d38d3d-362f-419e-afe7-805e05bb348c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:31.249652 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-98d38d3d-362f-419e-afe7-805e05bb348c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:31.346644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 687/1393] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:31.403591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c0ab7-5ca0-4921-aa82-9d731eaee3b8 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:31.404111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c0ab7-5ca0-4921-aa82-9d731eaee3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:31.404293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c0ab7-5ca0-4921-aa82-9d731eaee3b8 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:31.405560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 707/1394] 10.222.0.74 () {54 vars in 962 bytes} [Thu Jul 14 10:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:31.410811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f80573-117d-4672-ac78-0fba44ec6e15 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:31.411136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f80573-117d-4672-ac78-0fba44ec6e15 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:31.411419 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f80573-117d-4672-ac78-0fba44ec6e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:31.488224 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b2f80573-117d-4672-ac78-0fba44ec6e15 None None] MFA Rules not processed for user `397a66eb12254a65bf05bc9fff9a868e`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:31.489468 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b2f80573-117d-4672-ac78-0fba44ec6e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:31.531474 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:31.567224 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 688/1395] 10.222.0.74 () {58 vars in 1059 bytes} [Thu Jul 14 10:15:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:31.574756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c0ab7-5ca0-4921-aa82-9d731eaee3b8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:31.576300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-734c0ab7-5ca0-4921-aa82-9d731eaee3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:31.590354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:31.686062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c0ab7-5ca0-4921-aa82-9d731eaee3b8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:31.759308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4c010-9c99-492f-991b-dbd4a7528a2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397a66eb12254a65bf05bc9fff9a868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:31.759966 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4c010-9c99-492f-991b-dbd4a7528a2a service glance] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:31.760282 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4c010-9c99-492f-991b-dbd4a7528a2a service glance] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:31.760561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4c010-9c99-492f-991b-dbd4a7528a2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:31.762251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1dc4c010-9c99-492f-991b-dbd4a7528a2a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:31.830618 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:31.870767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4c010-9c99-492f-991b-dbd4a7528a2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:31.872790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4c010-9c99-492f-991b-dbd4a7528a2a service glance] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:31.891899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 708/1396] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:32.710256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca138f-a8b4-4391-80e2-833ee5eb62e4 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:32.711187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca138f-a8b4-4391-80e2-833ee5eb62e4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:32.711187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca138f-a8b4-4391-80e2-833ee5eb62e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:32.780551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-39ca138f-a8b4-4391-80e2-833ee5eb62e4 None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:32.781770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-39ca138f-a8b4-4391-80e2-833ee5eb62e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:32.868751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 689/1397] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:15:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:32.913123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f2c04-20ad-4a9a-b1a7-4fa71d849ad0 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:32.913628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f2c04-20ad-4a9a-b1a7-4fa71d849ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:32.913747 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f2c04-20ad-4a9a-b1a7-4fa71d849ad0 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:32.915133 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 709/1398] 10.222.0.74 () {54 vars in 942 bytes} [Thu Jul 14 10:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:32.921671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1a930-ec80-46ea-b0f6-dd246fd2bb6a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:32.921969 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1a930-ec80-46ea-b0f6-dd246fd2bb6a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:32.922271 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1a930-ec80-46ea-b0f6-dd246fd2bb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:32.991001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:32.998579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-bff1a930-ec80-46ea-b0f6-dd246fd2bb6a None None] MFA Rules not processed for user `323279b7ad0c418b848d6d7ae26ec5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:33.001375 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bff1a930-ec80-46ea-b0f6-dd246fd2bb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:33.107112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba2ab9-90bb-4154-acb9-5a3bf06fdde6 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:33.107395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba2ab9-90bb-4154-acb9-5a3bf06fdde6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:33.107674 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba2ab9-90bb-4154-acb9-5a3bf06fdde6 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:33.109057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 710/1399] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:33.112690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 690/1400] 10.222.0.74 () {58 vars in 1039 bytes} [Thu Jul 14 10:15:32 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:15:33.113730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca012-1dbb-455e-9dc6-ee698b56946b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:33.114017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca012-1dbb-455e-9dc6-ee698b56946b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:33.114472 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca012-1dbb-455e-9dc6-ee698b56946b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:33.122213 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1a930-ec80-46ea-b0f6-dd246fd2bb6a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:33.132204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1a930-ec80-46ea-b0f6-dd246fd2bb6a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:33.181317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c55ca012-1dbb-455e-9dc6-ee698b56946b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:33.182524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c55ca012-1dbb-455e-9dc6-ee698b56946b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:33.238853 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e351d6-884e-403c-a898-e2a177b51fb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:33.239536 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e351d6-884e-403c-a898-e2a177b51fb9 service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:33.239818 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e351d6-884e-403c-a898-e2a177b51fb9 service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:33.240128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e351d6-884e-403c-a898-e2a177b51fb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:33.241824 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-97e351d6-884e-403c-a898-e2a177b51fb9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:33.244332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:33.282150 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 711/1401] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:15:33.326263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ca012-1dbb-455e-9dc6-ee698b56946b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:33.327453 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c55ca012-1dbb-455e-9dc6-ee698b56946b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:33.328573 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e351d6-884e-403c-a898-e2a177b51fb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:33.330185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e351d6-884e-403c-a898-e2a177b51fb9 service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:33.338639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 691/1402] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:15:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 10:15:33.359786 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:33.447980 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ca012-1dbb-455e-9dc6-ee698b56946b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:33.561554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde05c2b-75c1-4f1d-99fe-e34cd15a1e9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:33.562216 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde05c2b-75c1-4f1d-99fe-e34cd15a1e9b service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:33.562504 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde05c2b-75c1-4f1d-99fe-e34cd15a1e9b service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:33.562779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde05c2b-75c1-4f1d-99fe-e34cd15a1e9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:33.564516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-dde05c2b-75c1-4f1d-99fe-e34cd15a1e9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:33.582919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:33.657210 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde05c2b-75c1-4f1d-99fe-e34cd15a1e9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:33.658815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde05c2b-75c1-4f1d-99fe-e34cd15a1e9b service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:33.676500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 712/1403] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:35.843495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08efcac-8b34-4779-8c26-2a43b30cdd37 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:35.844180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08efcac-8b34-4779-8c26-2a43b30cdd37 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:35.844180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08efcac-8b34-4779-8c26-2a43b30cdd37 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:35.845609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 692/1404] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:35.851608 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa89f8-2c09-413a-89aa-35147eab64aa None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:35.852177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa89f8-2c09-413a-89aa-35147eab64aa None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:35.852270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa89f8-2c09-413a-89aa-35147eab64aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:35.920293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9ffa89f8-2c09-413a-89aa-35147eab64aa None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:35.921540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9ffa89f8-2c09-413a-89aa-35147eab64aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:36.020842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:36.027626 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 713/1405] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:36.075251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08efcac-8b34-4779-8c26-2a43b30cdd37 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:36.076858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f08efcac-8b34-4779-8c26-2a43b30cdd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:36.234828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:36.237210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08efcac-8b34-4779-8c26-2a43b30cdd37 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:36.364124 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a15ae-8847-4b7c-a114-4b85b00a49bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:36.364786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a15ae-8847-4b7c-a114-4b85b00a49bd service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:36.365073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a15ae-8847-4b7c-a114-4b85b00a49bd service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:36.365356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a15ae-8847-4b7c-a114-4b85b00a49bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:36.366997 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ad0a15ae-8847-4b7c-a114-4b85b00a49bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:36.467589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a15ae-8847-4b7c-a114-4b85b00a49bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:36.469181 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a15ae-8847-4b7c-a114-4b85b00a49bd service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:36.488518 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 693/1406] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:38.686357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dbc86-040f-4e4a-81d9-1fbf70d92ee5 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:38.686933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dbc86-040f-4e4a-81d9-1fbf70d92ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:38.686933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dbc86-040f-4e4a-81d9-1fbf70d92ee5 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:38.688455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 714/1407] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:38.693557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678798d2-b3dc-4e0b-9015-8ef7aabdb25b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:38.694068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678798d2-b3dc-4e0b-9015-8ef7aabdb25b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:38.694177 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678798d2-b3dc-4e0b-9015-8ef7aabdb25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:38.697368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:38.767400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-678798d2-b3dc-4e0b-9015-8ef7aabdb25b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:38.768725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-678798d2-b3dc-4e0b-9015-8ef7aabdb25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:38.878846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 694/1408] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:38.922619 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dbc86-040f-4e4a-81d9-1fbf70d92ee5 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:38.924165 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-734dbc86-040f-4e4a-81d9-1fbf70d92ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:39.095491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dbc86-040f-4e4a-81d9-1fbf70d92ee5 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:39.170377 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:39.221306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1d4c8-11f8-49e8-bdd9-709753b84ebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:39.221985 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1d4c8-11f8-49e8-bdd9-709753b84ebe service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:39.222269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1d4c8-11f8-49e8-bdd9-709753b84ebe service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:39.222546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1d4c8-11f8-49e8-bdd9-709753b84ebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:39.224346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5ca1d4c8-11f8-49e8-bdd9-709753b84ebe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:39.350499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1d4c8-11f8-49e8-bdd9-709753b84ebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:39.350499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1d4c8-11f8-49e8-bdd9-709753b84ebe service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:39.374850 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 715/1409] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:48.876834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=64 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:49.368413 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=64 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:56.805098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c279-1861-43fe-a522-3924361e303f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:56.805686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c279-1861-43fe-a522-3924361e303f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:56.805686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c279-1861-43fe-a522-3924361e303f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:56.807009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 695/1410] 10.222.0.74 () {54 vars in 918 bytes} [Thu Jul 14 10:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:56.811957 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e53c11-3a91-48e8-91e3-b9e2c21e5e25 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:56.812381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e53c11-3a91-48e8-91e3-b9e2c21e5e25 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:56.812549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e53c11-3a91-48e8-91e3-b9e2c21e5e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:56.887173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b3e53c11-3a91-48e8-91e3-b9e2c21e5e25 None None] MFA Rules not processed for user `2784d36c16d343cc961a22d956ee30f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:56.888413 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b3e53c11-3a91-48e8-91e3-b9e2c21e5e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:56.993837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 716/1411] 10.222.0.74 () {58 vars in 1015 bytes} [Thu Jul 14 10:15:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:57.008498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5271c74-bad4-4183-8b1e-64e19e8d9d09 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:57.008788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5271c74-bad4-4183-8b1e-64e19e8d9d09 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:57.009068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5271c74-bad4-4183-8b1e-64e19e8d9d09 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:57.010435 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 696/1412] 10.222.0.74 () {54 vars in 918 bytes} [Thu Jul 14 10:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:57.015452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783fbc6-7585-41ce-bcad-fd8fab5d0fdf None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:57.015739 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783fbc6-7585-41ce-bcad-fd8fab5d0fdf None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:57.016032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783fbc6-7585-41ce-bcad-fd8fab5d0fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:57.087157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:57.090168 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4783fbc6-7585-41ce-bcad-fd8fab5d0fdf None None] MFA Rules not processed for user `2a0626754b40449ba2346d05c5c90a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:57.091384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4783fbc6-7585-41ce-bcad-fd8fab5d0fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:57.208405 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 717/1413] 10.222.0.74 () {58 vars in 1015 bytes} [Thu Jul 14 10:15:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:59.700891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22fe56-20a4-4128-aed0-f5fc27568a26 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:59.701461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22fe56-20a4-4128-aed0-f5fc27568a26 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:59.701461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22fe56-20a4-4128-aed0-f5fc27568a26 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:59.702850 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:15:59.707970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade62bb-ee30-4fbe-936a-4d303746e115 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:59.708414 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade62bb-ee30-4fbe-936a-4d303746e115 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:59.708556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade62bb-ee30-4fbe-936a-4d303746e115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:59.773047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3ade62bb-ee30-4fbe-936a-4d303746e115 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:59.774256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3ade62bb-ee30-4fbe-936a-4d303746e115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:59.830119 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:59.872866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:59.914941 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22fe56-20a4-4128-aed0-f5fc27568a26 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:59.916535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ab22fe56-20a4-4128-aed0-f5fc27568a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:00.061257 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22fe56-20a4-4128-aed0-f5fc27568a26 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:00.133066 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:00.172904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc5ef4-ec52-426a-9c8d-14d5926a932d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:00.173555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc5ef4-ec52-426a-9c8d-14d5926a932d service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:00.173840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc5ef4-ec52-426a-9c8d-14d5926a932d service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:00.174117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc5ef4-ec52-426a-9c8d-14d5926a932d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:00.175759 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4dfc5ef4-ec52-426a-9c8d-14d5926a932d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:00.263688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc5ef4-ec52-426a-9c8d-14d5926a932d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:00.265322 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc5ef4-ec52-426a-9c8d-14d5926a932d service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:00.283520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 698/1416] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:01.175883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd5716-cc40-4b04-a955-232bd149dc12 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:01.176460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd5716-cc40-4b04-a955-232bd149dc12 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:01.176460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd5716-cc40-4b04-a955-232bd149dc12 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:01.177841 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:01.182824 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baecd0-735b-4355-bd74-986183354b0b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:01.183882 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baecd0-735b-4355-bd74-986183354b0b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:01.183990 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baecd0-735b-4355-bd74-986183354b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:01.257405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d0baecd0-735b-4355-bd74-986183354b0b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:01.258641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d0baecd0-735b-4355-bd74-986183354b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:01.287217 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:01.358672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:01.508541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd5716-cc40-4b04-a955-232bd149dc12 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:01.510094 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fddd5716-cc40-4b04-a955-232bd149dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:01.656360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd5716-cc40-4b04-a955-232bd149dc12 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:01.694657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:01.767504 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6aefb-61f3-4967-8a00-b2bbf5be73b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:01.768184 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6aefb-61f3-4967-8a00-b2bbf5be73b5 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:01.768469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6aefb-61f3-4967-8a00-b2bbf5be73b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:01.768745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6aefb-61f3-4967-8a00-b2bbf5be73b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:01.770429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5dc6aefb-61f3-4967-8a00-b2bbf5be73b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:01.859032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6aefb-61f3-4967-8a00-b2bbf5be73b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:01.860676 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6aefb-61f3-4967-8a00-b2bbf5be73b5 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:01.879216 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 720/1419] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:02.755722 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76237680-a2f1-4d52-8247-64d9a0a29bb9 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:02.756340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76237680-a2f1-4d52-8247-64d9a0a29bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:02.756340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76237680-a2f1-4d52-8247-64d9a0a29bb9 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:02.757672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:02.762728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab155eb-1bd3-4996-9b0f-5758648acebd None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:02.763141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab155eb-1bd3-4996-9b0f-5758648acebd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:02.763314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab155eb-1bd3-4996-9b0f-5758648acebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:02.817227 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:02.838250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3ab155eb-1bd3-4996-9b0f-5758648acebd None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:02.839985 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3ab155eb-1bd3-4996-9b0f-5758648acebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:02.936405 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:03.086033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76237680-a2f1-4d52-8247-64d9a0a29bb9 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:03.087565 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-76237680-a2f1-4d52-8247-64d9a0a29bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:03.231328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76237680-a2f1-4d52-8247-64d9a0a29bb9 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:03.242995 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:03.343479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc85ffa-a367-4ec0-82e6-b9ca972e5df4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:03.344105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85ffa-a367-4ec0-82e6-b9ca972e5df4 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:03.344390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85ffa-a367-4ec0-82e6-b9ca972e5df4 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:03.344665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85ffa-a367-4ec0-82e6-b9ca972e5df4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:03.346307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8bc85ffa-a367-4ec0-82e6-b9ca972e5df4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:03.435436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc85ffa-a367-4ec0-82e6-b9ca972e5df4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:03.437057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc85ffa-a367-4ec0-82e6-b9ca972e5df4 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:03.455506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 701/1422] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:04.307885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b32a86-b19a-4104-89be-18e4d2ab3fb9 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:04.308946 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b32a86-b19a-4104-89be-18e4d2ab3fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:04.309124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b32a86-b19a-4104-89be-18e4d2ab3fb9 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:04.310594 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:16:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:04.315373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccd172-3d01-407b-905b-aa35764dde5a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:04.315796 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccd172-3d01-407b-905b-aa35764dde5a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:04.315929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccd172-3d01-407b-905b-aa35764dde5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:04.334943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:04.390019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-caccd172-3d01-407b-905b-aa35764dde5a None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:04.391227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-caccd172-3d01-407b-905b-aa35764dde5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:04.490451 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:04.641389 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b32a86-b19a-4104-89be-18e4d2ab3fb9 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:04.642938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b3b32a86-b19a-4104-89be-18e4d2ab3fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:04.751254 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:04.786503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b32a86-b19a-4104-89be-18e4d2ab3fb9 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:04.897709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd08d3-1a7a-4feb-8371-3b0906a85d49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:04.898282 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd08d3-1a7a-4feb-8371-3b0906a85d49 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:04.898582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd08d3-1a7a-4feb-8371-3b0906a85d49 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:04.898877 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd08d3-1a7a-4feb-8371-3b0906a85d49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:04.900565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-babd08d3-1a7a-4feb-8371-3b0906a85d49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:04.975172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:04.988904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd08d3-1a7a-4feb-8371-3b0906a85d49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:04.990531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd08d3-1a7a-4feb-8371-3b0906a85d49 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:05.008923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 723/1425] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:05.862729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bec5a-a923-462d-bf9f-f18b4d613655 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:05.863286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bec5a-a923-462d-bf9f-f18b4d613655 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:05.863286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bec5a-a923-462d-bf9f-f18b4d613655 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:05.864721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:05.869593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca603f18-4db4-4ce5-b25b-7eb4ab30ba5c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:05.870043 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca603f18-4db4-4ce5-b25b-7eb4ab30ba5c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:05.870143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca603f18-4db4-4ce5-b25b-7eb4ab30ba5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:05.944366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ca603f18-4db4-4ce5-b25b-7eb4ab30ba5c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:05.945571 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ca603f18-4db4-4ce5-b25b-7eb4ab30ba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:06.043840 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:06.193006 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bec5a-a923-462d-bf9f-f18b4d613655 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:06.194538 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a09bec5a-a923-462d-bf9f-f18b4d613655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:06.277039 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:06.337985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bec5a-a923-462d-bf9f-f18b4d613655 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:06.448523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6bfe4-0a32-4e77-8298-d5466743bbf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:06.449161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6bfe4-0a32-4e77-8298-d5466743bbf2 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:06.449440 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6bfe4-0a32-4e77-8298-d5466743bbf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:06.449711 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6bfe4-0a32-4e77-8298-d5466743bbf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:06.451324 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-94f6bfe4-0a32-4e77-8298-d5466743bbf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:06.498426 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:06.538903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6bfe4-0a32-4e77-8298-d5466743bbf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:06.540533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6bfe4-0a32-4e77-8298-d5466743bbf2 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:06.558707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 704/1428] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:07.474366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92f48-ae05-4d17-8af3-72f1d684f48d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:07.474936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92f48-ae05-4d17-8af3-72f1d684f48d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:07.474936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92f48-ae05-4d17-8af3-72f1d684f48d None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:07.476341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:07.481748 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc31316-dfc6-4bca-9c1b-081a4464348c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:07.482202 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc31316-dfc6-4bca-9c1b-081a4464348c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:07.482336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc31316-dfc6-4bca-9c1b-081a4464348c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:07.556717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8fc31316-dfc6-4bca-9c1b-081a4464348c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:07.557933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8fc31316-dfc6-4bca-9c1b-081a4464348c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:07.654782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:16:07.804512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b92f48-ae05-4d17-8af3-72f1d684f48d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:07.806067 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b4b92f48-ae05-4d17-8af3-72f1d684f48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:07.853924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:07.948609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b92f48-ae05-4d17-8af3-72f1d684f48d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:08.059678 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4ffd6-a572-45a3-ba08-95aea448323c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:08.060363 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4ffd6-a572-45a3-ba08-95aea448323c service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:08.060649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4ffd6-a572-45a3-ba08-95aea448323c service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:08.060919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4ffd6-a572-45a3-ba08-95aea448323c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:08.062563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a8d4ffd6-a572-45a3-ba08-95aea448323c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:08.069554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:08.151180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4ffd6-a572-45a3-ba08-95aea448323c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:08.153362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4ffd6-a572-45a3-ba08-95aea448323c service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:08.171546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 726/1431] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:09.040936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872cbb4-bc72-4375-b3ab-180ecbddad07 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:09.041493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872cbb4-bc72-4375-b3ab-180ecbddad07 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:09.041493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872cbb4-bc72-4375-b3ab-180ecbddad07 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:09.042906 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:09.048008 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deff471-900e-45e6-82d0-ca231af1a1f2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:09.048452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deff471-900e-45e6-82d0-ca231af1a1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:09.048569 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deff471-900e-45e6-82d0-ca231af1a1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:09.123565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0deff471-900e-45e6-82d0-ca231af1a1f2 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:09.124798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0deff471-900e-45e6-82d0-ca231af1a1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:09.192437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:09.220534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:09.372091 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872cbb4-bc72-4375-b3ab-180ecbddad07 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:09.373599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f872cbb4-bc72-4375-b3ab-180ecbddad07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:09.390998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:09.518230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872cbb4-bc72-4375-b3ab-180ecbddad07 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:09.606769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:09.632806 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fabfd4-43bf-4853-ad20-39f4bf80eec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:09.633465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fabfd4-43bf-4853-ad20-39f4bf80eec1 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:09.633750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fabfd4-43bf-4853-ad20-39f4bf80eec1 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:09.634027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fabfd4-43bf-4853-ad20-39f4bf80eec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:09.635693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-09fabfd4-43bf-4853-ad20-39f4bf80eec1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:09.724462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fabfd4-43bf-4853-ad20-39f4bf80eec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:09.726051 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fabfd4-43bf-4853-ad20-39f4bf80eec1 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:09.744635 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 707/1434] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:10.594725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fe3ca-81c1-4d13-a23d-1428e5f0ecce None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:10.595256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fe3ca-81c1-4d13-a23d-1428e5f0ecce None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:10.595382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fe3ca-81c1-4d13-a23d-1428e5f0ecce None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:10.596693 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:10.601715 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9bce8-f61f-4911-842d-c62d5ea2678e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:10.602134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9bce8-f61f-4911-842d-c62d5ea2678e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:10.602298 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9bce8-f61f-4911-842d-c62d5ea2678e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:10.677802 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-41a9bce8-f61f-4911-842d-c62d5ea2678e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:10.679042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-41a9bce8-f61f-4911-842d-c62d5ea2678e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:10.725200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:10.783593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:10.935003 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fe3ca-81c1-4d13-a23d-1428e5f0ecce None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:10.936503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3f7fe3ca-81c1-4d13-a23d-1428e5f0ecce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:11.080746 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fe3ca-81c1-4d13-a23d-1428e5f0ecce None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:11.133864 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:11.191635 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bb587-af12-4b78-94a6-dae8db47540e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:11.192267 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bb587-af12-4b78-94a6-dae8db47540e service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:11.192544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bb587-af12-4b78-94a6-dae8db47540e service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:11.192810 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bb587-af12-4b78-94a6-dae8db47540e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:11.194443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-462bb587-af12-4b78-94a6-dae8db47540e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:11.282053 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bb587-af12-4b78-94a6-dae8db47540e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:11.283654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bb587-af12-4b78-94a6-dae8db47540e service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:11.301117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 729/1437] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:12.163885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee5960-3764-42da-8cef-dfac67ef4262 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:12.164324 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee5960-3764-42da-8cef-dfac67ef4262 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:12.164473 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee5960-3764-42da-8cef-dfac67ef4262 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:12.165946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:12.170989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a4bfb-427b-4fc2-827d-91c7ea0a454b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:12.171449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a4bfb-427b-4fc2-827d-91c7ea0a454b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:12.171555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a4bfb-427b-4fc2-827d-91c7ea0a454b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:12.247364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d78a4bfb-427b-4fc2-827d-91c7ea0a454b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:12.248620 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d78a4bfb-427b-4fc2-827d-91c7ea0a454b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:12.250776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:12.344918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:12.497410 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee5960-3764-42da-8cef-dfac67ef4262 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:12.499034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a3ee5960-3764-42da-8cef-dfac67ef4262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:12.647046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee5960-3764-42da-8cef-dfac67ef4262 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:12.673773 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:12.759294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc99e62-6214-4c8b-8dea-a97c5bc34c2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:12.759953 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc99e62-6214-4c8b-8dea-a97c5bc34c2b service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:12.760268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc99e62-6214-4c8b-8dea-a97c5bc34c2b service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:12.760546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc99e62-6214-4c8b-8dea-a97c5bc34c2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:12.762836 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4fc99e62-6214-4c8b-8dea-a97c5bc34c2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:12.850412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc99e62-6214-4c8b-8dea-a97c5bc34c2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:12.852120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc99e62-6214-4c8b-8dea-a97c5bc34c2b service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:12.870144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 710/1440] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:14.803914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9621f78-6a17-491d-a8db-735c3401c094 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:14.804503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9621f78-6a17-491d-a8db-735c3401c094 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:14.804503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9621f78-6a17-491d-a8db-735c3401c094 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:14.805922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:14.811742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c31f4b-d47a-4f94-b1e6-79394ae2db78 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:14.812223 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c31f4b-d47a-4f94-b1e6-79394ae2db78 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:14.812332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c31f4b-d47a-4f94-b1e6-79394ae2db78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:14.851601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:14.876698 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-72c31f4b-d47a-4f94-b1e6-79394ae2db78 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:14.877921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-72c31f4b-d47a-4f94-b1e6-79394ae2db78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:14.974783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:15.013595 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9621f78-6a17-491d-a8db-735c3401c094 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:15.015119 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e9621f78-6a17-491d-a8db-735c3401c094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:15.119268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9621f78-6a17-491d-a8db-735c3401c094 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:15.152278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:15.194823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3050af3-1ffb-4ea0-9314-96174f70c5de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:15.195473 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3050af3-1ffb-4ea0-9314-96174f70c5de service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:15.195755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3050af3-1ffb-4ea0-9314-96174f70c5de service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:15.196115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3050af3-1ffb-4ea0-9314-96174f70c5de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:15.197693 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c3050af3-1ffb-4ea0-9314-96174f70c5de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:15.304543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3050af3-1ffb-4ea0-9314-96174f70c5de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:15.305995 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3050af3-1ffb-4ea0-9314-96174f70c5de service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:15.324822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 732/1443] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:17.481348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d118e17-38b2-4af8-a5d3-88534fbdc41a None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:17.481911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d118e17-38b2-4af8-a5d3-88534fbdc41a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:17.481911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d118e17-38b2-4af8-a5d3-88534fbdc41a None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:17.483281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:17.488557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635ea97-9b68-4f25-affb-a5ed50cac12d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:17.488965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635ea97-9b68-4f25-affb-a5ed50cac12d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:17.489110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635ea97-9b68-4f25-affb-a5ed50cac12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:17.553769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1635ea97-9b68-4f25-affb-a5ed50cac12d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:17.554991 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1635ea97-9b68-4f25-affb-a5ed50cac12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:17.568493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:17.653476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:17.691702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d118e17-38b2-4af8-a5d3-88534fbdc41a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:17.693290 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1d118e17-38b2-4af8-a5d3-88534fbdc41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:17.794924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d118e17-38b2-4af8-a5d3-88534fbdc41a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:17.806730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:17.867493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ab2b3-154b-4b98-a3a1-0289b1cf225f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:17.868170 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ab2b3-154b-4b98-a3a1-0289b1cf225f service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:17.868455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ab2b3-154b-4b98-a3a1-0289b1cf225f service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:17.868729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ab2b3-154b-4b98-a3a1-0289b1cf225f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:17.870363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4f7ab2b3-154b-4b98-a3a1-0289b1cf225f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:17.977654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ab2b3-154b-4b98-a3a1-0289b1cf225f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:17.979092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ab2b3-154b-4b98-a3a1-0289b1cf225f service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:17.997473 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 713/1446] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:20.429725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4007dc-b34b-41b8-a654-f7eca3825b62 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:20.430328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4007dc-b34b-41b8-a654-f7eca3825b62 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:20.430328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4007dc-b34b-41b8-a654-f7eca3825b62 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:20.431824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:20.437957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30817efb-26b4-481b-af4d-cd085a65bafc None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:20.438380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30817efb-26b4-481b-af4d-cd085a65bafc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:20.438501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30817efb-26b4-481b-af4d-cd085a65bafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:20.485306 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:20.502934 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-30817efb-26b4-481b-af4d-cd085a65bafc None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:20.504452 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-30817efb-26b4-481b-af4d-cd085a65bafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:20.600125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:20.639960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4007dc-b34b-41b8-a654-f7eca3825b62 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:20.641549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fc4007dc-b34b-41b8-a654-f7eca3825b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:20.747004 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4007dc-b34b-41b8-a654-f7eca3825b62 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:20.787440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:20.820958 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b3d1f-86ab-4319-b47e-aefa9d8f51e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:20.821609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b3d1f-86ab-4319-b47e-aefa9d8f51e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:20.821890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b3d1f-86ab-4319-b47e-aefa9d8f51e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:20.822160 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b3d1f-86ab-4319-b47e-aefa9d8f51e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:20.824421 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-514b3d1f-86ab-4319-b47e-aefa9d8f51e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:20.930293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b3d1f-86ab-4319-b47e-aefa9d8f51e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:20.931753 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b3d1f-86ab-4319-b47e-aefa9d8f51e3 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:20.950982 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 735/1449] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:23.100832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fcedf-8994-4809-836e-9f6b902748ac None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:23.101353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fcedf-8994-4809-836e-9f6b902748ac None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:23.101453 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fcedf-8994-4809-836e-9f6b902748ac None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:23.102785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:23.108732 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3d082-6cb3-486b-8b3e-100b10c77d1b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:23.109166 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3d082-6cb3-486b-8b3e-100b10c77d1b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:23.109275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3d082-6cb3-486b-8b3e-100b10c77d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:23.174197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1cf3d082-6cb3-486b-8b3e-100b10c77d1b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:23.175409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1cf3d082-6cb3-486b-8b3e-100b10c77d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:23.196311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:23.273887 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:23.313210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fcedf-8994-4809-836e-9f6b902748ac None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:23.314695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b34fcedf-8994-4809-836e-9f6b902748ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:23.419912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fcedf-8994-4809-836e-9f6b902748ac None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:23.439909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:23.493505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a51588-297c-4375-8fed-c724baf877bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:23.494180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a51588-297c-4375-8fed-c724baf877bc service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:23.494466 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a51588-297c-4375-8fed-c724baf877bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:23.494742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a51588-297c-4375-8fed-c724baf877bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:23.496532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-28a51588-297c-4375-8fed-c724baf877bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:23.605364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a51588-297c-4375-8fed-c724baf877bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:23.606816 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a51588-297c-4375-8fed-c724baf877bc service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:23.624624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 716/1452] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:25.764316 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408ea44-947c-41be-b430-a99e1c2f4a36 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:25.764861 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408ea44-947c-41be-b430-a99e1c2f4a36 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:25.764861 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408ea44-947c-41be-b430-a99e1c2f4a36 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:25.766225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:25.771414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9eea-8d55-4dbb-960e-8bd0a4309307 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:25.771822 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9eea-8d55-4dbb-960e-8bd0a4309307 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:25.771970 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9eea-8d55-4dbb-960e-8bd0a4309307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:25.833539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:25.836243 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-28ce9eea-8d55-4dbb-960e-8bd0a4309307 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:25.837459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-28ce9eea-8d55-4dbb-960e-8bd0a4309307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:25.936652 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:25.973960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408ea44-947c-41be-b430-a99e1c2f4a36 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:25.975531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d408ea44-947c-41be-b430-a99e1c2f4a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:26.078001 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408ea44-947c-41be-b430-a99e1c2f4a36 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:26.126213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:26.150508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f193349-39d6-41e7-84d5-8bef77f9a022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:26.151154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f193349-39d6-41e7-84d5-8bef77f9a022 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:26.151941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f193349-39d6-41e7-84d5-8bef77f9a022 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:26.152240 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f193349-39d6-41e7-84d5-8bef77f9a022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:26.153858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0f193349-39d6-41e7-84d5-8bef77f9a022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:26.263336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f193349-39d6-41e7-84d5-8bef77f9a022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:26.264854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f193349-39d6-41e7-84d5-8bef77f9a022 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:26.283974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 738/1455] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:28.353995 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de6027-51bd-4318-92cd-b45e798c25ee None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:28.354560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de6027-51bd-4318-92cd-b45e798c25ee None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:28.354560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de6027-51bd-4318-92cd-b45e798c25ee None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:28.355969 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:28.361320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3083adf-105d-4fc1-8478-9ccb12553539 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:28.361733 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3083adf-105d-4fc1-8478-9ccb12553539 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:28.361865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3083adf-105d-4fc1-8478-9ccb12553539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:28.426800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c3083adf-105d-4fc1-8478-9ccb12553539 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:28.428037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c3083adf-105d-4fc1-8478-9ccb12553539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:28.457919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:28.526738 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:28.564591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de6027-51bd-4318-92cd-b45e798c25ee None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:28.566129 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-31de6027-51bd-4318-92cd-b45e798c25ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:28.669858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de6027-51bd-4318-92cd-b45e798c25ee None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:28.697943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:28.743981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acffec-b59e-4765-ae29-58b1237ce90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:28.744659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acffec-b59e-4765-ae29-58b1237ce90b service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:28.745047 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acffec-b59e-4765-ae29-58b1237ce90b service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:28.745866 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acffec-b59e-4765-ae29-58b1237ce90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:28.747506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-95acffec-b59e-4765-ae29-58b1237ce90b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:28.851814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acffec-b59e-4765-ae29-58b1237ce90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:28.853269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acffec-b59e-4765-ae29-58b1237ce90b service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:28.872570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 719/1458] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:30.954724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3e0a6-d911-442a-8354-0d0310a4ab32 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:30.955299 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3e0a6-d911-442a-8354-0d0310a4ab32 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:30.955299 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3e0a6-d911-442a-8354-0d0310a4ab32 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:30.956692 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:30.961917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398d57b-0935-4607-8655-79adb7b08f4b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:30.962344 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398d57b-0935-4607-8655-79adb7b08f4b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:30.962479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398d57b-0935-4607-8655-79adb7b08f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:31.027136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e398d57b-0935-4607-8655-79adb7b08f4b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:31.028386 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e398d57b-0935-4607-8655-79adb7b08f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:31.036553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:31.124601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:31.162289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3e0a6-d911-442a-8354-0d0310a4ab32 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:31.163844 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f8b3e0a6-d911-442a-8354-0d0310a4ab32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:31.266889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3e0a6-d911-442a-8354-0d0310a4ab32 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:31.321113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:31.339833 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc3b6c-a128-4104-88f5-91cd9c379ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:31.340516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc3b6c-a128-4104-88f5-91cd9c379ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:31.340800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc3b6c-a128-4104-88f5-91cd9c379ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:31.341073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc3b6c-a128-4104-88f5-91cd9c379ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:31.342715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b8bc3b6c-a128-4104-88f5-91cd9c379ee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:31.450058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc3b6c-a128-4104-88f5-91cd9c379ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:31.451517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc3b6c-a128-4104-88f5-91cd9c379ee1 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:31.469732 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 741/1461] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:33.557425 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057c5a1-ab22-481d-8722-bb36fe2044ca None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:33.557998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057c5a1-ab22-481d-8722-bb36fe2044ca None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:33.557998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057c5a1-ab22-481d-8722-bb36fe2044ca None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:33.559378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:33.564828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d320c54-9cbc-4717-adf5-112ca68d68e1 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:33.565239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d320c54-9cbc-4717-adf5-112ca68d68e1 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:33.565382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d320c54-9cbc-4717-adf5-112ca68d68e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:33.629546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2d320c54-9cbc-4717-adf5-112ca68d68e1 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:33.630797 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2d320c54-9cbc-4717-adf5-112ca68d68e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:33.668926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:33.726397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:33.763919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057c5a1-ab22-481d-8722-bb36fe2044ca None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:33.765523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1057c5a1-ab22-481d-8722-bb36fe2044ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:33.869365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057c5a1-ab22-481d-8722-bb36fe2044ca None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:33.907572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:33.943121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e687c9-1012-464e-a23d-738e0d1f7345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:33.943776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e687c9-1012-464e-a23d-738e0d1f7345 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:33.944087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e687c9-1012-464e-a23d-738e0d1f7345 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:33.944365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e687c9-1012-464e-a23d-738e0d1f7345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:33.946019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-69e687c9-1012-464e-a23d-738e0d1f7345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:34.054549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e687c9-1012-464e-a23d-738e0d1f7345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:34.056046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e687c9-1012-464e-a23d-738e0d1f7345 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:34.074560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 722/1464] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:36.127113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98972c-eec8-4d79-98d8-3f370a54226e None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:36.127657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98972c-eec8-4d79-98d8-3f370a54226e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:36.127657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98972c-eec8-4d79-98d8-3f370a54226e None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:36.129379 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:36.134707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679a526-30b2-4cd5-81f8-d08034b93724 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:36.135110 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679a526-30b2-4cd5-81f8-d08034b93724 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:36.135297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679a526-30b2-4cd5-81f8-d08034b93724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:36.201118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b679a526-30b2-4cd5-81f8-d08034b93724 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:36.202348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b679a526-30b2-4cd5-81f8-d08034b93724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:36.220937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:36.298931 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:36.335850 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98972c-eec8-4d79-98d8-3f370a54226e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:36.337423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7a98972c-eec8-4d79-98d8-3f370a54226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:36.443109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98972c-eec8-4d79-98d8-3f370a54226e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:36.509254 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:36.515645 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b7d51-7bae-40d8-bac2-9c6314dda55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:36.516323 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b7d51-7bae-40d8-bac2-9c6314dda55c service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:36.516609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b7d51-7bae-40d8-bac2-9c6314dda55c service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:36.516888 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b7d51-7bae-40d8-bac2-9c6314dda55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:36.518549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8b4b7d51-7bae-40d8-bac2-9c6314dda55c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:36.626554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b7d51-7bae-40d8-bac2-9c6314dda55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:36.628020 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b7d51-7bae-40d8-bac2-9c6314dda55c service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:36.645730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 744/1467] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:38.679987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789972de-cc08-4679-9fc2-17b04c32d5db None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:38.680653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789972de-cc08-4679-9fc2-17b04c32d5db None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:38.680653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789972de-cc08-4679-9fc2-17b04c32d5db None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:38.681949 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:38.687798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5be60-5464-463a-beaa-309cd184b133 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:38.688228 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5be60-5464-463a-beaa-309cd184b133 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:38.688398 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5be60-5464-463a-beaa-309cd184b133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:38.752150 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-07b5be60-5464-463a-beaa-309cd184b133 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:38.753529 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-07b5be60-5464-463a-beaa-309cd184b133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:38.800880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:38.848731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:38.886347 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789972de-cc08-4679-9fc2-17b04c32d5db None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:38.887874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-789972de-cc08-4679-9fc2-17b04c32d5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:38.990541 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789972de-cc08-4679-9fc2-17b04c32d5db None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:39.037233 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:39.064314 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b70d81-6269-42b6-b5c6-827a37f975d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:39.064974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b70d81-6269-42b6-b5c6-827a37f975d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:39.065260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b70d81-6269-42b6-b5c6-827a37f975d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:39.065538 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b70d81-6269-42b6-b5c6-827a37f975d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:39.067186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-40b70d81-6269-42b6-b5c6-827a37f975d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:39.174408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b70d81-6269-42b6-b5c6-827a37f975d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:39.175843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b70d81-6269-42b6-b5c6-827a37f975d8 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:39.195272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 725/1470] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:48.846802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=22 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:49.193046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=66 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:58.850149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c54b7-5ba0-4e97-995c-d884329043a2 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:58.850695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c54b7-5ba0-4e97-995c-d884329043a2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:58.850695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c54b7-5ba0-4e97-995c-d884329043a2 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:58.852199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 746/1471] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:58.857990 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40916f-499c-4e34-9a91-737322acda50 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:58.858396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40916f-499c-4e34-9a91-737322acda50 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:58.858549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40916f-499c-4e34-9a91-737322acda50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:58.922807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4f40916f-499c-4e34-9a91-737322acda50 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:58.924020 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4f40916f-499c-4e34-9a91-737322acda50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:59.018589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 726/1472] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:59.102746 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c0ed3-55d1-439b-b54a-92776b6be0a3 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:59.102981 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c0ed3-55d1-439b-b54a-92776b6be0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:59.103263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c0ed3-55d1-439b-b54a-92776b6be0a3 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:59.105355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 747/1473] 10.222.0.74 () {54 vars in 962 bytes} [Thu Jul 14 10:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:16:59.110214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9f01c-4d04-4ed3-8912-9b3c8b975f69 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:59.110502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9f01c-4d04-4ed3-8912-9b3c8b975f69 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:59.110777 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9f01c-4d04-4ed3-8912-9b3c8b975f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:59.184488 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-59a9f01c-4d04-4ed3-8912-9b3c8b975f69 None None] MFA Rules not processed for user `397a66eb12254a65bf05bc9fff9a868e`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:59.185691 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-59a9f01c-4d04-4ed3-8912-9b3c8b975f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:59.205908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:59.260764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 727/1474] 10.222.0.74 () {58 vars in 1059 bytes} [Thu Jul 14 10:16:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:59.268289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c0ed3-55d1-439b-b54a-92776b6be0a3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:59.269825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7e0c0ed3-55d1-439b-b54a-92776b6be0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:59.374281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c0ed3-55d1-439b-b54a-92776b6be0a3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:59.444070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77ed42-b151-44fc-85d9-f4f713b07e89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397a66eb12254a65bf05bc9fff9a868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:59.444727 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77ed42-b151-44fc-85d9-f4f713b07e89 service glance] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:59.445012 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77ed42-b151-44fc-85d9-f4f713b07e89 service glance] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:59.445287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77ed42-b151-44fc-85d9-f4f713b07e89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:59.446938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6d77ed42-b151-44fc-85d9-f4f713b07e89 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:59.501693 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:59.557222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77ed42-b151-44fc-85d9-f4f713b07e89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:59.558664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77ed42-b151-44fc-85d9-f4f713b07e89 service glance] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:59.577220 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 748/1475] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:17:01.686817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4099c-2e42-42ed-8efe-dfd9d6f4816d None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:01.687351 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4099c-2e42-42ed-8efe-dfd9d6f4816d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:01.687351 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4099c-2e42-42ed-8efe-dfd9d6f4816d None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:01.688740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 728/1476] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:17:01.694118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45613d35-5131-4d10-995a-abec018aaf47 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:01.694546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45613d35-5131-4d10-995a-abec018aaf47 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:01.694658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45613d35-5131-4d10-995a-abec018aaf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:01.761131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-45613d35-5131-4d10-995a-abec018aaf47 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:17:01.762369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-45613d35-5131-4d10-995a-abec018aaf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:01.856621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 749/1477] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:17:01.880221 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4099c-2e42-42ed-8efe-dfd9d6f4816d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:17:01.881738 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f1a4099c-2e42-42ed-8efe-dfd9d6f4816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:02.006015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4099c-2e42-42ed-8efe-dfd9d6f4816d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:17:02.055960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:02.101403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3954bad-74ae-4cd6-9702-828c4a2d9374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:17:02.102073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3954bad-74ae-4cd6-9702-828c4a2d9374 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:02.102360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3954bad-74ae-4cd6-9702-828c4a2d9374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:02.102640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3954bad-74ae-4cd6-9702-828c4a2d9374 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:02.103376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3954bad-74ae-4cd6-9702-828c4a2d9374 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:17:02.105185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-c3954bad-74ae-4cd6-9702-828c4a2d9374 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:17:02.105185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: warnings.warn(msg) Jul 14 10:17:02.105185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: Jul 14 10:17:02.106339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3954bad-74ae-4cd6-9702-828c4a2d9374 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:17:02.125322 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 729/1478] 10.222.0.74 () {56 vars in 1108 bytes} [Thu Jul 14 10:17:01 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:17:04.148508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59495eab-ecc1-4b2d-9230-b3f9f799abba None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:04.149055 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59495eab-ecc1-4b2d-9230-b3f9f799abba None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:04.149055 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59495eab-ecc1-4b2d-9230-b3f9f799abba None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:04.151030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 750/1479] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:17:04.156310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd8e2e-b567-4a00-bb01-a3af47c0ebbc None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:04.156717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd8e2e-b567-4a00-bb01-a3af47c0ebbc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:04.156907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd8e2e-b567-4a00-bb01-a3af47c0ebbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:04.221056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-28cd8e2e-b567-4a00-bb01-a3af47c0ebbc None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:17:04.222274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-28cd8e2e-b567-4a00-bb01-a3af47c0ebbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:04.318642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 730/1480] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:17:04.362553 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59495eab-ecc1-4b2d-9230-b3f9f799abba None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:17:04.364112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-59495eab-ecc1-4b2d-9230-b3f9f799abba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:04.374017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:04.511308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59495eab-ecc1-4b2d-9230-b3f9f799abba None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:17:04.590755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:04.624871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783eff2-fdfe-4894-ab00-c4957c5cfa31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:17:04.625523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783eff2-fdfe-4894-ab00-c4957c5cfa31 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:04.625814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783eff2-fdfe-4894-ab00-c4957c5cfa31 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:04.626090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783eff2-fdfe-4894-ab00-c4957c5cfa31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:04.628083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e783eff2-fdfe-4894-ab00-c4957c5cfa31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:04.717244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783eff2-fdfe-4894-ab00-c4957c5cfa31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:17:04.718853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783eff2-fdfe-4894-ab00-c4957c5cfa31 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:17:04.737950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 751/1481] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:17:06.940368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2f2fe-7ab1-41e7-b505-c81b5d1f691f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:06.940952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2f2fe-7ab1-41e7-b505-c81b5d1f691f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:06.940952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2f2fe-7ab1-41e7-b505-c81b5d1f691f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:06.942308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 731/1482] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:17:06.948131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7a854-d6b8-431a-8cbd-335f371aca49 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:06.948612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7a854-d6b8-431a-8cbd-335f371aca49 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:06.948728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7a854-d6b8-431a-8cbd-335f371aca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:07.012756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-cff7a854-d6b8-431a-8cbd-335f371aca49 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:17:07.013962 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cff7a854-d6b8-431a-8cbd-335f371aca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:07.061993 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:07.112642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 752/1483] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:17:07.151014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2f2fe-7ab1-41e7-b505-c81b5d1f691f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:17:07.155864 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bbb2f2fe-7ab1-41e7-b505-c81b5d1f691f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:07.175925 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:07.255495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2f2fe-7ab1-41e7-b505-c81b5d1f691f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:17:07.328637 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a5450-3141-4b1e-bdd7-f1a5fa3291f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:17:07.329302 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a5450-3141-4b1e-bdd7-f1a5fa3291f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:07.329582 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a5450-3141-4b1e-bdd7-f1a5fa3291f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:07.329863 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a5450-3141-4b1e-bdd7-f1a5fa3291f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:07.331526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1a9a5450-3141-4b1e-bdd7-f1a5fa3291f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:07.411097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:07.445427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a5450-3141-4b1e-bdd7-f1a5fa3291f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:17:07.446943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a5450-3141-4b1e-bdd7-f1a5fa3291f9 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:17:07.585316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 732/1484] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:17:09.673147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4481-5059-4184-9ce1-e0036b295b8c None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:09.673736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4481-5059-4184-9ce1-e0036b295b8c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:09.673736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4481-5059-4184-9ce1-e0036b295b8c None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:09.675113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 753/1485] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:17:09.680451 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce40fe-4ec6-46e7-bf99-2af303d4e93e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:09.680887 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce40fe-4ec6-46e7-bf99-2af303d4e93e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:09.681540 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce40fe-4ec6-46e7-bf99-2af303d4e93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:09.745036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-05ce40fe-4ec6-46e7-bf99-2af303d4e93e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:17:09.746240 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-05ce40fe-4ec6-46e7-bf99-2af303d4e93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:09.843549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 733/1486] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:17:09.881097 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a4481-5059-4184-9ce1-e0036b295b8c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:17:09.882623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9c9a4481-5059-4184-9ce1-e0036b295b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:09.986087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a4481-5059-4184-9ce1-e0036b295b8c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:17:10.056971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:10.058924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61503188-557e-4001-90d1-e30e81edcf93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:17:10.059577 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503188-557e-4001-90d1-e30e81edcf93 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:10.059859 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503188-557e-4001-90d1-e30e81edcf93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:10.060170 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503188-557e-4001-90d1-e30e81edcf93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:10.061826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-61503188-557e-4001-90d1-e30e81edcf93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:10.172583 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61503188-557e-4001-90d1-e30e81edcf93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:17:10.173933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61503188-557e-4001-90d1-e30e81edcf93 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:17:10.192196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 754/1487] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:17:12.314451 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22c35e-13fa-447e-a02a-def9d2ab1038 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:12.314981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22c35e-13fa-447e-a02a-def9d2ab1038 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:12.314981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22c35e-13fa-447e-a02a-def9d2ab1038 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:12.316395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 734/1488] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:17:12.321667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff0f4b-73ac-46aa-9451-fb43e61ca041 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:12.322099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff0f4b-73ac-46aa-9451-fb43e61ca041 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:12.322224 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff0f4b-73ac-46aa-9451-fb43e61ca041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:12.387204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c0ff0f4b-73ac-46aa-9451-fb43e61ca041 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:17:12.388464 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c0ff0f4b-73ac-46aa-9451-fb43e61ca041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:12.440657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:12.485123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 755/1489] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:17:12.526486 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22c35e-13fa-447e-a02a-def9d2ab1038 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:17:12.528107 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ba22c35e-13fa-447e-a02a-def9d2ab1038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:12.565405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:12.632665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22c35e-13fa-447e-a02a-def9d2ab1038 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:17:12.707195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7da26-b473-4845-8b13-a7bea0079036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:17:12.710190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7da26-b473-4845-8b13-a7bea0079036 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:12.710190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7da26-b473-4845-8b13-a7bea0079036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:12.710190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7da26-b473-4845-8b13-a7bea0079036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:12.710490 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-91b7da26-b473-4845-8b13-a7bea0079036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:12.790638 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:12.820848 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7da26-b473-4845-8b13-a7bea0079036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:17:12.822805 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7da26-b473-4845-8b13-a7bea0079036 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:17:12.841033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 735/1490] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:17:15.222142 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb6a71-c89b-48a0-bd65-b24753463866 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:15.222712 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb6a71-c89b-48a0-bd65-b24753463866 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:15.222712 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb6a71-c89b-48a0-bd65-b24753463866 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:15.224111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 756/1491] 10.222.0.74 () {54 vars in 926 bytes} [Thu Jul 14 10:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:17:15.229548 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b440fc-c90f-4339-a46d-3e3c269291cb None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:15.229953 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b440fc-c90f-4339-a46d-3e3c269291cb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:15.230106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b440fc-c90f-4339-a46d-3e3c269291cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:15.293269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e7b440fc-c90f-4339-a46d-3e3c269291cb None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:17:15.294474 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e7b440fc-c90f-4339-a46d-3e3c269291cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:15.389539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 736/1492] 10.222.0.74 () {58 vars in 1023 bytes} [Thu Jul 14 10:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:17:15.428315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb6a71-c89b-48a0-bd65-b24753463866 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:17:15.429839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-dfbb6a71-c89b-48a0-bd65-b24753463866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:15.532577 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb6a71-c89b-48a0-bd65-b24753463866 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:17:15.607112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d0987-9986-4412-92e5-a278cb2d699b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:17:15.607802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d0987-9986-4412-92e5-a278cb2d699b service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:15.608259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d0987-9986-4412-92e5-a278cb2d699b service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:15.608447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d0987-9986-4412-92e5-a278cb2d699b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:15.610104 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-782d0987-9986-4412-92e5-a278cb2d699b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:15.619805 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:15.719948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d0987-9986-4412-92e5-a278cb2d699b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:17:15.721387 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d0987-9986-4412-92e5-a278cb2d699b service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:17:15.740156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 757/1493] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:17:25.387733 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=82 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:25.738020 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=50 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:49.099758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc165f-2d58-4484-a123-18b9579dd4be None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:49.100274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc165f-2d58-4484-a123-18b9579dd4be None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:49.100379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc165f-2d58-4484-a123-18b9579dd4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:49.172974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3dfc165f-2d58-4484-a123-18b9579dd4be None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:49.174179 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3dfc165f-2d58-4484-a123-18b9579dd4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:49.270614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 737/1494] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:49.278574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d7230-2613-42ce-bf1d-94f46e8819a8 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:49.279080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d7230-2613-42ce-bf1d-94f46e8819a8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:49.279196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d7230-2613-42ce-bf1d-94f46e8819a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:49.470453 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0c3d7230-2613-42ce-bf1d-94f46e8819a8 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:49.471804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0c3d7230-2613-42ce-bf1d-94f46e8819a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:49.569582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 758/1495] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:49.573998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc165f-2d58-4484-a123-18b9579dd4be None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:49.575242 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3dfc165f-2d58-4484-a123-18b9579dd4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:49.587027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc165f-2d58-4484-a123-18b9579dd4be None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:49.648500 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:49.681015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad000f-610b-4e46-a4d7-39a13021f989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:49.681678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad000f-610b-4e46-a4d7-39a13021f989 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:49.681960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad000f-610b-4e46-a4d7-39a13021f989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:49.682231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad000f-610b-4e46-a4d7-39a13021f989 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:49.683014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad000f-610b-4e46-a4d7-39a13021f989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:18:49.683561 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad000f-610b-4e46-a4d7-39a13021f989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:49.684936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-afad000f-610b-4e46-a4d7-39a13021f989 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:18:49.684936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: warnings.warn(msg) Jul 14 10:18:49.684936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: Jul 14 10:18:49.686126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad000f-610b-4e46-a4d7-39a13021f989 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:49.697722 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 738/1496] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:18:49.705770 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d7230-2613-42ce-bf1d-94f46e8819a8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:49.715541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d7230-2613-42ce-bf1d-94f46e8819a8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:49.776159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:49.809179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f7e00-d844-44c3-8f4f-56a62e0116bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:49.810034 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f7e00-d844-44c3-8f4f-56a62e0116bc admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:49.810488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f7e00-d844-44c3-8f4f-56a62e0116bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:49.811069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f7e00-d844-44c3-8f4f-56a62e0116bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:49.811757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f7e00-d844-44c3-8f4f-56a62e0116bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:49.813533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: WARNING py.warnings [None req-a29f7e00-d844-44c3-8f4f-56a62e0116bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:18:49.813533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: warnings.warn(msg) Jul 14 10:18:49.813533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: Jul 14 10:18:49.814712 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f7e00-d844-44c3-8f4f-56a62e0116bc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:49.904006 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 759/1497] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:18:49 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:18:49.908223 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad000f-610b-4e46-a4d7-39a13021f989 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:49.909727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-afad000f-610b-4e46-a4d7-39a13021f989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:49.943872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad000f-610b-4e46-a4d7-39a13021f989 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:50.037235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417fa5d-1fbb-47bd-9ec9-9c0e391dfc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:50.037828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417fa5d-1fbb-47bd-9ec9-9c0e391dfc43 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:50.038108 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417fa5d-1fbb-47bd-9ec9-9c0e391dfc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:50.038397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417fa5d-1fbb-47bd-9ec9-9c0e391dfc43 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:50.039069 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417fa5d-1fbb-47bd-9ec9-9c0e391dfc43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:50.040103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-5417fa5d-1fbb-47bd-9ec9-9c0e391dfc43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:18:50.040103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: warnings.warn(msg) Jul 14 10:18:50.040103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: Jul 14 10:18:50.041292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417fa5d-1fbb-47bd-9ec9-9c0e391dfc43 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:50.125356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 739/1498] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:18:49 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:18:50.130175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f7e00-d844-44c3-8f4f-56a62e0116bc admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:50.131700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a29f7e00-d844-44c3-8f4f-56a62e0116bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:50.192361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f7e00-d844-44c3-8f4f-56a62e0116bc admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:50.275464 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:50.285575 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725e4cb-a567-47ec-a3bc-234317b588f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:50.289951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725e4cb-a567-47ec-a3bc-234317b588f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:50.289951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725e4cb-a567-47ec-a3bc-234317b588f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:50.289951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725e4cb-a567-47ec-a3bc-234317b588f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:50.289951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725e4cb-a567-47ec-a3bc-234317b588f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:50.289951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: WARNING py.warnings [None req-4725e4cb-a567-47ec-a3bc-234317b588f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:18:50.289951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: warnings.warn(msg) Jul 14 10:18:50.289951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: Jul 14 10:18:50.290551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725e4cb-a567-47ec-a3bc-234317b588f6 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:50.303511 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 760/1499] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:18:50.307005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417fa5d-1fbb-47bd-9ec9-9c0e391dfc43 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:50.308578 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5417fa5d-1fbb-47bd-9ec9-9c0e391dfc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:50.321047 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417fa5d-1fbb-47bd-9ec9-9c0e391dfc43 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:50.346469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:50.416318 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a348f54-ca36-4911-9053-1de26de584d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:50.416983 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a348f54-ca36-4911-9053-1de26de584d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:50.417264 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a348f54-ca36-4911-9053-1de26de584d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:50.417538 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a348f54-ca36-4911-9053-1de26de584d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:50.418263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a348f54-ca36-4911-9053-1de26de584d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:50.419275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-4a348f54-ca36-4911-9053-1de26de584d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:18:50.419275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: warnings.warn(msg) Jul 14 10:18:50.419275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: Jul 14 10:18:50.420190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a348f54-ca36-4911-9053-1de26de584d4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:50.433097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 740/1500] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:18:50.437193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725e4cb-a567-47ec-a3bc-234317b588f6 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:50.438792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4725e4cb-a567-47ec-a3bc-234317b588f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:50.473037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725e4cb-a567-47ec-a3bc-234317b588f6 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:50.565184 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69cb62-78e7-47b0-8378-e67987e91bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:50.566081 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69cb62-78e7-47b0-8378-e67987e91bac admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:50.566313 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69cb62-78e7-47b0-8378-e67987e91bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:50.567083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69cb62-78e7-47b0-8378-e67987e91bac admin admin] PATH_INFO: `/v3/projects/1f29d0cf0e114c438d1ef708f648ca81/users/d457ab9d1f544e6f997d1e83b6bd0013/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:50.589203 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69cb62-78e7-47b0-8378-e67987e91bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f29d0cf0e114c438d1ef708f648ca81, user_id=d457ab9d1f544e6f997d1e83b6bd0013, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:50.590244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: WARNING py.warnings [None req-7e69cb62-78e7-47b0-8378-e67987e91bac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:18:50.590244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: warnings.warn(msg) Jul 14 10:18:50.590244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: Jul 14 10:18:50.592181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69cb62-78e7-47b0-8378-e67987e91bac admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:50.673217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 761/1501] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:18:50 2022] PUT /identity/v3/projects/1f29d0cf0e114c438d1ef708f648ca81/users/d457ab9d1f544e6f997d1e83b6bd0013/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:50.685454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7c28c-a188-49b0-9cca-dcd541a431ce None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:50.685766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7c28c-a188-49b0-9cca-dcd541a431ce None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:50.686052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7c28c-a188-49b0-9cca-dcd541a431ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:50.766711 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-09c7c28c-a188-49b0-9cca-dcd541a431ce None None] MFA Rules not processed for user `d457ab9d1f544e6f997d1e83b6bd0013`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:50.768343 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-09c7c28c-a188-49b0-9cca-dcd541a431ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:50.846160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 741/1502] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:18:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:50.860056 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894eb73-e0d9-4620-bb5b-cdc5a043d79a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:50.860424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894eb73-e0d9-4620-bb5b-cdc5a043d79a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:50.860711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894eb73-e0d9-4620-bb5b-cdc5a043d79a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:50.862109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 762/1503] 10.222.0.74 () {54 vars in 963 bytes} [Thu Jul 14 10:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:18:50.866899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356b0e5-3b2e-4032-8beb-027c064f8d63 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:50.867189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356b0e5-3b2e-4032-8beb-027c064f8d63 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:50.867465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356b0e5-3b2e-4032-8beb-027c064f8d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:50.897474 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:50.941763 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3356b0e5-3b2e-4032-8beb-027c064f8d63 None None] MFA Rules not processed for user `12abc4b2a8d348d992e0bb00a1218929`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:50.942985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3356b0e5-3b2e-4032-8beb-027c064f8d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:51.018258 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 742/1504] 10.222.0.74 () {58 vars in 1060 bytes} [Thu Jul 14 10:18:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:51.026523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894eb73-e0d9-4620-bb5b-cdc5a043d79a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:51.028075 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c894eb73-e0d9-4620-bb5b-cdc5a043d79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:51.080122 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:51.133075 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894eb73-e0d9-4620-bb5b-cdc5a043d79a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:51.203759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375b5a6-e69e-4178-90f0-3a4f795fa055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:51.204434 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375b5a6-e69e-4178-90f0-3a4f795fa055 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:51.204717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375b5a6-e69e-4178-90f0-3a4f795fa055 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:51.204997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375b5a6-e69e-4178-90f0-3a4f795fa055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:51.206633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3375b5a6-e69e-4178-90f0-3a4f795fa055 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:51.302731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375b5a6-e69e-4178-90f0-3a4f795fa055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:51.304217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375b5a6-e69e-4178-90f0-3a4f795fa055 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:51.307654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:51.322203 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 763/1505] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:18:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:18:51.364462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5948d3-2f97-454a-b276-6fff05e32d50 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:51.364900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5948d3-2f97-454a-b276-6fff05e32d50 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:51.365014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5948d3-2f97-454a-b276-6fff05e32d50 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:51.366291 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 743/1506] 10.222.0.74 () {52 vars in 829 bytes} [Thu Jul 14 10:18:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:18:51.369951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375b5a6-e69e-4178-90f0-3a4f795fa055 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:51.371155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3375b5a6-e69e-4178-90f0-3a4f795fa055 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:51.469125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375b5a6-e69e-4178-90f0-3a4f795fa055 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:51.562056 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:51.562925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:51.563209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:51.563483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] PATH_INFO: `/v3/users/d457ab9d1f544e6f997d1e83b6bd0013` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:51.575536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d457ab9d1f544e6f997d1e83b6bd0013)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:51.576629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: WARNING py.warnings [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:18:51.576629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: warnings.warn(msg) Jul 14 10:18:51.576629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: Jul 14 10:18:51.577825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:51.587829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:51.772884 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd457ab9d1f544e6f997d1e83b6bd0013'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.795758 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd457ab9d1f544e6f997d1e83b6bd0013'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.861561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd457ab9d1f544e6f997d1e83b6bd0013'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.862111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd457ab9d1f544e6f997d1e83b6bd0013'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.875210 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd457ab9d1f544e6f997d1e83b6bd0013'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.881426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 764/1507] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:18:51 2022] DELETE /identity/v3/users/d457ab9d1f544e6f997d1e83b6bd0013 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:51.885956 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6549c9c-04d6-4a69-964a-1680ba41ea2d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:51.886249 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6549c9c-04d6-4a69-964a-1680ba41ea2d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:51.886530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6549c9c-04d6-4a69-964a-1680ba41ea2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:51.940533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e6549c9c-04d6-4a69-964a-1680ba41ea2d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:51.942261 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e6549c9c-04d6-4a69-964a-1680ba41ea2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:52.016497 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:52.029477 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 744/1508] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:52.039717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.041732 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:52.139683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180f252-d19f-443c-9aeb-e01f8e150da8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:52.195645 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:52.214589 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e7618-c271-487e-81fc-36b4d936bd35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:52.215237 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e7618-c271-487e-81fc-36b4d936bd35 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.215520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e7618-c271-487e-81fc-36b4d936bd35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.215795 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e7618-c271-487e-81fc-36b4d936bd35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.217566 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-185e7618-c271-487e-81fc-36b4d936bd35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:52.328737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e7618-c271-487e-81fc-36b4d936bd35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:52.330105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e7618-c271-487e-81fc-36b4d936bd35 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:52.348555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 765/1509] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:18:52.829479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6549c9c-04d6-4a69-964a-1680ba41ea2d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.830717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e6549c9c-04d6-4a69-964a-1680ba41ea2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:52.843158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6549c9c-04d6-4a69-964a-1680ba41ea2d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:52.942727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e38db1-31e9-44c1-afc1-d83a293a23eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:52.943586 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e38db1-31e9-44c1-afc1-d83a293a23eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.943869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e38db1-31e9-44c1-afc1-d83a293a23eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.944180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e38db1-31e9-44c1-afc1-d83a293a23eb admin admin] PATH_INFO: `/v3/projects/1f29d0cf0e114c438d1ef708f648ca81` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.954077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e38db1-31e9-44c1-afc1-d83a293a23eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f29d0cf0e114c438d1ef708f648ca81)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:52.955114 dv-cinder-849800-1-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-f2e38db1-31e9-44c1-afc1-d83a293a23eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:18:52.955114 dv-cinder-849800-1-smb devstack@keystone.service[80503]: warnings.warn(msg) Jul 14 10:18:52.955114 dv-cinder-849800-1-smb devstack@keystone.service[80503]: Jul 14 10:18:52.956434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e38db1-31e9-44c1-afc1-d83a293a23eb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:53.083502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f2e38db1-31e9-44c1-afc1-d83a293a23eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f29d0cf0e114c438d1ef708f648ca81', 'request_id': 'req-f2e38db1-31e9-44c1-afc1-d83a293a23eb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:53.169725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f2e38db1-31e9-44c1-afc1-d83a293a23eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f29d0cf0e114c438d1ef708f648ca81', 'request_id': 'req-f2e38db1-31e9-44c1-afc1-d83a293a23eb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:53.176274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f2e38db1-31e9-44c1-afc1-d83a293a23eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f29d0cf0e114c438d1ef708f648ca81', 'request_id': 'req-f2e38db1-31e9-44c1-afc1-d83a293a23eb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:53.207706 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f2e38db1-31e9-44c1-afc1-d83a293a23eb admin admin] The token cache is being invalidate because project 1f29d0cf0e114c438d1ef708f648ca81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:18:53.208020 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f2e38db1-31e9-44c1-afc1-d83a293a23eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:53.208456 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f2e38db1-31e9-44c1-afc1-d83a293a23eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:53.209894 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 745/1510] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:18:52 2022] DELETE /identity/v3/projects/1f29d0cf0e114c438d1ef708f648ca81 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:19:02.346150 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=62 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:03.205121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:39.499774 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755f669-d66d-4242-b000-bba48b49b90d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:39.500427 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755f669-d66d-4242-b000-bba48b49b90d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:39.500427 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755f669-d66d-4242-b000-bba48b49b90d None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:39.501728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:20:39.506524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49125980-6795-43c3-85ce-36537a7eb737 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:39.506965 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49125980-6795-43c3-85ce-36537a7eb737 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:39.507085 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49125980-6795-43c3-85ce-36537a7eb737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:39.586707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-49125980-6795-43c3-85ce-36537a7eb737 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:39.587919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-49125980-6795-43c3-85ce-36537a7eb737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:39.691516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:39.845545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755f669-d66d-4242-b000-bba48b49b90d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:39.847634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8755f669-d66d-4242-b000-bba48b49b90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:39.965842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755f669-d66d-4242-b000-bba48b49b90d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:39.971341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1d875-67ef-4eeb-8300-ff35a6c4d9c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:39.971986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1d875-67ef-4eeb-8300-ff35a6c4d9c4 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:39.972307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1d875-67ef-4eeb-8300-ff35a6c4d9c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:39.972585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1d875-67ef-4eeb-8300-ff35a6c4d9c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:39.980665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1d875-67ef-4eeb-8300-ff35a6c4d9c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:39.982237 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1d875-67ef-4eeb-8300-ff35a6c4d9c4 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:39.991843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 767/1513] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:40.821628 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c738943-e924-414e-a775-6157c1c39e52 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:40.822195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c738943-e924-414e-a775-6157c1c39e52 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:40.822195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c738943-e924-414e-a775-6157c1c39e52 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:40.823558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 747/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:20:40.828403 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204d743-4796-4f79-a9f1-5707930b6af5 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:40.828852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204d743-4796-4f79-a9f1-5707930b6af5 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:40.828956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204d743-4796-4f79-a9f1-5707930b6af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:40.848192 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2204d743-4796-4f79-a9f1-5707930b6af5 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:40.849425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2204d743-4796-4f79-a9f1-5707930b6af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:40.857331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 768/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:41.011554 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c738943-e924-414e-a775-6157c1c39e52 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:41.017275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82068019-f4c3-4fc1-b1b2-b7c031494a0b None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:41.017637 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82068019-f4c3-4fc1-b1b2-b7c031494a0b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:41.017988 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82068019-f4c3-4fc1-b1b2-b7c031494a0b None None] PATH_INFO: `/v3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:41.019377 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 769/1516] 10.222.0.57 () {54 vars in 925 bytes} [Thu Jul 14 10:20:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:20:41.026400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd4bf3-5db7-4139-9c40-8491a903a68b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:41.026566 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c738943-e924-414e-a775-6157c1c39e52 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:41.026686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd4bf3-5db7-4139-9c40-8491a903a68b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:41.026946 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd4bf3-5db7-4139-9c40-8491a903a68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:41.032554 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16318cf9-be90-4ad1-bc1f-65c0d5718aed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:41.033213 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318cf9-be90-4ad1-bc1f-65c0d5718aed service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:41.033493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318cf9-be90-4ad1-bc1f-65c0d5718aed service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:41.033769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318cf9-be90-4ad1-bc1f-65c0d5718aed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:41.042109 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16318cf9-be90-4ad1-bc1f-65c0d5718aed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:41.043693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16318cf9-be90-4ad1-bc1f-65c0d5718aed service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:41.057378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 748/1517] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:41.089499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b9bd4bf3-5db7-4139-9c40-8491a903a68b None None] MFA Rules not processed for user `2784d36c16d343cc961a22d956ee30f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:41.090721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b9bd4bf3-5db7-4139-9c40-8491a903a68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:41.149143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:41.168027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 770/1518] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Jul 14 10:20:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:20:50.289829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e08714-c89f-441b-aea5-616c51fa4acb None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:50.290428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e08714-c89f-441b-aea5-616c51fa4acb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:50.290428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e08714-c89f-441b-aea5-616c51fa4acb None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:50.291674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 749/1519] 10.222.0.74 () {54 vars in 960 bytes} [Thu Jul 14 10:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:20:50.296704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edbe54-39de-4c73-a49f-5cb32ee96b49 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:50.297156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edbe54-39de-4c73-a49f-5cb32ee96b49 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:50.297265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edbe54-39de-4c73-a49f-5cb32ee96b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:50.316645 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-62edbe54-39de-4c73-a49f-5cb32ee96b49 None None] MFA Rules not processed for user `2784d36c16d343cc961a22d956ee30f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:50.317847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-62edbe54-39de-4c73-a49f-5cb32ee96b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:50.326624 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 771/1520] 10.222.0.74 () {58 vars in 1057 bytes} [Thu Jul 14 10:20:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:50.333900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e08714-c89f-441b-aea5-616c51fa4acb None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:50.347238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e08714-c89f-441b-aea5-616c51fa4acb None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:50.352244 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d96cd1-89f4-4db1-98bd-98358369be0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784d36c16d343cc961a22d956ee30f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:50.352879 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d96cd1-89f4-4db1-98bd-98358369be0e service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:50.353160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d96cd1-89f4-4db1-98bd-98358369be0e service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:50.353435 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d96cd1-89f4-4db1-98bd-98358369be0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:50.362151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d96cd1-89f4-4db1-98bd-98358369be0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:50.363709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d96cd1-89f4-4db1-98bd-98358369be0e service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:50.373545 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 750/1521] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:52.278647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a1e34-263f-429f-be55-5383fc8faf61 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:52.279199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a1e34-263f-429f-be55-5383fc8faf61 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:52.279199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a1e34-263f-429f-be55-5383fc8faf61 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:52.280589 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:20:52.286021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f6e9a-2796-4794-8727-27a31b858098 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:52.286505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f6e9a-2796-4794-8727-27a31b858098 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:52.286621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f6e9a-2796-4794-8727-27a31b858098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:52.305358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-031f6e9a-2796-4794-8727-27a31b858098 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:52.306570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-031f6e9a-2796-4794-8727-27a31b858098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:52.314690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:52.468357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a1e34-263f-429f-be55-5383fc8faf61 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:52.482394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a1e34-263f-429f-be55-5383fc8faf61 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:52.488038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91393f22-75f6-4a84-9902-026ecfdbc155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:52.488411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91393f22-75f6-4a84-9902-026ecfdbc155 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:52.488695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91393f22-75f6-4a84-9902-026ecfdbc155 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:52.488972 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91393f22-75f6-4a84-9902-026ecfdbc155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:52.497244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91393f22-75f6-4a84-9902-026ecfdbc155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:52.498823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91393f22-75f6-4a84-9902-026ecfdbc155 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:52.508822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 773/1524] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:53.329599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eaa5e-2ec1-4760-9154-a754f912a4f4 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:53.330134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eaa5e-2ec1-4760-9154-a754f912a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:53.330134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eaa5e-2ec1-4760-9154-a754f912a4f4 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:53.331570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:20:53.336570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43944d-7289-4f78-8836-6037205f52d1 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:53.336983 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43944d-7289-4f78-8836-6037205f52d1 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:53.337135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43944d-7289-4f78-8836-6037205f52d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:53.354882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7c43944d-7289-4f78-8836-6037205f52d1 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:53.356117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7c43944d-7289-4f78-8836-6037205f52d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:53.364656 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:53.514786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112eaa5e-2ec1-4760-9154-a754f912a4f4 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:53.529056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112eaa5e-2ec1-4760-9154-a754f912a4f4 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:53.534609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a33f9e-6abb-4b96-bb45-31ca450d0061 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:53.535247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a33f9e-6abb-4b96-bb45-31ca450d0061 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:53.535532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a33f9e-6abb-4b96-bb45-31ca450d0061 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:53.535808 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a33f9e-6abb-4b96-bb45-31ca450d0061 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:53.543984 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a33f9e-6abb-4b96-bb45-31ca450d0061 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:53.545588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a33f9e-6abb-4b96-bb45-31ca450d0061 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:53.555554 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 753/1527] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:57.694077 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab92b5c-cac2-40da-98f8-3dd1cc10f0cf None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:57.694679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab92b5c-cac2-40da-98f8-3dd1cc10f0cf None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:57.694679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab92b5c-cac2-40da-98f8-3dd1cc10f0cf None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:57.696058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:20:57.701268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062531d8-3757-4b74-bb60-2fc04aa3884d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:57.701693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062531d8-3757-4b74-bb60-2fc04aa3884d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:57.701820 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062531d8-3757-4b74-bb60-2fc04aa3884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:57.720128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-062531d8-3757-4b74-bb60-2fc04aa3884d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:57.725468 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-062531d8-3757-4b74-bb60-2fc04aa3884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:57.729290 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:57.802806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab92b5c-cac2-40da-98f8-3dd1cc10f0cf None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:57.804560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-aab92b5c-cac2-40da-98f8-3dd1cc10f0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:57.882797 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab92b5c-cac2-40da-98f8-3dd1cc10f0cf None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:57.886331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ee702-1c5d-4ca4-b7e6-ab28c2b80f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:57.886976 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee702-1c5d-4ca4-b7e6-ab28c2b80f32 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:57.887253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee702-1c5d-4ca4-b7e6-ab28c2b80f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:57.887523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee702-1c5d-4ca4-b7e6-ab28c2b80f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:57.896802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ee702-1c5d-4ca4-b7e6-ab28c2b80f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:57.898289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ee702-1c5d-4ca4-b7e6-ab28c2b80f32 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:57.908115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 776/1530] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:59.901341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af104e-d38e-47d4-bb8a-90df2f3fc9fd None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:59.901915 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af104e-d38e-47d4-bb8a-90df2f3fc9fd None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:59.901915 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af104e-d38e-47d4-bb8a-90df2f3fc9fd None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:59.903320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:20:59.908842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f61593-cf2f-4dc8-99e9-e4eb5a774882 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:59.909274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f61593-cf2f-4dc8-99e9-e4eb5a774882 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:59.909381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f61593-cf2f-4dc8-99e9-e4eb5a774882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:59.927611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-04f61593-cf2f-4dc8-99e9-e4eb5a774882 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:59.928899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-04f61593-cf2f-4dc8-99e9-e4eb5a774882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:59.936590 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:59.973986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af104e-d38e-47d4-bb8a-90df2f3fc9fd None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:59.984680 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af104e-d38e-47d4-bb8a-90df2f3fc9fd None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:59.988854 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25c598-b223-46b0-a663-09fa32992407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:59.989485 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25c598-b223-46b0-a663-09fa32992407 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:59.989764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25c598-b223-46b0-a663-09fa32992407 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:59.990292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25c598-b223-46b0-a663-09fa32992407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:59.999009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25c598-b223-46b0-a663-09fa32992407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:00.000456 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25c598-b223-46b0-a663-09fa32992407 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:00.009646 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 756/1533] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:03.812426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6c0d9-a61c-4332-9502-e2d7e3bfe5fd None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:03.812973 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6c0d9-a61c-4332-9502-e2d7e3bfe5fd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:03.813095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6c0d9-a61c-4332-9502-e2d7e3bfe5fd None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:03.814399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:21:03.819461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcd660-6136-46ac-a23a-da91c0b8ece0 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:03.819847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcd660-6136-46ac-a23a-da91c0b8ece0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:03.820018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcd660-6136-46ac-a23a-da91c0b8ece0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:03.826331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:03.838946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-bddcd660-6136-46ac-a23a-da91c0b8ece0 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:03.844971 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bddcd660-6136-46ac-a23a-da91c0b8ece0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:03.848705 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:04.147691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6c0d9-a61c-4332-9502-e2d7e3bfe5fd None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:04.149407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-19d6c0d9-a61c-4332-9502-e2d7e3bfe5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:04.232612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6c0d9-a61c-4332-9502-e2d7e3bfe5fd None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:04.236248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e59076-e6c2-4f70-a384-ffc8954ac43a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:04.236897 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e59076-e6c2-4f70-a384-ffc8954ac43a service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:04.237184 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e59076-e6c2-4f70-a384-ffc8954ac43a service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:04.237466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e59076-e6c2-4f70-a384-ffc8954ac43a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:04.246594 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e59076-e6c2-4f70-a384-ffc8954ac43a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:04.248054 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e59076-e6c2-4f70-a384-ffc8954ac43a service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:04.257844 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 779/1536] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:06.308401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb3e46-3735-4f59-80f5-5318233245e6 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:06.308937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb3e46-3735-4f59-80f5-5318233245e6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:06.308937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb3e46-3735-4f59-80f5-5318233245e6 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:06.310342 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:21:06.316294 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5bc8-54c0-4e97-ac89-8b646474201e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:06.316699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5bc8-54c0-4e97-ac89-8b646474201e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:06.316988 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5bc8-54c0-4e97-ac89-8b646474201e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:06.335080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-eb1b5bc8-54c0-4e97-ac89-8b646474201e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:06.336315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-eb1b5bc8-54c0-4e97-ac89-8b646474201e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:06.344328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:06.648804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb3e46-3735-4f59-80f5-5318233245e6 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:06.650508 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c0eb3e46-3735-4f59-80f5-5318233245e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:06.663645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb3e46-3735-4f59-80f5-5318233245e6 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:06.667222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3538f-0fca-42b2-9a8b-a6f02ddabaf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:06.667861 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3538f-0fca-42b2-9a8b-a6f02ddabaf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:06.668186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3538f-0fca-42b2-9a8b-a6f02ddabaf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:06.668468 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3538f-0fca-42b2-9a8b-a6f02ddabaf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:06.678835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3538f-0fca-42b2-9a8b-a6f02ddabaf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:06.680313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3538f-0fca-42b2-9a8b-a6f02ddabaf2 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:06.690268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 759/1539] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:16.330325 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:16.685546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=8 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:39.060790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188c2ff-0637-4d75-a5aa-9a49321b4f95 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.062750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188c2ff-0637-4d75-a5aa-9a49321b4f95 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.062750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188c2ff-0637-4d75-a5aa-9a49321b4f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.083191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1cb28-1ddc-4e95-a6ac-3b14ae3f5b84 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.084248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1cb28-1ddc-4e95-a6ac-3b14ae3f5b84 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.084766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1cb28-1ddc-4e95-a6ac-3b14ae3f5b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.085552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a188c2ff-0637-4d75-a5aa-9a49321b4f95 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.086763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a188c2ff-0637-4d75-a5aa-9a49321b4f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.103423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 781/1540] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.107826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f9fb-0baf-4849-8814-71e54d19f765 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.107826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f9fb-0baf-4849-8814-71e54d19f765 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.107826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f9fb-0baf-4849-8814-71e54d19f765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.117394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-57a1cb28-1ddc-4e95-a6ac-3b14ae3f5b84 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.119264 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-57a1cb28-1ddc-4e95-a6ac-3b14ae3f5b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.136359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 760/1541] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.138306 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0eb7a7-6de3-4e1d-86a2-c88d14a339ad None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.138825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0eb7a7-6de3-4e1d-86a2-c88d14a339ad None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.139364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0eb7a7-6de3-4e1d-86a2-c88d14a339ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.144388 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c5e5f9fb-0baf-4849-8814-71e54d19f765 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.146130 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c5e5f9fb-0baf-4849-8814-71e54d19f765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.168325 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 782/1542] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.168325 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f16946-2a8f-48ff-82c8-9be590f3d286 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.168325 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f16946-2a8f-48ff-82c8-9be590f3d286 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.168325 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f16946-2a8f-48ff-82c8-9be590f3d286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.176034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5a0eb7a7-6de3-4e1d-86a2-c88d14a339ad None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.177573 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5a0eb7a7-6de3-4e1d-86a2-c88d14a339ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.199669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d4f16946-2a8f-48ff-82c8-9be590f3d286 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.199669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d4f16946-2a8f-48ff-82c8-9be590f3d286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.209830 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 761/1543] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.211619 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452e8fc-8ab7-429c-b8b6-8d1f0af04667 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.212169 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452e8fc-8ab7-429c-b8b6-8d1f0af04667 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.212693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452e8fc-8ab7-429c-b8b6-8d1f0af04667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.218314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 783/1544] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.220940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f16946-2a8f-48ff-82c8-9be590f3d286 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:39.234612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f16946-2a8f-48ff-82c8-9be590f3d286 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:39.251716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f4afd-ec4e-4cac-8e41-65dba376baf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:39.253115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0452e8fc-8ab7-429c-b8b6-8d1f0af04667 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.254053 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f4afd-ec4e-4cac-8e41-65dba376baf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.255514 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0452e8fc-8ab7-429c-b8b6-8d1f0af04667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.256067 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f4afd-ec4e-4cac-8e41-65dba376baf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.256580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f4afd-ec4e-4cac-8e41-65dba376baf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.257561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f4afd-ec4e-4cac-8e41-65dba376baf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:22:39.258993 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f4afd-ec4e-4cac-8e41-65dba376baf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:39.261257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: WARNING py.warnings [None req-030f4afd-ec4e-4cac-8e41-65dba376baf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:22:39.261257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: warnings.warn(msg) Jul 14 10:22:39.261257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: Jul 14 10:22:39.262817 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f4afd-ec4e-4cac-8e41-65dba376baf3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:39.281359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 762/1545] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.283210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452e8fc-8ab7-429c-b8b6-8d1f0af04667 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:39.297779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 784/1546] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:22:39.307661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00593109-a9dc-4453-a2f5-30d1c10eb4ea None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.310447 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452e8fc-8ab7-429c-b8b6-8d1f0af04667 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:39.311613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00593109-a9dc-4453-a2f5-30d1c10eb4ea None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.312174 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00593109-a9dc-4453-a2f5-30d1c10eb4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.323492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba523b8-4a6f-4e2f-9620-7c02d17fa71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:39.324566 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba523b8-4a6f-4e2f-9620-7c02d17fa71c admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.325905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba523b8-4a6f-4e2f-9620-7c02d17fa71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.326578 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba523b8-4a6f-4e2f-9620-7c02d17fa71c admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.332511 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba523b8-4a6f-4e2f-9620-7c02d17fa71c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:22:39.333101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba523b8-4a6f-4e2f-9620-7c02d17fa71c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:39.334954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba523b8-4a6f-4e2f-9620-7c02d17fa71c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:39.347852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-00593109-a9dc-4453-a2f5-30d1c10eb4ea None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.351541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-00593109-a9dc-4453-a2f5-30d1c10eb4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.356388 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 763/1547] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:22:39.359367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba523b8-4a6f-4e2f-9620-7c02d17fa71c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:39.371413 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 785/1548] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.374699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00593109-a9dc-4453-a2f5-30d1c10eb4ea None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:39.384239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba523b8-4a6f-4e2f-9620-7c02d17fa71c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:39.391926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00593109-a9dc-4453-a2f5-30d1c10eb4ea None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:39.394931 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749ff49-dcb3-4a31-ba50-21d029b09905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:39.395912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749ff49-dcb3-4a31-ba50-21d029b09905 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.396459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749ff49-dcb3-4a31-ba50-21d029b09905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.396962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749ff49-dcb3-4a31-ba50-21d029b09905 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.397931 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749ff49-dcb3-4a31-ba50-21d029b09905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:22:39.398537 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749ff49-dcb3-4a31-ba50-21d029b09905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:39.401249 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749ff49-dcb3-4a31-ba50-21d029b09905 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:39.404032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a06461-b42d-4160-bcbd-63fa22c05141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:39.405607 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a06461-b42d-4160-bcbd-63fa22c05141 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.406141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a06461-b42d-4160-bcbd-63fa22c05141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.406643 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a06461-b42d-4160-bcbd-63fa22c05141 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.407644 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a06461-b42d-4160-bcbd-63fa22c05141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:39.409958 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a06461-b42d-4160-bcbd-63fa22c05141 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:39.417638 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 764/1549] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:22:39.419117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2105b-130a-4c28-b4d2-45188e4f29f6 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.419412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2105b-130a-4c28-b4d2-45188e4f29f6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.419693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2105b-130a-4c28-b4d2-45188e4f29f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.439473 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-63a2105b-130a-4c28-b4d2-45188e4f29f6 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.440733 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-63a2105b-130a-4c28-b4d2-45188e4f29f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.448810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 765/1550] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.453912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2105b-130a-4c28-b4d2-45188e4f29f6 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:39.459380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2105b-130a-4c28-b4d2-45188e4f29f6 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:39.464065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0ef65-a123-4f93-bf4f-8ba3c842f23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:39.464707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0ef65-a123-4f93-bf4f-8ba3c842f23e admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.464990 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0ef65-a123-4f93-bf4f-8ba3c842f23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.465261 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0ef65-a123-4f93-bf4f-8ba3c842f23e admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.465938 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0ef65-a123-4f93-bf4f-8ba3c842f23e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:39.467009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-82c0ef65-a123-4f93-bf4f-8ba3c842f23e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:22:39.467009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: warnings.warn(msg) Jul 14 10:22:39.467009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: Jul 14 10:22:39.468267 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0ef65-a123-4f93-bf4f-8ba3c842f23e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:39.539471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 786/1551] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/projects => generated 389 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:39.540798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c940b8d-29e6-43d1-811d-e6932fd57484 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.541093 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c940b8d-29e6-43d1-811d-e6932fd57484 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.541598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c940b8d-29e6-43d1-811d-e6932fd57484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.558778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-6c940b8d-29e6-43d1-811d-e6932fd57484 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.559984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6c940b8d-29e6-43d1-811d-e6932fd57484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.613822 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 766/1552] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:39.615236 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3396bea-64d9-4326-b125-e84a12e439f3 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.615598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3396bea-64d9-4326-b125-e84a12e439f3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.615870 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3396bea-64d9-4326-b125-e84a12e439f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.622155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 787/1553] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.623568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa4646-ab02-4c85-bf00-3350fc22e697 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.623734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa4646-ab02-4c85-bf00-3350fc22e697 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.624038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa4646-ab02-4c85-bf00-3350fc22e697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.634047 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e3396bea-64d9-4326-b125-e84a12e439f3 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.635268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e3396bea-64d9-4326-b125-e84a12e439f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.643011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-21aa4646-ab02-4c85-bf00-3350fc22e697 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.644324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-21aa4646-ab02-4c85-bf00-3350fc22e697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.695251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 767/1554] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.696638 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b2b39-ebe7-45e2-90e7-8c0fc1af37c5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.696924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b2b39-ebe7-45e2-90e7-8c0fc1af37c5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.697195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b2b39-ebe7-45e2-90e7-8c0fc1af37c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.707655 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 788/1555] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.716896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa4646-ab02-4c85-bf00-3350fc22e697 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:39.717959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa4646-ab02-4c85-bf00-3350fc22e697 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:39.718215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e89b2b39-ebe7-45e2-90e7-8c0fc1af37c5 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.719452 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e89b2b39-ebe7-45e2-90e7-8c0fc1af37c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.722950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ca588-f782-4623-9774-4db74fc47d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:39.723726 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ca588-f782-4623-9774-4db74fc47d2a admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.724042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ca588-f782-4623-9774-4db74fc47d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.724324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ca588-f782-4623-9774-4db74fc47d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.725010 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ca588-f782-4623-9774-4db74fc47d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:39.726912 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ca588-f782-4623-9774-4db74fc47d2a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:39.727745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 768/1556] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.729009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3a02a-7e1e-4e8c-97bd-e2bd7f083018 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.729294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3a02a-7e1e-4e8c-97bd-e2bd7f083018 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.729570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3a02a-7e1e-4e8c-97bd-e2bd7f083018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.749326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3fa3a02a-7e1e-4e8c-97bd-e2bd7f083018 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.750525 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3fa3a02a-7e1e-4e8c-97bd-e2bd7f083018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.758542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 769/1557] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.759429 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3a02a-7e1e-4e8c-97bd-e2bd7f083018 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:39.769464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3a02a-7e1e-4e8c-97bd-e2bd7f083018 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:39.774077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ded07c-2435-48f4-9355-cf2992711ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:39.774775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ded07c-2435-48f4-9355-cf2992711ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.775002 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ded07c-2435-48f4-9355-cf2992711ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.775273 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ded07c-2435-48f4-9355-cf2992711ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.775947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ded07c-2435-48f4-9355-cf2992711ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:39.777876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ded07c-2435-48f4-9355-cf2992711ab8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:39.823491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 789/1558] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:39.824386 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ca588-f782-4623-9774-4db74fc47d2a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:39.834781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:39.882462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 770/1559] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:39.882462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ded07c-2435-48f4-9355-cf2992711ab8 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:39.888856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ca588-f782-4623-9774-4db74fc47d2a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:39.889986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ded07c-2435-48f4-9355-cf2992711ab8 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:39.893491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761b4ef-2d8c-4b52-9499-470e704b4804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:39.894165 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761b4ef-2d8c-4b52-9499-470e704b4804 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.894449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761b4ef-2d8c-4b52-9499-470e704b4804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.894730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761b4ef-2d8c-4b52-9499-470e704b4804 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.895001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c6235-8548-444b-9807-765841a0f7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:39.895456 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761b4ef-2d8c-4b52-9499-470e704b4804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:39.895585 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c6235-8548-444b-9807-765841a0f7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.895812 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c6235-8548-444b-9807-765841a0f7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.896120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c6235-8548-444b-9807-765841a0f7e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.896845 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c6235-8548-444b-9807-765841a0f7e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:22:39.897154 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c6235-8548-444b-9807-765841a0f7e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:39.897381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: WARNING py.warnings [None req-b761b4ef-2d8c-4b52-9499-470e704b4804 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:22:39.897381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: warnings.warn(msg) Jul 14 10:22:39.897381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: Jul 14 10:22:39.898737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c6235-8548-444b-9807-765841a0f7e1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:39.899100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761b4ef-2d8c-4b52-9499-470e704b4804 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:39.911847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 771/1560] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:22:39.913135 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343dfd-16ab-483f-8825-587d75a1026c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.913532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343dfd-16ab-483f-8825-587d75a1026c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.913807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343dfd-16ab-483f-8825-587d75a1026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.931982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b1343dfd-16ab-483f-8825-587d75a1026c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.933289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b1343dfd-16ab-483f-8825-587d75a1026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.941245 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 772/1561] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.942422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b96aa0-ab13-4ec2-8049-c03bb075ed17 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.942705 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b96aa0-ab13-4ec2-8049-c03bb075ed17 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.942979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b96aa0-ab13-4ec2-8049-c03bb075ed17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.959879 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e6b96aa0-ab13-4ec2-8049-c03bb075ed17 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.961128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e6b96aa0-ab13-4ec2-8049-c03bb075ed17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:39.969621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 773/1562] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:39.971627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb64eac-ce60-4aec-bcd9-c99d455bfeda None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:39.971921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb64eac-ce60-4aec-bcd9-c99d455bfeda None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:39.972246 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb64eac-ce60-4aec-bcd9-c99d455bfeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:39.990649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2cb64eac-ce60-4aec-bcd9-c99d455bfeda None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:39.991871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2cb64eac-ce60-4aec-bcd9-c99d455bfeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:40.000118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 774/1563] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:40.000939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb64eac-ce60-4aec-bcd9-c99d455bfeda None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.010454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb64eac-ce60-4aec-bcd9-c99d455bfeda None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.013845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 790/1564] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:22:39 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:40.013845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761b4ef-2d8c-4b52-9499-470e704b4804 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.019653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20471a-14f9-43a1-89ed-4879edbd7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.019653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20471a-14f9-43a1-89ed-4879edbd7eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.019653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20471a-14f9-43a1-89ed-4879edbd7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.019653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20471a-14f9-43a1-89ed-4879edbd7eb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.020061 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20471a-14f9-43a1-89ed-4879edbd7eb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:22:40.020061 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20471a-14f9-43a1-89ed-4879edbd7eb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.021171 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20471a-14f9-43a1-89ed-4879edbd7eb7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.022517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761b4ef-2d8c-4b52-9499-470e704b4804 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.027275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ded195-f542-4373-8e12-8b2c3e672a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.027927 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ded195-f542-4373-8e12-8b2c3e672a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.028243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ded195-f542-4373-8e12-8b2c3e672a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.028527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ded195-f542-4373-8e12-8b2c3e672a99 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.029206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ded195-f542-4373-8e12-8b2c3e672a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.031985 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ded195-f542-4373-8e12-8b2c3e672a99 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.041151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 775/1565] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:22:40.041151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20471a-14f9-43a1-89ed-4879edbd7eb7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.046386 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20471a-14f9-43a1-89ed-4879edbd7eb7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.051150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a96a3-1cd3-4d87-835d-f3656d11c16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.053951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a96a3-1cd3-4d87-835d-f3656d11c16e admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.053951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a96a3-1cd3-4d87-835d-f3656d11c16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.053951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a96a3-1cd3-4d87-835d-f3656d11c16e admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.053951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a96a3-1cd3-4d87-835d-f3656d11c16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.054650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a96a3-1cd3-4d87-835d-f3656d11c16e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.056879 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:40.065597 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 776/1566] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:40.066540 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a96a3-1cd3-4d87-835d-f3656d11c16e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.075876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a96a3-1cd3-4d87-835d-f3656d11c16e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.081233 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a1f9c-7553-4a2a-bc90-ba6e963c9b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.081862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a1f9c-7553-4a2a-bc90-ba6e963c9b60 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.082644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a1f9c-7553-4a2a-bc90-ba6e963c9b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.082644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a1f9c-7553-4a2a-bc90-ba6e963c9b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.083135 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a1f9c-7553-4a2a-bc90-ba6e963c9b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.085033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a1f9c-7553-4a2a-bc90-ba6e963c9b60 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.143017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 791/1567] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:22:40 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:40.143916 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ded195-f542-4373-8e12-8b2c3e672a99 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.154196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ded195-f542-4373-8e12-8b2c3e672a99 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.159592 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a81ee1-eb57-43f9-9020-ea4f5d4b041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.160269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a81ee1-eb57-43f9-9020-ea4f5d4b041a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.160554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a81ee1-eb57-43f9-9020-ea4f5d4b041a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.160865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a81ee1-eb57-43f9-9020-ea4f5d4b041a admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.161589 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a81ee1-eb57-43f9-9020-ea4f5d4b041a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:22:40.161894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a81ee1-eb57-43f9-9020-ea4f5d4b041a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.163570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a81ee1-eb57-43f9-9020-ea4f5d4b041a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.176931 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 792/1568] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:22:40.177878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a81ee1-eb57-43f9-9020-ea4f5d4b041a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.188265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a81ee1-eb57-43f9-9020-ea4f5d4b041a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.191870 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 777/1569] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:22:40 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:40.192743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a1f9c-7553-4a2a-bc90-ba6e963c9b60 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.192941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ae939-6eab-4eea-83e1-0dc7c78da3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.193580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ae939-6eab-4eea-83e1-0dc7c78da3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.193863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ae939-6eab-4eea-83e1-0dc7c78da3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.194137 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ae939-6eab-4eea-83e1-0dc7c78da3a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.195089 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ae939-6eab-4eea-83e1-0dc7c78da3a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:22:40.195199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ae939-6eab-4eea-83e1-0dc7c78da3a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.196757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ae939-6eab-4eea-83e1-0dc7c78da3a2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.208604 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 793/1570] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:22:40.209399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ae939-6eab-4eea-83e1-0dc7c78da3a2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.219070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ae939-6eab-4eea-83e1-0dc7c78da3a2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.256593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a1f9c-7553-4a2a-bc90-ba6e963c9b60 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.261555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441525d-7ea2-4c72-b663-3cb10d5c4d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.262215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441525d-7ea2-4c72-b663-3cb10d5c4d98 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.262496 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441525d-7ea2-4c72-b663-3cb10d5c4d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.262770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441525d-7ea2-4c72-b663-3cb10d5c4d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.263493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441525d-7ea2-4c72-b663-3cb10d5c4d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:22:40.263797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441525d-7ea2-4c72-b663-3cb10d5c4d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.266001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441525d-7ea2-4c72-b663-3cb10d5c4d98 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.277326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 778/1571] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:22:40.278092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441525d-7ea2-4c72-b663-3cb10d5c4d98 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.282763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8ac32-fa4b-4951-bffe-4f9b487d59ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.283738 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8ac32-fa4b-4951-bffe-4f9b487d59ac admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.284061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8ac32-fa4b-4951-bffe-4f9b487d59ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.285014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8ac32-fa4b-4951-bffe-4f9b487d59ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.285719 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8ac32-fa4b-4951-bffe-4f9b487d59ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.287546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8ac32-fa4b-4951-bffe-4f9b487d59ac admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.288098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441525d-7ea2-4c72-b663-3cb10d5c4d98 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.292723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864a97-401d-47a9-8912-214c212e7362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.293350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864a97-401d-47a9-8912-214c212e7362 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.293630 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864a97-401d-47a9-8912-214c212e7362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.293902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864a97-401d-47a9-8912-214c212e7362 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.294571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2864a97-401d-47a9-8912-214c212e7362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.297099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2864a97-401d-47a9-8912-214c212e7362 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.301188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 794/1572] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:40.301188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8ac32-fa4b-4951-bffe-4f9b487d59ac admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.308765 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8ac32-fa4b-4951-bffe-4f9b487d59ac admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.313994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5adcf-a4b9-4129-abea-22284c2b48a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.314644 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5adcf-a4b9-4129-abea-22284c2b48a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.314930 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5adcf-a4b9-4129-abea-22284c2b48a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.315205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5adcf-a4b9-4129-abea-22284c2b48a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.315917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5adcf-a4b9-4129-abea-22284c2b48a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.317513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5adcf-a4b9-4129-abea-22284c2b48a0 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.327411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 795/1573] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:40.328939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5adcf-a4b9-4129-abea-22284c2b48a0 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.338794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5adcf-a4b9-4129-abea-22284c2b48a0 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.343558 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742c8b9-e604-49ee-ae4f-4c245e40d4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.344214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742c8b9-e604-49ee-ae4f-4c245e40d4dd admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.344502 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742c8b9-e604-49ee-ae4f-4c245e40d4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.344778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742c8b9-e604-49ee-ae4f-4c245e40d4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.345479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742c8b9-e604-49ee-ae4f-4c245e40d4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.347013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742c8b9-e604-49ee-ae4f-4c245e40d4dd admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.357280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 796/1574] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:40.362214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742c8b9-e604-49ee-ae4f-4c245e40d4dd admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.368222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742c8b9-e604-49ee-ae4f-4c245e40d4dd admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.375934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca7178-d872-4b9d-962b-d9d91f980190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.376647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca7178-d872-4b9d-962b-d9d91f980190 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.376937 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca7178-d872-4b9d-962b-d9d91f980190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.377218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca7178-d872-4b9d-962b-d9d91f980190 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.377896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca7178-d872-4b9d-962b-d9d91f980190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.380556 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 779/1575] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:22:40 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:40.381632 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca7178-d872-4b9d-962b-d9d91f980190 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.381757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864a97-401d-47a9-8912-214c212e7362 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.442391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864a97-401d-47a9-8912-214c212e7362 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.447034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e4d02-bf8c-4c4e-be3b-c0771e2382f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.447724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e4d02-bf8c-4c4e-be3b-c0771e2382f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.448039 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e4d02-bf8c-4c4e-be3b-c0771e2382f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.448321 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e4d02-bf8c-4c4e-be3b-c0771e2382f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.449074 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e4d02-bf8c-4c4e-be3b-c0771e2382f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.451002 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e4d02-bf8c-4c4e-be3b-c0771e2382f1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.464942 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 797/1576] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:22:40 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:40.465895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca7178-d872-4b9d-962b-d9d91f980190 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.474709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:40.525910 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 780/1577] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:22:40 2022] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:40.526862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e4d02-bf8c-4c4e-be3b-c0771e2382f1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.527548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca7178-d872-4b9d-962b-d9d91f980190 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.533004 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774589-76b4-4e3b-a57f-0199b0cddbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.533672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774589-76b4-4e3b-a57f-0199b0cddbfd admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.533952 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774589-76b4-4e3b-a57f-0199b0cddbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.534228 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774589-76b4-4e3b-a57f-0199b0cddbfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.534917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774589-76b4-4e3b-a57f-0199b0cddbfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.536855 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774589-76b4-4e3b-a57f-0199b0cddbfd admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.537187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e4d02-bf8c-4c4e-be3b-c0771e2382f1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.542041 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da6026-ced4-449b-8de3-80e592548b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.542693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da6026-ced4-449b-8de3-80e592548b46 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.542980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da6026-ced4-449b-8de3-80e592548b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.543260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da6026-ced4-449b-8de3-80e592548b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.543946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da6026-ced4-449b-8de3-80e592548b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.545917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da6026-ced4-449b-8de3-80e592548b46 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.633907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 798/1578] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:22:40 2022] POST /identity/v3/projects => generated 405 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:40.634742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774589-76b4-4e3b-a57f-0199b0cddbfd admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.652345 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 781/1579] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:22:40 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:40.653442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da6026-ced4-449b-8de3-80e592548b46 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.673626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:40.702566 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774589-76b4-4e3b-a57f-0199b0cddbfd admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.720137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da6026-ced4-449b-8de3-80e592548b46 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.725784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f570f-708e-4d93-98cb-b585df5ba202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.726717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f570f-708e-4d93-98cb-b585df5ba202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.727001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f570f-708e-4d93-98cb-b585df5ba202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.727279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f570f-708e-4d93-98cb-b585df5ba202 admin admin] PATH_INFO: `/v3/projects/f6a35ed4d1dc4870924884d706f5bc95/users/69e33c07f0844f228bef34d242d3be11/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.745650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f570f-708e-4d93-98cb-b585df5ba202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a35ed4d1dc4870924884d706f5bc95, user_id=69e33c07f0844f228bef34d242d3be11, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.746697 dv-cinder-849800-1-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-0c5f570f-708e-4d93-98cb-b585df5ba202 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:22:40.746697 dv-cinder-849800-1-smb devstack@keystone.service[80503]: warnings.warn(msg) Jul 14 10:22:40.746697 dv-cinder-849800-1-smb devstack@keystone.service[80503]: Jul 14 10:22:40.748742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f570f-708e-4d93-98cb-b585df5ba202 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.755972 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54e152-3be1-402d-bee1-e158ca584432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.756786 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54e152-3be1-402d-bee1-e158ca584432 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.757099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54e152-3be1-402d-bee1-e158ca584432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.757381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54e152-3be1-402d-bee1-e158ca584432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.758107 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54e152-3be1-402d-bee1-e158ca584432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.759874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54e152-3be1-402d-bee1-e158ca584432 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.770394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 799/1580] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:40.771343 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54e152-3be1-402d-bee1-e158ca584432 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.781310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54e152-3be1-402d-bee1-e158ca584432 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.786062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983be50b-ef91-46d9-a809-be6eb5cff488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.786730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983be50b-ef91-46d9-a809-be6eb5cff488 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.787014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983be50b-ef91-46d9-a809-be6eb5cff488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.787291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983be50b-ef91-46d9-a809-be6eb5cff488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.788113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983be50b-ef91-46d9-a809-be6eb5cff488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.789659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983be50b-ef91-46d9-a809-be6eb5cff488 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.799243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 800/1581] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:40.799978 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983be50b-ef91-46d9-a809-be6eb5cff488 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.809013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983be50b-ef91-46d9-a809-be6eb5cff488 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.813622 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fa19d-e626-4a17-a0a8-22dd6967dc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.814237 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fa19d-e626-4a17-a0a8-22dd6967dc16 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.814523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fa19d-e626-4a17-a0a8-22dd6967dc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.814838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fa19d-e626-4a17-a0a8-22dd6967dc16 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.815500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fa19d-e626-4a17-a0a8-22dd6967dc16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.818500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fa19d-e626-4a17-a0a8-22dd6967dc16 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.840127 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 782/1582] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:40 2022] PUT /identity/v3/projects/f6a35ed4d1dc4870924884d706f5bc95/users/69e33c07f0844f228bef34d242d3be11/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:40.841444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f570f-708e-4d93-98cb-b585df5ba202 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.888393 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 801/1583] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:22:40 2022] POST /identity/v3/users => generated 284 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:40.888393 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fa19d-e626-4a17-a0a8-22dd6967dc16 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.896818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fa19d-e626-4a17-a0a8-22dd6967dc16 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.900857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:40.907980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f570f-708e-4d93-98cb-b585df5ba202 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.913054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a089f-8d4f-4972-a38d-e4fef2eef425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.913725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a089f-8d4f-4972-a38d-e4fef2eef425 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.914134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a089f-8d4f-4972-a38d-e4fef2eef425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.914420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a089f-8d4f-4972-a38d-e4fef2eef425 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.915112 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a089f-8d4f-4972-a38d-e4fef2eef425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.917200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a089f-8d4f-4972-a38d-e4fef2eef425 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.954498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bec713-637e-4258-83cd-040857456a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.955131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bec713-637e-4258-83cd-040857456a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.955415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bec713-637e-4258-83cd-040857456a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.955691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bec713-637e-4258-83cd-040857456a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.956446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bec713-637e-4258-83cd-040857456a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.958100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bec713-637e-4258-83cd-040857456a69 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:40.968003 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 802/1584] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:40.968928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bec713-637e-4258-83cd-040857456a69 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:40.978276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bec713-637e-4258-83cd-040857456a69 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:40.983303 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc47a3b-9a3a-4314-921c-24a335d1cb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:40.983941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47a3b-9a3a-4314-921c-24a335d1cb44 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:40.984258 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47a3b-9a3a-4314-921c-24a335d1cb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:40.984535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47a3b-9a3a-4314-921c-24a335d1cb44 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:40.985204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc47a3b-9a3a-4314-921c-24a335d1cb44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:40.987063 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc47a3b-9a3a-4314-921c-24a335d1cb44 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.017544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 783/1585] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:22:40 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:41.018202 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a089f-8d4f-4972-a38d-e4fef2eef425 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.027653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a089f-8d4f-4972-a38d-e4fef2eef425 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.033035 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fed838-2ccd-427e-b1a6-0d89620ff22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.036902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed838-2ccd-427e-b1a6-0d89620ff22b admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.036902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed838-2ccd-427e-b1a6-0d89620ff22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.036902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed838-2ccd-427e-b1a6-0d89620ff22b admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.036902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fed838-2ccd-427e-b1a6-0d89620ff22b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.036902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fed838-2ccd-427e-b1a6-0d89620ff22b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.082986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 803/1586] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:22:40 2022] POST /identity/v3/users => generated 303 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:41.082986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc47a3b-9a3a-4314-921c-24a335d1cb44 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.090264 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc47a3b-9a3a-4314-921c-24a335d1cb44 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.095667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589f7cd-3e00-4f91-9305-1974ddaf5910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.096549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f7cd-3e00-4f91-9305-1974ddaf5910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.096841 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f7cd-3e00-4f91-9305-1974ddaf5910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.097113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f7cd-3e00-4f91-9305-1974ddaf5910 admin admin] PATH_INFO: `/v3/projects/ebd2096f6b69426c86fd19d39bc89288/users/84d2de5b7eb34c0893fa8f37d1341b64/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.103709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 784/1587] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:22:41 2022] POST /identity/v3/users => generated 289 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:41.103709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fed838-2ccd-427e-b1a6-0d89620ff22b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.113472 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fed838-2ccd-427e-b1a6-0d89620ff22b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.114661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589f7cd-3e00-4f91-9305-1974ddaf5910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd2096f6b69426c86fd19d39bc89288, user_id=84d2de5b7eb34c0893fa8f37d1341b64, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.117632 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589f7cd-3e00-4f91-9305-1974ddaf5910 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.118119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdc3be-96d8-4195-bcd0-2802204447f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.118996 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdc3be-96d8-4195-bcd0-2802204447f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.119281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdc3be-96d8-4195-bcd0-2802204447f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.119555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdc3be-96d8-4195-bcd0-2802204447f1 admin admin] PATH_INFO: `/v3/projects/e16fee8a36414573a2f2cbaba2df5631/users/9784f292f7724b7e97e84c4f75b6a767/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.134595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdc3be-96d8-4195-bcd0-2802204447f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16fee8a36414573a2f2cbaba2df5631, user_id=9784f292f7724b7e97e84c4f75b6a767, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.137465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdc3be-96d8-4195-bcd0-2802204447f1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.188015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 804/1588] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:41 2022] PUT /identity/v3/projects/ebd2096f6b69426c86fd19d39bc89288/users/84d2de5b7eb34c0893fa8f37d1341b64/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:41.189300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ca895-def7-4445-b870-dc2a046b98bc None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.189586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ca895-def7-4445-b870-dc2a046b98bc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.189859 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ca895-def7-4445-b870-dc2a046b98bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.207120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7c6ca895-def7-4445-b870-dc2a046b98bc None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:41.208285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7c6ca895-def7-4445-b870-dc2a046b98bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:41.222196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 785/1589] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:41 2022] PUT /identity/v3/projects/e16fee8a36414573a2f2cbaba2df5631/users/9784f292f7724b7e97e84c4f75b6a767/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:41.225283 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdc3be-96d8-4195-bcd0-2802204447f1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.272182 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:41.280390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 805/1590] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:41.282016 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ca895-def7-4445-b870-dc2a046b98bc None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.286660 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdc3be-96d8-4195-bcd0-2802204447f1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.292048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ca895-def7-4445-b870-dc2a046b98bc None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.293283 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275aaaa-76d1-453f-833e-1042793a5a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.294001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275aaaa-76d1-453f-833e-1042793a5a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.294330 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275aaaa-76d1-453f-833e-1042793a5a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.294690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275aaaa-76d1-453f-833e-1042793a5a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.296141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275aaaa-76d1-453f-833e-1042793a5a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.297562 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc7c21-3105-493e-9474-bfd808dd6998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.297771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275aaaa-76d1-453f-833e-1042793a5a7f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.298233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc7c21-3105-493e-9474-bfd808dd6998 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.298524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc7c21-3105-493e-9474-bfd808dd6998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.298799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc7c21-3105-493e-9474-bfd808dd6998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.299572 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc7c21-3105-493e-9474-bfd808dd6998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.301331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc7c21-3105-493e-9474-bfd808dd6998 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.311422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 786/1591] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:41.314934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 806/1592] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:41.315074 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275aaaa-76d1-453f-833e-1042793a5a7f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.315211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc7c21-3105-493e-9474-bfd808dd6998 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.322103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc7c21-3105-493e-9474-bfd808dd6998 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.322636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275aaaa-76d1-453f-833e-1042793a5a7f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.326956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f57a0-9997-4aed-bf5c-258fca02a6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.327237 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10ddb3-3077-406c-915e-64f906d98d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.327603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f57a0-9997-4aed-bf5c-258fca02a6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.327892 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f57a0-9997-4aed-bf5c-258fca02a6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.328024 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ddb3-3077-406c-915e-64f906d98d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.328199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f57a0-9997-4aed-bf5c-258fca02a6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.328309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ddb3-3077-406c-915e-64f906d98d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.328476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ddb3-3077-406c-915e-64f906d98d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.328972 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f57a0-9997-4aed-bf5c-258fca02a6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.329356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10ddb3-3077-406c-915e-64f906d98d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.330573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f57a0-9997-4aed-bf5c-258fca02a6a4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.330984 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10ddb3-3077-406c-915e-64f906d98d73 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.341141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 807/1593] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:41.341757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 787/1594] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:41.342481 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f57a0-9997-4aed-bf5c-258fca02a6a4 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.343524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dc884-ba77-471e-9567-cd9e69159040 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.343816 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dc884-ba77-471e-9567-cd9e69159040 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.344128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dc884-ba77-471e-9567-cd9e69159040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.352470 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f57a0-9997-4aed-bf5c-258fca02a6a4 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.357060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641c38e-1463-4ee5-ade4-dcd16235c188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.358516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641c38e-1463-4ee5-ade4-dcd16235c188 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.358799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641c38e-1463-4ee5-ade4-dcd16235c188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.359071 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641c38e-1463-4ee5-ade4-dcd16235c188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.359789 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641c38e-1463-4ee5-ade4-dcd16235c188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.361771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641c38e-1463-4ee5-ade4-dcd16235c188 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.363152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-346dc884-ba77-471e-9567-cd9e69159040 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:41.364471 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-346dc884-ba77-471e-9567-cd9e69159040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:41.372423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 788/1595] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:41.376136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d18191-71e8-4f8d-809e-b17c9779c6b7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.376331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 808/1596] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:41.376441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d18191-71e8-4f8d-809e-b17c9779c6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.376441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d18191-71e8-4f8d-809e-b17c9779c6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.376689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641c38e-1463-4ee5-ade4-dcd16235c188 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.403669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c5d18191-71e8-4f8d-809e-b17c9779c6b7 None None] MFA Rules not processed for user `9784f292f7724b7e97e84c4f75b6a767`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:41.404943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c5d18191-71e8-4f8d-809e-b17c9779c6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:41.410449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:41.434152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641c38e-1463-4ee5-ade4-dcd16235c188 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.438416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae9555-3035-4102-9055-ee4491e10afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.439091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae9555-3035-4102-9055-ee4491e10afb service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.439373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae9555-3035-4102-9055-ee4491e10afb service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.439646 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae9555-3035-4102-9055-ee4491e10afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.448746 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae9555-3035-4102-9055-ee4491e10afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.450174 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae9555-3035-4102-9055-ee4491e10afb service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.460832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 809/1597] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:41.461574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae9555-3035-4102-9055-ee4491e10afb service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.470604 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae9555-3035-4102-9055-ee4491e10afb service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.471074 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 789/1598] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:41.471871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d18191-71e8-4f8d-809e-b17c9779c6b7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.479184 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3c544-7df3-4bae-8eaf-f1066cd72049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.479861 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3c544-7df3-4bae-8eaf-f1066cd72049 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.480178 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3c544-7df3-4bae-8eaf-f1066cd72049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.480455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3c544-7df3-4bae-8eaf-f1066cd72049 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.481186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3c544-7df3-4bae-8eaf-f1066cd72049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.482615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d18191-71e8-4f8d-809e-b17c9779c6b7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.483153 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3c544-7df3-4bae-8eaf-f1066cd72049 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.487457 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d1725-c22a-4780-998c-c85c742da1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.488413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d1725-c22a-4780-998c-c85c742da1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.488699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d1725-c22a-4780-998c-c85c742da1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.488969 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d1725-c22a-4780-998c-c85c742da1a1 admin admin] PATH_INFO: `/v3/projects/4cc0556d9ff741a295bd274063056fb7/users/8acb1c9eead84a11a48c1a217ce82584/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.496067 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 810/1599] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:41.499458 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3c544-7df3-4bae-8eaf-f1066cd72049 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.505389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d1725-c22a-4780-998c-c85c742da1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc0556d9ff741a295bd274063056fb7, user_id=8acb1c9eead84a11a48c1a217ce82584, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.508255 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d1725-c22a-4780-998c-c85c742da1a1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.508833 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3c544-7df3-4bae-8eaf-f1066cd72049 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.513500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e30d9a-f07c-4d98-974a-ecd8f63a4cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.514707 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e30d9a-f07c-4d98-974a-ecd8f63a4cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.514994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e30d9a-f07c-4d98-974a-ecd8f63a4cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.515277 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e30d9a-f07c-4d98-974a-ecd8f63a4cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.516039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e30d9a-f07c-4d98-974a-ecd8f63a4cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.517594 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e30d9a-f07c-4d98-974a-ecd8f63a4cf5 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.527678 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 811/1600] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:41.528492 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e30d9a-f07c-4d98-974a-ecd8f63a4cf5 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.537654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e30d9a-f07c-4d98-974a-ecd8f63a4cf5 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.542279 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d519ce-a93d-4118-a456-69c6691af68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.542898 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d519ce-a93d-4118-a456-69c6691af68d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.543179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d519ce-a93d-4118-a456-69c6691af68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.543456 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d519ce-a93d-4118-a456-69c6691af68d admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.544189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d519ce-a93d-4118-a456-69c6691af68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.546276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d519ce-a93d-4118-a456-69c6691af68d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.557421 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 812/1601] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:41.557421 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d519ce-a93d-4118-a456-69c6691af68d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.568107 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d519ce-a93d-4118-a456-69c6691af68d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.572814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce062685-5792-483a-b2bb-36faca0f0b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.573454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce062685-5792-483a-b2bb-36faca0f0b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.573741 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce062685-5792-483a-b2bb-36faca0f0b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.574030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce062685-5792-483a-b2bb-36faca0f0b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.574764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce062685-5792-483a-b2bb-36faca0f0b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.576964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce062685-5792-483a-b2bb-36faca0f0b65 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.588219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 813/1603] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:41.591533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 790/1603] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:41 2022] PUT /identity/v3/projects/4cc0556d9ff741a295bd274063056fb7/users/8acb1c9eead84a11a48c1a217ce82584/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:41.591659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce062685-5792-483a-b2bb-36faca0f0b65 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.591756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d1725-c22a-4780-998c-c85c742da1a1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.603287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce062685-5792-483a-b2bb-36faca0f0b65 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.655285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d1725-c22a-4780-998c-c85c742da1a1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.659970 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a0796-80f1-4594-a9d9-6c1e17433fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.661155 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a0796-80f1-4594-a9d9-6c1e17433fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.661602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a0796-80f1-4594-a9d9-6c1e17433fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.662057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a0796-80f1-4594-a9d9-6c1e17433fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.668186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a39ac6-eef4-4a64-91e9-7b0f43144302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.668939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a39ac6-eef4-4a64-91e9-7b0f43144302 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.669293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a39ac6-eef4-4a64-91e9-7b0f43144302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.669646 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a39ac6-eef4-4a64-91e9-7b0f43144302 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.670442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a39ac6-eef4-4a64-91e9-7b0f43144302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.672455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a39ac6-eef4-4a64-91e9-7b0f43144302 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.706777 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:41.723534 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a0796-80f1-4594-a9d9-6c1e17433fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.724960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a0796-80f1-4594-a9d9-6c1e17433fa8 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.735541 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 791/1604] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:41.736383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a0796-80f1-4594-a9d9-6c1e17433fa8 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.745421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a0796-80f1-4594-a9d9-6c1e17433fa8 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.750738 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6f513-b5c2-4f27-bdc5-5dda77ae8c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.751654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6f513-b5c2-4f27-bdc5-5dda77ae8c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.751946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6f513-b5c2-4f27-bdc5-5dda77ae8c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.752256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6f513-b5c2-4f27-bdc5-5dda77ae8c53 admin admin] PATH_INFO: `/v3/projects/7b6404d54f1e452983cebaf5e94d0b4a/users/b910f5306e8740b3a133e9a18082511b/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.761001 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 814/1605] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:22:41 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:41.762482 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a39ac6-eef4-4a64-91e9-7b0f43144302 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.772016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6f513-b5c2-4f27-bdc5-5dda77ae8c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6404d54f1e452983cebaf5e94d0b4a, user_id=b910f5306e8740b3a133e9a18082511b, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.774882 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6f513-b5c2-4f27-bdc5-5dda77ae8c53 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.839548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a39ac6-eef4-4a64-91e9-7b0f43144302 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.845958 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 792/1606] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:41 2022] PUT /identity/v3/projects/7b6404d54f1e452983cebaf5e94d0b4a/users/b910f5306e8740b3a133e9a18082511b/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:41.846819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6f513-b5c2-4f27-bdc5-5dda77ae8c53 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:41.870143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:41.911837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6371f3-d60a-438d-983a-31780c68dfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.912143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6f513-b5c2-4f27-bdc5-5dda77ae8c53 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:41.912770 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6371f3-d60a-438d-983a-31780c68dfdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.913059 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6371f3-d60a-438d-983a-31780c68dfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.913338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6371f3-d60a-438d-983a-31780c68dfdd admin admin] PATH_INFO: `/v3/projects/e82284556044433d8dcb0708829c8690/users/ab332425ad2d4cad9892caf3345719b7/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.920892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a12abf-28c0-4e3f-9284-0d70e407a6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:41.921802 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a12abf-28c0-4e3f-9284-0d70e407a6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:41.922081 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a12abf-28c0-4e3f-9284-0d70e407a6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:41.922362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a12abf-28c0-4e3f-9284-0d70e407a6c2 admin admin] PATH_INFO: `/v3/projects/f8ea98bf8c60422f97341a1a3afe7c3b/users/966f1a7def864f4b99c372318dd1e66f/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:41.928962 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6371f3-d60a-438d-983a-31780c68dfdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82284556044433d8dcb0708829c8690, user_id=ab332425ad2d4cad9892caf3345719b7, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.932340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6371f3-d60a-438d-983a-31780c68dfdd admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:41.939861 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a12abf-28c0-4e3f-9284-0d70e407a6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ea98bf8c60422f97341a1a3afe7c3b, user_id=966f1a7def864f4b99c372318dd1e66f, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:41.942571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a12abf-28c0-4e3f-9284-0d70e407a6c2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:42.011528 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 793/1607] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:41 2022] PUT /identity/v3/projects/f8ea98bf8c60422f97341a1a3afe7c3b/users/966f1a7def864f4b99c372318dd1e66f/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:42.015476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563ce1e-5b0c-4649-b73a-153cd6787f9f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:42.015476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563ce1e-5b0c-4649-b73a-153cd6787f9f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:42.015476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563ce1e-5b0c-4649-b73a-153cd6787f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:42.025169 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 815/1608] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:41 2022] PUT /identity/v3/projects/e82284556044433d8dcb0708829c8690/users/ab332425ad2d4cad9892caf3345719b7/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:42.026513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6371f3-d60a-438d-983a-31780c68dfdd admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:42.046610 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4563ce1e-5b0c-4649-b73a-153cd6787f9f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:42.047982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4563ce1e-5b0c-4649-b73a-153cd6787f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:42.102685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6371f3-d60a-438d-983a-31780c68dfdd admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:42.117551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 794/1609] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:42.119148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563ce1e-5b0c-4649-b73a-153cd6787f9f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:42.134615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563ce1e-5b0c-4649-b73a-153cd6787f9f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:42.143735 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b30fc-a5e4-43bb-acad-ee45fe5e9df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:42.145699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b30fc-a5e4-43bb-acad-ee45fe5e9df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:42.146103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b30fc-a5e4-43bb-acad-ee45fe5e9df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:42.146484 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b30fc-a5e4-43bb-acad-ee45fe5e9df3 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:42.147320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b30fc-a5e4-43bb-acad-ee45fe5e9df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:42.150051 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b30fc-a5e4-43bb-acad-ee45fe5e9df3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:42.172196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43961cd3-89dd-428b-9756-a991f70c6df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:42.173415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43961cd3-89dd-428b-9756-a991f70c6df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:42.173415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43961cd3-89dd-428b-9756-a991f70c6df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:42.173793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43961cd3-89dd-428b-9756-a991f70c6df6 admin admin] PATH_INFO: `/v3/projects/d6357076e00c4064a61a14fdb6b84aa1/users/35057047c93946a7a1ff01bd649abd9c/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:42.190389 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43961cd3-89dd-428b-9756-a991f70c6df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6357076e00c4064a61a14fdb6b84aa1, user_id=35057047c93946a7a1ff01bd649abd9c, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:42.193277 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43961cd3-89dd-428b-9756-a991f70c6df6 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:42.279866 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 795/1610] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:22:42 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:42.280241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 816/1611] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:42 2022] PUT /identity/v3/projects/d6357076e00c4064a61a14fdb6b84aa1/users/35057047c93946a7a1ff01bd649abd9c/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:42.280338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff0946-a820-41f0-8a1c-623ffeae1bc8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:42.280338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff0946-a820-41f0-8a1c-623ffeae1bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:42.280500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61cab4-5c26-44a1-91f3-801a0fa0c10b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:42.280575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff0946-a820-41f0-8a1c-623ffeae1bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:42.280649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61cab4-5c26-44a1-91f3-801a0fa0c10b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:42.280649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61cab4-5c26-44a1-91f3-801a0fa0c10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:42.335445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a1ff0946-a820-41f0-8a1c-623ffeae1bc8 None None] MFA Rules not processed for user `b910f5306e8740b3a133e9a18082511b`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:42.340253 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a1ff0946-a820-41f0-8a1c-623ffeae1bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:42.340407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-bb61cab4-5c26-44a1-91f3-801a0fa0c10b None None] MFA Rules not processed for user `966f1a7def864f4b99c372318dd1e66f`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:42.341007 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bb61cab4-5c26-44a1-91f3-801a0fa0c10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:42.353709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:42.391443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:42.447281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 796/1612] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:42.447281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6bb1b-7c7f-4290-bdbb-3d1a8f728584 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:42.447281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6bb1b-7c7f-4290-bdbb-3d1a8f728584 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:42.447281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6bb1b-7c7f-4290-bdbb-3d1a8f728584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:42.454455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 817/1613] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:42.458712 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61cab4-5c26-44a1-91f3-801a0fa0c10b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:42.460202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bb61cab4-5c26-44a1-91f3-801a0fa0c10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:42.482017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6db6bb1b-7c7f-4290-bdbb-3d1a8f728584 None None] MFA Rules not processed for user `ab332425ad2d4cad9892caf3345719b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:42.484201 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6db6bb1b-7c7f-4290-bdbb-3d1a8f728584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:42.526756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61cab4-5c26-44a1-91f3-801a0fa0c10b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:42.531689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e1ebd-deb4-4e33-a838-576d02216aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:42.532705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e1ebd-deb4-4e33-a838-576d02216aac service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:42.532831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e1ebd-deb4-4e33-a838-576d02216aac service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:42.533129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e1ebd-deb4-4e33-a838-576d02216aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:42.557169 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 797/1614] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:42.561780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6bb1b-7c7f-4290-bdbb-3d1a8f728584 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:42.615221 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e1ebd-deb4-4e33-a838-576d02216aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:42.616704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e1ebd-deb4-4e33-a838-576d02216aac service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:42.640724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6bb1b-7c7f-4290-bdbb-3d1a8f728584 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:42.646040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 818/1615] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:42.646192 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d683d-8be7-4b92-8b4c-6832407a23dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:42.646833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d683d-8be7-4b92-8b4c-6832407a23dc admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:42.647118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d683d-8be7-4b92-8b4c-6832407a23dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:42.647380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7064-ae4a-4846-a458-24b954890f2c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:42.647491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d683d-8be7-4b92-8b4c-6832407a23dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:42.647672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7064-ae4a-4846-a458-24b954890f2c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:42.647950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7064-ae4a-4846-a458-24b954890f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:42.648161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d683d-8be7-4b92-8b4c-6832407a23dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:42.649937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d683d-8be7-4b92-8b4c-6832407a23dc admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:42.666003 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 798/1616] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:42.667698 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d683d-8be7-4b92-8b4c-6832407a23dc admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:42.684242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b91e7064-ae4a-4846-a458-24b954890f2c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:42.685489 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b91e7064-ae4a-4846-a458-24b954890f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:42.686340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d683d-8be7-4b92-8b4c-6832407a23dc admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:42.693785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2c2bd-2b15-4ee8-9e0f-117db70e5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:42.694587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2c2bd-2b15-4ee8-9e0f-117db70e5007 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:42.694882 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2c2bd-2b15-4ee8-9e0f-117db70e5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:42.695146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2c2bd-2b15-4ee8-9e0f-117db70e5007 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:42.696018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2c2bd-2b15-4ee8-9e0f-117db70e5007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:42.700533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 819/1617] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:42.700533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7064-ae4a-4846-a458-24b954890f2c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:42.700799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2c2bd-2b15-4ee8-9e0f-117db70e5007 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:42.716558 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7064-ae4a-4846-a458-24b954890f2c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:42.724661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401ef3f-0745-4f6e-945b-bba1650b30b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:42.725616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401ef3f-0745-4f6e-945b-bba1650b30b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:42.725972 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401ef3f-0745-4f6e-945b-bba1650b30b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:42.726771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401ef3f-0745-4f6e-945b-bba1650b30b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:42.727476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401ef3f-0745-4f6e-945b-bba1650b30b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:42.729782 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401ef3f-0745-4f6e-945b-bba1650b30b2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:42.810622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 799/1618] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:22:42 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:42.812390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a87a6c-42ca-4a34-a19c-d95472d1ba17 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:42.812833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a87a6c-42ca-4a34-a19c-d95472d1ba17 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:42.813283 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a87a6c-42ca-4a34-a19c-d95472d1ba17 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:42.814783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 800/1619] 10.222.0.74 () {54 vars in 961 bytes} [Thu Jul 14 10:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:22:42.815624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a87a6c-42ca-4a34-a19c-d95472d1ba17 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:42.834816 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:42.853157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 820/1620] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:22:42 2022] POST /identity/v3/projects => generated 405 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:42.858260 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401ef3f-0745-4f6e-945b-bba1650b30b2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:42.896872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a87a6c-42ca-4a34-a19c-d95472d1ba17 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:42.925249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:42.944957 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401ef3f-0745-4f6e-945b-bba1650b30b2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:42.948803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43fe0a-5056-4135-b752-c4442141222f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:42.949474 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43fe0a-5056-4135-b752-c4442141222f service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:42.949761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43fe0a-5056-4135-b752-c4442141222f service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:42.950066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43fe0a-5056-4135-b752-c4442141222f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:42.969097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58039d2a-13dd-48a8-8ac4-099a119419d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:42.971695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58039d2a-13dd-48a8-8ac4-099a119419d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:42.971695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58039d2a-13dd-48a8-8ac4-099a119419d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:42.971695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58039d2a-13dd-48a8-8ac4-099a119419d0 admin admin] PATH_INFO: `/v3/projects/d220e86536a7423e8b618e1c76f6c2e6/users/54eceb89ffd649088ca775317968eeb8/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:42.986845 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58039d2a-13dd-48a8-8ac4-099a119419d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d220e86536a7423e8b618e1c76f6c2e6, user_id=54eceb89ffd649088ca775317968eeb8, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:42.989536 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58039d2a-13dd-48a8-8ac4-099a119419d0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:43.016595 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43fe0a-5056-4135-b752-c4442141222f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:43.018204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43fe0a-5056-4135-b752-c4442141222f service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:43.028901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 821/1621] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:43.029922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43fe0a-5056-4135-b752-c4442141222f service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:43.040038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43fe0a-5056-4135-b752-c4442141222f service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:43.047109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ba780-fda5-40b5-8326-d1d7dc445dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:43.047912 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ba780-fda5-40b5-8326-d1d7dc445dfc admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:43.048229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ba780-fda5-40b5-8326-d1d7dc445dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:43.048565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ba780-fda5-40b5-8326-d1d7dc445dfc admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:43.049626 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ba780-fda5-40b5-8326-d1d7dc445dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:43.051744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ba780-fda5-40b5-8326-d1d7dc445dfc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:43.103605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 801/1622] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:42 2022] PUT /identity/v3/projects/d220e86536a7423e8b618e1c76f6c2e6/users/54eceb89ffd649088ca775317968eeb8/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:43.108375 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df84595-a014-4ebc-99d6-dd845547db4e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:43.108375 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df84595-a014-4ebc-99d6-dd845547db4e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:43.108375 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df84595-a014-4ebc-99d6-dd845547db4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:43.137422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 822/1623] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:22:43 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:43.139243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ba780-fda5-40b5-8326-d1d7dc445dfc admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:43.156388 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ba780-fda5-40b5-8326-d1d7dc445dfc admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:43.170994 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7df84595-a014-4ebc-99d6-dd845547db4e None None] MFA Rules not processed for user `2a0626754b40449ba2346d05c5c90a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:43.172410 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7df84595-a014-4ebc-99d6-dd845547db4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:43.260921 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab512dd1-e777-43be-a8bd-cb064722aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:43.261726 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab512dd1-e777-43be-a8bd-cb064722aea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:43.262027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab512dd1-e777-43be-a8bd-cb064722aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:43.262359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab512dd1-e777-43be-a8bd-cb064722aea8 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:43.263219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab512dd1-e777-43be-a8bd-cb064722aea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:43.264086 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 802/1624] 10.222.0.74 () {58 vars in 1058 bytes} [Thu Jul 14 10:22:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:43.265365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df84595-a014-4ebc-99d6-dd845547db4e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:43.266148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab512dd1-e777-43be-a8bd-cb064722aea8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:43.276385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df84595-a014-4ebc-99d6-dd845547db4e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:43.282987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed317f-c0a5-40db-afe1-4f5a0e33b69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:43.283857 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed317f-c0a5-40db-afe1-4f5a0e33b69c admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:43.284338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed317f-c0a5-40db-afe1-4f5a0e33b69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:43.284740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed317f-c0a5-40db-afe1-4f5a0e33b69c admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:43.286369 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed317f-c0a5-40db-afe1-4f5a0e33b69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:43.288255 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed317f-c0a5-40db-afe1-4f5a0e33b69c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:43.308291 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 803/1625] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:43.309498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed317f-c0a5-40db-afe1-4f5a0e33b69c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:43.323781 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed317f-c0a5-40db-afe1-4f5a0e33b69c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:43.329601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c0348-db33-422e-911a-13eabc467b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:43.330607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c0348-db33-422e-911a-13eabc467b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:43.331083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c0348-db33-422e-911a-13eabc467b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:43.331522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c0348-db33-422e-911a-13eabc467b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:43.332492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c0348-db33-422e-911a-13eabc467b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:43.334368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c0348-db33-422e-911a-13eabc467b41 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:43.346009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 804/1626] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:43.347155 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c0348-db33-422e-911a-13eabc467b41 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:43.366446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 823/1627] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:22:43 2022] POST /identity/v3/users => generated 309 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:43.368422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c0348-db33-422e-911a-13eabc467b41 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:43.368550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab512dd1-e777-43be-a8bd-cb064722aea8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:43.388896 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14d7fc-ce88-4f33-b5f8-c791e4bdce11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:43.389600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab512dd1-e777-43be-a8bd-cb064722aea8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:43.390695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14d7fc-ce88-4f33-b5f8-c791e4bdce11 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:43.391292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14d7fc-ce88-4f33-b5f8-c791e4bdce11 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:43.391677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14d7fc-ce88-4f33-b5f8-c791e4bdce11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:43.403032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf307b-d0e5-4b92-a5c1-dda28e2a82e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:43.404015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf307b-d0e5-4b92-a5c1-dda28e2a82e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:43.405468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf307b-d0e5-4b92-a5c1-dda28e2a82e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:43.405762 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf307b-d0e5-4b92-a5c1-dda28e2a82e3 admin admin] PATH_INFO: `/v3/projects/d220e86536a7423e8b618e1c76f6c2e6/users/54eceb89ffd649088ca775317968eeb8/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:43.408845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf307b-d0e5-4b92-a5c1-dda28e2a82e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d220e86536a7423e8b618e1c76f6c2e6, user_id=54eceb89ffd649088ca775317968eeb8, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:43.411394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf307b-d0e5-4b92-a5c1-dda28e2a82e3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:43.425884 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 824/1628] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:43 2022] PUT /identity/v3/projects/d220e86536a7423e8b618e1c76f6c2e6/users/54eceb89ffd649088ca775317968eeb8/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:43.426781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf307b-d0e5-4b92-a5c1-dda28e2a82e3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:43.473640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14d7fc-ce88-4f33-b5f8-c791e4bdce11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:43.475242 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14d7fc-ce88-4f33-b5f8-c791e4bdce11 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:43.500882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf307b-d0e5-4b92-a5c1-dda28e2a82e3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:43.504136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 805/1629] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:43.505227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14d7fc-ce88-4f33-b5f8-c791e4bdce11 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:43.524221 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaa5cb-9854-4aee-a0ee-bc502c6e3382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:43.525914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaa5cb-9854-4aee-a0ee-bc502c6e3382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:43.526766 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaa5cb-9854-4aee-a0ee-bc502c6e3382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:43.527677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaa5cb-9854-4aee-a0ee-bc502c6e3382 admin admin] PATH_INFO: `/v3/projects/a12be0c2cf5a462bafa2cc216d88834d/users/13c49056cf7f49dd8d31a0430f026030/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:43.529132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14d7fc-ce88-4f33-b5f8-c791e4bdce11 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:43.543032 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7da5cb-8cfc-42dd-95bc-0ffc4b9d5615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:43.544101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7da5cb-8cfc-42dd-95bc-0ffc4b9d5615 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:43.544536 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7da5cb-8cfc-42dd-95bc-0ffc4b9d5615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:43.545698 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7da5cb-8cfc-42dd-95bc-0ffc4b9d5615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:43.546620 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7da5cb-8cfc-42dd-95bc-0ffc4b9d5615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:43.548468 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7da5cb-8cfc-42dd-95bc-0ffc4b9d5615 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:43.563452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaa5cb-9854-4aee-a0ee-bc502c6e3382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12be0c2cf5a462bafa2cc216d88834d, user_id=13c49056cf7f49dd8d31a0430f026030, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:43.566939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaa5cb-9854-4aee-a0ee-bc502c6e3382 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:43.577390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 806/1630] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:43.578754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7b943-9c4c-42e0-8763-d924d82f4c2b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:43.579045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7b943-9c4c-42e0-8763-d924d82f4c2b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:43.579323 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7b943-9c4c-42e0-8763-d924d82f4c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:43.654842 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d3f7b943-9c4c-42e0-8763-d924d82f4c2b None None] MFA Rules not processed for user `54eceb89ffd649088ca775317968eeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:43.656033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d3f7b943-9c4c-42e0-8763-d924d82f4c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:43.673395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 825/1631] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:43 2022] PUT /identity/v3/projects/a12be0c2cf5a462bafa2cc216d88834d/users/13c49056cf7f49dd8d31a0430f026030/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:43.689690 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaa5cb-9854-4aee-a0ee-bc502c6e3382 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:43.813659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 807/1632] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:43.814460 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7b943-9c4c-42e0-8763-d924d82f4c2b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:43.840347 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7b943-9c4c-42e0-8763-d924d82f4c2b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:43.847456 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b9dde-9d3f-4677-b018-45281c56f5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:43.848170 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b9dde-9d3f-4677-b018-45281c56f5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:43.848456 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b9dde-9d3f-4677-b018-45281c56f5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:43.848764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b9dde-9d3f-4677-b018-45281c56f5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:43.849462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b9dde-9d3f-4677-b018-45281c56f5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:43.851080 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b9dde-9d3f-4677-b018-45281c56f5e1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:43.854444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaa5cb-9854-4aee-a0ee-bc502c6e3382 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:43.876423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 808/1633] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:43.886378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b9dde-9d3f-4677-b018-45281c56f5e1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:43.886680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33beed-230a-492b-9ae3-6cfc1285e995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:43.886680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33beed-230a-492b-9ae3-6cfc1285e995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:43.886680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33beed-230a-492b-9ae3-6cfc1285e995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:43.886680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33beed-230a-492b-9ae3-6cfc1285e995 admin admin] PATH_INFO: `/v3/projects/14b1d51502164bd1bb7749a25b1c7d1b/users/2e25aadc2cb14ff29b7b0a03345ff0b5/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:43.903778 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:43.927726 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33beed-230a-492b-9ae3-6cfc1285e995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b1d51502164bd1bb7749a25b1c7d1b, user_id=2e25aadc2cb14ff29b7b0a03345ff0b5, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:43.932376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33beed-230a-492b-9ae3-6cfc1285e995 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:43.977343 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:43.999893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b9dde-9d3f-4677-b018-45281c56f5e1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:44.006242 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178395ae-465c-4c49-9898-adb4b46e01e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:44.009314 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178395ae-465c-4c49-9898-adb4b46e01e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:44.012030 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178395ae-465c-4c49-9898-adb4b46e01e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:44.015690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178395ae-465c-4c49-9898-adb4b46e01e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:44.089713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 826/1634] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:43 2022] PUT /identity/v3/projects/14b1d51502164bd1bb7749a25b1c7d1b/users/2e25aadc2cb14ff29b7b0a03345ff0b5/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:44.089713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33beed-230a-492b-9ae3-6cfc1285e995 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:44.117091 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178395ae-465c-4c49-9898-adb4b46e01e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:44.118754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178395ae-465c-4c49-9898-adb4b46e01e7 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:44.134514 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 809/1635] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:44.137685 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459600cb-774f-4d3f-87c5-334503de8787 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:44.138511 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459600cb-774f-4d3f-87c5-334503de8787 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:44.138934 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459600cb-774f-4d3f-87c5-334503de8787 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:44.147038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 810/1636] 10.222.0.74 () {54 vars in 912 bytes} [Thu Jul 14 10:22:44 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:22:44.148259 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459600cb-774f-4d3f-87c5-334503de8787 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:44.187287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33beed-230a-492b-9ae3-6cfc1285e995 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:44.192530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49448c-21f0-427d-8c9b-b05f29ae4ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:44.194225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49448c-21f0-427d-8c9b-b05f29ae4ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:44.194625 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49448c-21f0-427d-8c9b-b05f29ae4ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:44.195011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49448c-21f0-427d-8c9b-b05f29ae4ff1 admin admin] PATH_INFO: `/v3/projects/a12be0c2cf5a462bafa2cc216d88834d/users/13c49056cf7f49dd8d31a0430f026030/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:44.197695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49448c-21f0-427d-8c9b-b05f29ae4ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12be0c2cf5a462bafa2cc216d88834d, user_id=13c49056cf7f49dd8d31a0430f026030, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:44.203297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49448c-21f0-427d-8c9b-b05f29ae4ff1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:44.225020 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 827/1637] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:44 2022] PUT /identity/v3/projects/a12be0c2cf5a462bafa2cc216d88834d/users/13c49056cf7f49dd8d31a0430f026030/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:44.229226 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9734b6-c68a-4d1f-b08a-13329be55aba None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:44.229634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9734b6-c68a-4d1f-b08a-13329be55aba None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:44.234424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9734b6-c68a-4d1f-b08a-13329be55aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:44.252036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0b9734b6-c68a-4d1f-b08a-13329be55aba None None] MFA Rules not processed for user `2a0626754b40449ba2346d05c5c90a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:44.253480 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0b9734b6-c68a-4d1f-b08a-13329be55aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:44.296295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459600cb-774f-4d3f-87c5-334503de8787 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:44.347511 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 828/1638] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:22:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:44.350084 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46332b2-c4c8-4ba8-bf29-08ba2be4ee0d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:44.350488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46332b2-c4c8-4ba8-bf29-08ba2be4ee0d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:44.350873 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46332b2-c4c8-4ba8-bf29-08ba2be4ee0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:44.400585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f46332b2-c4c8-4ba8-bf29-08ba2be4ee0d None None] MFA Rules not processed for user `13c49056cf7f49dd8d31a0430f026030`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:44.402026 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f46332b2-c4c8-4ba8-bf29-08ba2be4ee0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:44.447562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16c37b-c392-4ffa-b381-131df47964a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:44.448296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c37b-c392-4ffa-b381-131df47964a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:44.448755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c37b-c392-4ffa-b381-131df47964a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:44.449045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c37b-c392-4ffa-b381-131df47964a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:44.449780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16c37b-c392-4ffa-b381-131df47964a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:44.455137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16c37b-c392-4ffa-b381-131df47964a0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:44.471400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 811/1639] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:44.472358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16c37b-c392-4ffa-b381-131df47964a0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:44.519905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 829/1640] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:44.521053 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46332b2-c4c8-4ba8-bf29-08ba2be4ee0d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:44.535159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46332b2-c4c8-4ba8-bf29-08ba2be4ee0d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:44.540326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504de11b-0399-42c4-837e-e1e3f394c3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:44.541968 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de11b-0399-42c4-837e-e1e3f394c3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:44.542371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de11b-0399-42c4-837e-e1e3f394c3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:44.542808 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de11b-0399-42c4-837e-e1e3f394c3ca admin admin] PATH_INFO: `/v3/projects/14b1d51502164bd1bb7749a25b1c7d1b/users/2e25aadc2cb14ff29b7b0a03345ff0b5/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:44.545688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504de11b-0399-42c4-837e-e1e3f394c3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b1d51502164bd1bb7749a25b1c7d1b, user_id=2e25aadc2cb14ff29b7b0a03345ff0b5, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:44.548727 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504de11b-0399-42c4-837e-e1e3f394c3ca admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:44.564468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 830/1641] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:44 2022] PUT /identity/v3/projects/14b1d51502164bd1bb7749a25b1c7d1b/users/2e25aadc2cb14ff29b7b0a03345ff0b5/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:44.565606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504de11b-0399-42c4-837e-e1e3f394c3ca admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:44.613651 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16c37b-c392-4ffa-b381-131df47964a0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:44.643894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504de11b-0399-42c4-837e-e1e3f394c3ca admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:44.646774 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a5f40-5fc6-44ee-bac6-484875d9958c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:44.647604 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5f40-5fc6-44ee-bac6-484875d9958c service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:44.647950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5f40-5fc6-44ee-bac6-484875d9958c service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:44.648396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5f40-5fc6-44ee-bac6-484875d9958c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:44.695362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381daa19-c922-48cc-9fe3-1d25021f0937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:44.696389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381daa19-c922-48cc-9fe3-1d25021f0937 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:44.696821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381daa19-c922-48cc-9fe3-1d25021f0937 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:44.697260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381daa19-c922-48cc-9fe3-1d25021f0937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:44.762454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a5f40-5fc6-44ee-bac6-484875d9958c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:44.766575 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a5f40-5fc6-44ee-bac6-484875d9958c service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:44.810112 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381daa19-c922-48cc-9fe3-1d25021f0937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:44.812102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381daa19-c922-48cc-9fe3-1d25021f0937 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:44.812232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 831/1642] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:44.814682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52fcf6-ccb2-482a-8c3c-b5296b52c2d4 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:44.817076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52fcf6-ccb2-482a-8c3c-b5296b52c2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:44.817371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52fcf6-ccb2-482a-8c3c-b5296b52c2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:44.829673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 812/1643] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:44.883211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2b52fcf6-ccb2-482a-8c3c-b5296b52c2d4 None None] MFA Rules not processed for user `2e25aadc2cb14ff29b7b0a03345ff0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:44.884716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2b52fcf6-ccb2-482a-8c3c-b5296b52c2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:44.988120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:44.996249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 832/1644] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:44 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:45.027982 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:45.364328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:45.501639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381daa19-c922-48cc-9fe3-1d25021f0937 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:45.511732 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381daa19-c922-48cc-9fe3-1d25021f0937 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:45.523810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220ffaa-a4ab-416c-b4be-9b7170c8d5c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:45.524604 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220ffaa-a4ab-416c-b4be-9b7170c8d5c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:45.524957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220ffaa-a4ab-416c-b4be-9b7170c8d5c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:45.525478 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220ffaa-a4ab-416c-b4be-9b7170c8d5c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:45.704187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220ffaa-a4ab-416c-b4be-9b7170c8d5c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:45.704187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220ffaa-a4ab-416c-b4be-9b7170c8d5c2 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:45.745397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 813/1645] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:46.124098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52fcf6-ccb2-482a-8c3c-b5296b52c2d4 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:46.124098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52fcf6-ccb2-482a-8c3c-b5296b52c2d4 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:46.124098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7160fd-f718-4a1a-9eaf-5e64dfd31400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:46.124098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7160fd-f718-4a1a-9eaf-5e64dfd31400 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:46.128754 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7160fd-f718-4a1a-9eaf-5e64dfd31400 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:46.128754 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7160fd-f718-4a1a-9eaf-5e64dfd31400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:46.128754 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7160fd-f718-4a1a-9eaf-5e64dfd31400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:46.128754 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7160fd-f718-4a1a-9eaf-5e64dfd31400 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:46.147644 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 833/1646] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:46 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:46.485033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:47.299720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220ffaa-a4ab-416c-b4be-9b7170c8d5c2 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:47.425577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:47.459157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220ffaa-a4ab-416c-b4be-9b7170c8d5c2 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:47.469402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26511a3a-06e1-43b9-8c86-8bb7956d7e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:47.470410 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26511a3a-06e1-43b9-8c86-8bb7956d7e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:47.470792 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26511a3a-06e1-43b9-8c86-8bb7956d7e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:47.471167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26511a3a-06e1-43b9-8c86-8bb7956d7e83 admin admin] PATH_INFO: `/v3/users/966f1a7def864f4b99c372318dd1e66f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:47.473981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26511a3a-06e1-43b9-8c86-8bb7956d7e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966f1a7def864f4b99c372318dd1e66f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:47.475115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-26511a3a-06e1-43b9-8c86-8bb7956d7e83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:22:47.475115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: warnings.warn(msg) Jul 14 10:22:47.475115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: Jul 14 10:22:47.476607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26511a3a-06e1-43b9-8c86-8bb7956d7e83 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:47.594760 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3112c7-c3d8-495b-9683-eaa514416759 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:47.595314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3112c7-c3d8-495b-9683-eaa514416759 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:47.595314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3112c7-c3d8-495b-9683-eaa514416759 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:47.597119 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 834/1647] 10.222.0.74 () {54 vars in 961 bytes} [Thu Jul 14 10:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:22:47.605503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccb54e-8299-4b5b-b994-3b9aacb0b3e3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:47.605788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccb54e-8299-4b5b-b994-3b9aacb0b3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:47.606063 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccb54e-8299-4b5b-b994-3b9aacb0b3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:47.647932 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-26ccb54e-8299-4b5b-b994-3b9aacb0b3e3 None None] MFA Rules not processed for user `2a0626754b40449ba2346d05c5c90a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:47.649234 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-26ccb54e-8299-4b5b-b994-3b9aacb0b3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:47.668392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 835/1648] 10.222.0.74 () {58 vars in 1058 bytes} [Thu Jul 14 10:22:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:22:47.679097 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827a522-f2b4-41f5-b502-87454d9e11fe None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:47.679097 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827a522-f2b4-41f5-b502-87454d9e11fe None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:47.681542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827a522-f2b4-41f5-b502-87454d9e11fe None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:47.681542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 836/1649] 10.222.0.74 () {54 vars in 912 bytes} [Thu Jul 14 10:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:22:47.696073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627682c-6fce-44b2-8f17-88b4bae3d583 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:47.696599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627682c-6fce-44b2-8f17-88b4bae3d583 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:47.697027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627682c-6fce-44b2-8f17-88b4bae3d583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:47.733162 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8627682c-6fce-44b2-8f17-88b4bae3d583 None None] MFA Rules not processed for user `2a0626754b40449ba2346d05c5c90a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:47.739005 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8627682c-6fce-44b2-8f17-88b4bae3d583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:47.770185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 837/1650] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:22:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:22:47.820895 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-26511a3a-06e1-43b9-8c86-8bb7956d7e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966f1a7def864f4b99c372318dd1e66f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:47.862925 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-26511a3a-06e1-43b9-8c86-8bb7956d7e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966f1a7def864f4b99c372318dd1e66f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:47.864031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-26511a3a-06e1-43b9-8c86-8bb7956d7e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966f1a7def864f4b99c372318dd1e66f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:47.889512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627682c-6fce-44b2-8f17-88b4bae3d583 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:47.902367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627682c-6fce-44b2-8f17-88b4bae3d583 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:47.926783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218e2bb-07c4-4d8f-a731-1bc4c3be3c6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:47.927775 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218e2bb-07c4-4d8f-a731-1bc4c3be3c6f service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:47.928234 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218e2bb-07c4-4d8f-a731-1bc4c3be3c6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:47.930049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218e2bb-07c4-4d8f-a731-1bc4c3be3c6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:47.936451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d218e2bb-07c4-4d8f-a731-1bc4c3be3c6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:47.947324 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-26511a3a-06e1-43b9-8c86-8bb7956d7e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966f1a7def864f4b99c372318dd1e66f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:47.948185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-26511a3a-06e1-43b9-8c86-8bb7956d7e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966f1a7def864f4b99c372318dd1e66f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:47.972214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218e2bb-07c4-4d8f-a731-1bc4c3be3c6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:47.976496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218e2bb-07c4-4d8f-a731-1bc4c3be3c6f service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:47.983862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 814/1651] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:22:47 2022] DELETE /identity/v3/users/966f1a7def864f4b99c372318dd1e66f => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:47.987473 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68855dd-e984-4176-bda8-90ac35113e0f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:47.988222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68855dd-e984-4176-bda8-90ac35113e0f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:47.990281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68855dd-e984-4176-bda8-90ac35113e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:48.011602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 838/1652] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:22:48.068869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a68855dd-e984-4176-bda8-90ac35113e0f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:48.070402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a68855dd-e984-4176-bda8-90ac35113e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:48.340952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 815/1653] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:48.402599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218e2bb-07c4-4d8f-a731-1bc4c3be3c6f service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:48.410125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d218e2bb-07c4-4d8f-a731-1bc4c3be3c6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:48.651036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218e2bb-07c4-4d8f-a731-1bc4c3be3c6f service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:48.744059 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c7ea8-6056-41ee-b947-b039db3247f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:48.745369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c7ea8-6056-41ee-b947-b039db3247f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:48.745369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c7ea8-6056-41ee-b947-b039db3247f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:48.745369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c7ea8-6056-41ee-b947-b039db3247f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:48.756871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c7ea8-6056-41ee-b947-b039db3247f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:48.758424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c7ea8-6056-41ee-b947-b039db3247f5 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:48.771545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 839/1654] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:50.454892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68855dd-e984-4176-bda8-90ac35113e0f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:50.457098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a68855dd-e984-4176-bda8-90ac35113e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:50.506452 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68855dd-e984-4176-bda8-90ac35113e0f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:50.520313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:50.523174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:50.524576 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:50.525046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] PATH_INFO: `/v3/projects/f8ea98bf8c60422f97341a1a3afe7c3b` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:50.529674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ea98bf8c60422f97341a1a3afe7c3b)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:50.538256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:50.740826 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ea98bf8c60422f97341a1a3afe7c3b', 'request_id': 'req-693d17d5-a058-4ba0-9477-dd3c69140285'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:50.821324 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ea98bf8c60422f97341a1a3afe7c3b', 'request_id': 'req-693d17d5-a058-4ba0-9477-dd3c69140285'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:50.834177 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ea98bf8c60422f97341a1a3afe7c3b', 'request_id': 'req-693d17d5-a058-4ba0-9477-dd3c69140285'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:50.839008 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:50.858266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] The token cache is being invalidate because project f8ea98bf8c60422f97341a1a3afe7c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:22:50.858783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:50.863112 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:50.865727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 816/1655] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:22:50 2022] DELETE /identity/v3/projects/f8ea98bf8c60422f97341a1a3afe7c3b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:50.870114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c7ea8-6056-41ee-b947-b039db3247f5 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:50.888691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c7ea8-6056-41ee-b947-b039db3247f5 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:50.923189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:51.021306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82703d48-e8a8-49d2-8943-9cbc88b4d8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:51.023862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82703d48-e8a8-49d2-8943-9cbc88b4d8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:51.030246 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82703d48-e8a8-49d2-8943-9cbc88b4d8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:51.030246 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82703d48-e8a8-49d2-8943-9cbc88b4d8ee admin admin] PATH_INFO: `/v3/users/2e25aadc2cb14ff29b7b0a03345ff0b5` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:51.031076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82703d48-e8a8-49d2-8943-9cbc88b4d8ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e25aadc2cb14ff29b7b0a03345ff0b5)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:51.035859 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82703d48-e8a8-49d2-8943-9cbc88b4d8ee admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:51.133839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:51.138415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:51.158563 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d17d5-a058-4ba0-9477-dd3c69140285 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:51.173479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d555f-48d6-4c0b-9a2b-25661a242be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:51.174184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d555f-48d6-4c0b-9a2b-25661a242be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:51.174458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d555f-48d6-4c0b-9a2b-25661a242be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:51.176076 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d555f-48d6-4c0b-9a2b-25661a242be5 admin admin] PATH_INFO: `/v3/users/ab332425ad2d4cad9892caf3345719b7` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:51.177576 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d555f-48d6-4c0b-9a2b-25661a242be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab332425ad2d4cad9892caf3345719b7)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:51.179867 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d555f-48d6-4c0b-9a2b-25661a242be5 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:51.353453 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-82703d48-e8a8-49d2-8943-9cbc88b4d8ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e25aadc2cb14ff29b7b0a03345ff0b5'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:51.398936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-82703d48-e8a8-49d2-8943-9cbc88b4d8ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e25aadc2cb14ff29b7b0a03345ff0b5'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:51.433885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3d0d555f-48d6-4c0b-9a2b-25661a242be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab332425ad2d4cad9892caf3345719b7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:51.456796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-82703d48-e8a8-49d2-8943-9cbc88b4d8ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e25aadc2cb14ff29b7b0a03345ff0b5'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:51.457520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-82703d48-e8a8-49d2-8943-9cbc88b4d8ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e25aadc2cb14ff29b7b0a03345ff0b5'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:51.468087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-82703d48-e8a8-49d2-8943-9cbc88b4d8ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e25aadc2cb14ff29b7b0a03345ff0b5'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:51.479865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3d0d555f-48d6-4c0b-9a2b-25661a242be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab332425ad2d4cad9892caf3345719b7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:51.481771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3d0d555f-48d6-4c0b-9a2b-25661a242be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab332425ad2d4cad9892caf3345719b7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:51.498469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 840/1656] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:22:50 2022] DELETE /identity/v3/users/2e25aadc2cb14ff29b7b0a03345ff0b5 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:51.580881 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3d0d555f-48d6-4c0b-9a2b-25661a242be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab332425ad2d4cad9892caf3345719b7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:51.582017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3d0d555f-48d6-4c0b-9a2b-25661a242be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab332425ad2d4cad9892caf3345719b7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:51.612160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 817/1657] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:22:51 2022] DELETE /identity/v3/users/ab332425ad2d4cad9892caf3345719b7 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:51.615899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f159-85ba-4801-826f-7e09ea2f0cc0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:51.616227 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f159-85ba-4801-826f-7e09ea2f0cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:51.616509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f159-85ba-4801-826f-7e09ea2f0cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:51.660815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0065f159-85ba-4801-826f-7e09ea2f0cc0 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:51.663407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0065f159-85ba-4801-826f-7e09ea2f0cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:51.938287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 841/1658] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:51.962906 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d555f-48d6-4c0b-9a2b-25661a242be5 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:51.964258 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3d0d555f-48d6-4c0b-9a2b-25661a242be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:52.148087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d555f-48d6-4c0b-9a2b-25661a242be5 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:52.156907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cd10d-a236-48b9-9d23-18c38eca4368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:52.157812 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cd10d-a236-48b9-9d23-18c38eca4368 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:52.157911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cd10d-a236-48b9-9d23-18c38eca4368 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:52.158202 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cd10d-a236-48b9-9d23-18c38eca4368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:52.186331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cd10d-a236-48b9-9d23-18c38eca4368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:52.188030 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cd10d-a236-48b9-9d23-18c38eca4368 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:52.231056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 818/1659] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:52.377249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065f159-85ba-4801-826f-7e09ea2f0cc0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:52.379013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0065f159-85ba-4801-826f-7e09ea2f0cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:52.393794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065f159-85ba-4801-826f-7e09ea2f0cc0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:52.414330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80235f99-5a89-43ce-897b-ea00b78e2b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:52.414330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235f99-5a89-43ce-897b-ea00b78e2b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:52.414330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235f99-5a89-43ce-897b-ea00b78e2b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:52.414330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235f99-5a89-43ce-897b-ea00b78e2b5a admin admin] PATH_INFO: `/v3/users/b910f5306e8740b3a133e9a18082511b` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:52.414985 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80235f99-5a89-43ce-897b-ea00b78e2b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b910f5306e8740b3a133e9a18082511b)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:52.422884 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80235f99-5a89-43ce-897b-ea00b78e2b5a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:52.693545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:52.730535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-80235f99-5a89-43ce-897b-ea00b78e2b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b910f5306e8740b3a133e9a18082511b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:52.770798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-80235f99-5a89-43ce-897b-ea00b78e2b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b910f5306e8740b3a133e9a18082511b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:52.845320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-80235f99-5a89-43ce-897b-ea00b78e2b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b910f5306e8740b3a133e9a18082511b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:52.846586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-80235f99-5a89-43ce-897b-ea00b78e2b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b910f5306e8740b3a133e9a18082511b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:52.863033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-80235f99-5a89-43ce-897b-ea00b78e2b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b910f5306e8740b3a133e9a18082511b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:52.885763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 842/1660] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:22:52 2022] DELETE /identity/v3/users/b910f5306e8740b3a133e9a18082511b => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:52.891780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d05f4-d68b-42e1-bb84-12fa9b401528 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:52.892336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d05f4-d68b-42e1-bb84-12fa9b401528 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:52.892590 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d05f4-d68b-42e1-bb84-12fa9b401528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:52.961899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-363d05f4-d68b-42e1-bb84-12fa9b401528 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:52.963462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-363d05f4-d68b-42e1-bb84-12fa9b401528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:53.169132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 819/1661] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:53.206956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80235f99-5a89-43ce-897b-ea00b78e2b5a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:53.209626 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-80235f99-5a89-43ce-897b-ea00b78e2b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:53.315046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80235f99-5a89-43ce-897b-ea00b78e2b5a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:53.336355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdd452-d656-4c73-9de1-8d45dc81a623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:53.339129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd452-d656-4c73-9de1-8d45dc81a623 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:53.339641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd452-d656-4c73-9de1-8d45dc81a623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:53.340184 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd452-d656-4c73-9de1-8d45dc81a623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:53.367036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdd452-d656-4c73-9de1-8d45dc81a623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:53.370667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdd452-d656-4c73-9de1-8d45dc81a623 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:53.400414 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 843/1662] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:53.663289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f509-0d6c-460c-95f3-f74de0b8c2e5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:53.663679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f509-0d6c-460c-95f3-f74de0b8c2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:53.663858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f509-0d6c-460c-95f3-f74de0b8c2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:53.680008 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:53.722207 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-68b2f509-0d6c-460c-95f3-f74de0b8c2e5 None None] MFA Rules not processed for user `69e33c07f0844f228bef34d242d3be11`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:53.723667 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-68b2f509-0d6c-460c-95f3-f74de0b8c2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:53.876613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 820/1663] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:53.886027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdd452-d656-4c73-9de1-8d45dc81a623 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:53.888342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d7fdd452-d656-4c73-9de1-8d45dc81a623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:54.021551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdd452-d656-4c73-9de1-8d45dc81a623 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:54.037824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d4f92-76e4-4b30-8d0a-43155c772c85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:54.067897 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4f92-76e4-4b30-8d0a-43155c772c85 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:54.068462 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4f92-76e4-4b30-8d0a-43155c772c85 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:54.070049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4f92-76e4-4b30-8d0a-43155c772c85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:54.091688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d4f92-76e4-4b30-8d0a-43155c772c85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:54.093744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d4f92-76e4-4b30-8d0a-43155c772c85 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:54.111286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 844/1664] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:54.174821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2f509-0d6c-460c-95f3-f74de0b8c2e5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:54.176920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-68b2f509-0d6c-460c-95f3-f74de0b8c2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:54.217410 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2f509-0d6c-460c-95f3-f74de0b8c2e5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:54.232960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9902e-959f-4a07-b887-828e7293f726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:54.236363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9902e-959f-4a07-b887-828e7293f726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:54.236655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9902e-959f-4a07-b887-828e7293f726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:54.237736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9902e-959f-4a07-b887-828e7293f726 admin admin] PATH_INFO: `/v3/projects/14b1d51502164bd1bb7749a25b1c7d1b` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:54.250803 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9902e-959f-4a07-b887-828e7293f726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b1d51502164bd1bb7749a25b1c7d1b)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:54.252982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9902e-959f-4a07-b887-828e7293f726 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:54.413311 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-52f9902e-959f-4a07-b887-828e7293f726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b1d51502164bd1bb7749a25b1c7d1b', 'request_id': 'req-52f9902e-959f-4a07-b887-828e7293f726'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:54.525397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-52f9902e-959f-4a07-b887-828e7293f726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b1d51502164bd1bb7749a25b1c7d1b', 'request_id': 'req-52f9902e-959f-4a07-b887-828e7293f726'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:54.535363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-52f9902e-959f-4a07-b887-828e7293f726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b1d51502164bd1bb7749a25b1c7d1b', 'request_id': 'req-52f9902e-959f-4a07-b887-828e7293f726'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:54.580643 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-52f9902e-959f-4a07-b887-828e7293f726 admin admin] The token cache is being invalidate because project 14b1d51502164bd1bb7749a25b1c7d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:22:54.583061 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-52f9902e-959f-4a07-b887-828e7293f726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:54.584658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-52f9902e-959f-4a07-b887-828e7293f726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:54.592074 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 821/1665] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:22:54 2022] DELETE /identity/v3/projects/14b1d51502164bd1bb7749a25b1c7d1b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:54.597140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c236a4-a46c-4f32-8383-5a719461f37e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:54.597642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c236a4-a46c-4f32-8383-5a719461f37e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:54.597744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c236a4-a46c-4f32-8383-5a719461f37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:54.633551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-35c236a4-a46c-4f32-8383-5a719461f37e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:54.634876 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-35c236a4-a46c-4f32-8383-5a719461f37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:54.714590 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:54.792916 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3e60e-b707-49e0-be72-5e2fe58c0f4c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:54.795839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3e60e-b707-49e0-be72-5e2fe58c0f4c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:54.795839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3e60e-b707-49e0-be72-5e2fe58c0f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:54.797302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 845/1666] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:54.829163 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d0c3e60e-b707-49e0-be72-5e2fe58c0f4c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:54.830771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d0c3e60e-b707-49e0-be72-5e2fe58c0f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:54.859398 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c236a4-a46c-4f32-8383-5a719461f37e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:54.866543 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 822/1667] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:54.870977 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c236a4-a46c-4f32-8383-5a719461f37e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:54.884144 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a1e71-1ec8-43ee-b328-b074b14c034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:54.885054 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1e71-1ec8-43ee-b328-b074b14c034c admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:54.885501 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1e71-1ec8-43ee-b328-b074b14c034c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:54.885917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1e71-1ec8-43ee-b328-b074b14c034c admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:54.886812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a1e71-1ec8-43ee-b328-b074b14c034c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:22:54.888130 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a1e71-1ec8-43ee-b328-b074b14c034c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:54.894564 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a1e71-1ec8-43ee-b328-b074b14c034c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:54.928793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3e60e-b707-49e0-be72-5e2fe58c0f4c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:54.945497 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 846/1668] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:22:54.948043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3e60e-b707-49e0-be72-5e2fe58c0f4c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:54.957400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc4899-4a7f-4b86-ab60-6c5a4949e37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:54.958389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc4899-4a7f-4b86-ab60-6c5a4949e37f admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:54.958829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc4899-4a7f-4b86-ab60-6c5a4949e37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:54.959288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc4899-4a7f-4b86-ab60-6c5a4949e37f admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:54.960401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc4899-4a7f-4b86-ab60-6c5a4949e37f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:54.964789 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc4899-4a7f-4b86-ab60-6c5a4949e37f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:55.076063 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 823/1669] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:22:54 2022] POST /identity/v3/projects => generated 403 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:22:55.080699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a1e71-1ec8-43ee-b328-b074b14c034c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:55.094402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a1e71-1ec8-43ee-b328-b074b14c034c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:55.228854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371dadf-b8e8-4a3f-bb93-65f255b7ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:55.229618 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371dadf-b8e8-4a3f-bb93-65f255b7ed7a admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:55.229906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371dadf-b8e8-4a3f-bb93-65f255b7ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:55.230218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371dadf-b8e8-4a3f-bb93-65f255b7ed7a admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:55.230886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371dadf-b8e8-4a3f-bb93-65f255b7ed7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:55.241887 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371dadf-b8e8-4a3f-bb93-65f255b7ed7a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:55.378371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 847/1670] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:22:55 2022] POST /identity/v3/users => generated 302 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:55.381668 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc4899-4a7f-4b86-ab60-6c5a4949e37f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:55.396356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc4899-4a7f-4b86-ab60-6c5a4949e37f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:55.419247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8de59-6aa9-4edb-b500-3b22b558d721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:55.419952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8de59-6aa9-4edb-b500-3b22b558d721 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:55.420453 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8de59-6aa9-4edb-b500-3b22b558d721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:55.420736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8de59-6aa9-4edb-b500-3b22b558d721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:55.428506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8de59-6aa9-4edb-b500-3b22b558d721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:55.430375 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8de59-6aa9-4edb-b500-3b22b558d721 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:55.466838 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 824/1671] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:55.470821 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371dadf-b8e8-4a3f-bb93-65f255b7ed7a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:55.492722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371dadf-b8e8-4a3f-bb93-65f255b7ed7a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:55.517753 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005fc89-c3af-4284-b86f-cd3429a1ffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:55.518507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005fc89-c3af-4284-b86f-cd3429a1ffc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:55.518793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005fc89-c3af-4284-b86f-cd3429a1ffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:55.519075 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005fc89-c3af-4284-b86f-cd3429a1ffc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:55.524489 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005fc89-c3af-4284-b86f-cd3429a1ffc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:55.526213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005fc89-c3af-4284-b86f-cd3429a1ffc4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:55.563238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8de59-6aa9-4edb-b500-3b22b558d721 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:55.570033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 848/1672] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:55.578432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8de59-6aa9-4edb-b500-3b22b558d721 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:55.588217 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1f039-4b04-4fae-86b5-76010e8a5f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:55.589400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f039-4b04-4fae-86b5-76010e8a5f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:55.592128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f039-4b04-4fae-86b5-76010e8a5f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:55.592573 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f039-4b04-4fae-86b5-76010e8a5f6d admin admin] PATH_INFO: `/v3/projects/252fe0b83ba64e079209b8a2a02ba4a6/users/f168a96ba20a4d3abc694fc6bd4a9d52/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:55.629118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005fc89-c3af-4284-b86f-cd3429a1ffc4 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:55.630161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f005fc89-c3af-4284-b86f-cd3429a1ffc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:55.676816 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1f039-4b04-4fae-86b5-76010e8a5f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=252fe0b83ba64e079209b8a2a02ba4a6, user_id=f168a96ba20a4d3abc694fc6bd4a9d52, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:55.684823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005fc89-c3af-4284-b86f-cd3429a1ffc4 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:55.687749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1f039-4b04-4fae-86b5-76010e8a5f6d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:55.695471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:55.702197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:55.703388 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:55.703586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] PATH_INFO: `/v3/projects/e82284556044433d8dcb0708829c8690` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:55.705596 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e82284556044433d8dcb0708829c8690)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:55.707268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: WARNING py.warnings [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:22:55.707268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: warnings.warn(msg) Jul 14 10:22:55.707268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: Jul 14 10:22:55.709862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:55.794789 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 825/1673] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:55 2022] PUT /identity/v3/projects/252fe0b83ba64e079209b8a2a02ba4a6/users/f168a96ba20a4d3abc694fc6bd4a9d52/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:55.800841 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ac653-ebf5-46fc-8527-8ad75bab4dbe None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:55.801203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ac653-ebf5-46fc-8527-8ad75bab4dbe None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:55.801557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ac653-ebf5-46fc-8527-8ad75bab4dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:55.843793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-610ac653-ebf5-46fc-8527-8ad75bab4dbe None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:55.850088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-610ac653-ebf5-46fc-8527-8ad75bab4dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:55.886654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e82284556044433d8dcb0708829c8690', 'request_id': 'req-79f54991-e1bc-4c13-abd7-7f092cb50084'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:55.905194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:55.978447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e82284556044433d8dcb0708829c8690', 'request_id': 'req-79f54991-e1bc-4c13-abd7-7f092cb50084'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:55.995099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 826/1674] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:55.996067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ac653-ebf5-46fc-8527-8ad75bab4dbe None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:55.998207 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-610ac653-ebf5-46fc-8527-8ad75bab4dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:56.017947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e82284556044433d8dcb0708829c8690', 'request_id': 'req-79f54991-e1bc-4c13-abd7-7f092cb50084'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:56.034285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ac653-ebf5-46fc-8527-8ad75bab4dbe None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:56.051833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:56.052905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:56.053190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:56.053485 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2 admin admin] PATH_INFO: `/v3/projects/7b6404d54f1e452983cebaf5e94d0b4a` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:56.055676 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b6404d54f1e452983cebaf5e94d0b4a)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:56.057693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:56.103386 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] The token cache is being invalidate because project e82284556044433d8dcb0708829c8690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:22:56.108585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:56.110921 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:56.116224 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 849/1675] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:22:55 2022] DELETE /identity/v3/projects/e82284556044433d8dcb0708829c8690 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:22:56.120250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:56.121392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:56.187723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:56.250135 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b6404d54f1e452983cebaf5e94d0b4a', 'request_id': 'req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:56.253845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f54991-e1bc-4c13-abd7-7f092cb50084 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:56.325967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b6404d54f1e452983cebaf5e94d0b4a', 'request_id': 'req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:56.339648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b6404d54f1e452983cebaf5e94d0b4a', 'request_id': 'req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:56.349328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6845c05-cca9-4b30-9f44-8ff48a662652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:56.351020 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6845c05-cca9-4b30-9f44-8ff48a662652 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:56.351512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6845c05-cca9-4b30-9f44-8ff48a662652 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:56.352056 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6845c05-cca9-4b30-9f44-8ff48a662652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:56.358994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b6845c05-cca9-4b30-9f44-8ff48a662652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:56.360901 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2 admin admin] The token cache is being invalidate because project 7b6404d54f1e452983cebaf5e94d0b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:22:56.360901 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:56.362349 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2d20ea27-6f9d-4ae4-bbf0-003d7fb4dba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:56.364718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 827/1676] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:22:55 2022] DELETE /identity/v3/projects/7b6404d54f1e452983cebaf5e94d0b4a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:56.369945 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9717f-fb44-4190-b3d0-54adb4d84be6 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:56.370117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9717f-fb44-4190-b3d0-54adb4d84be6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:56.370437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9717f-fb44-4190-b3d0-54adb4d84be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:56.436860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-abd9717f-fb44-4190-b3d0-54adb4d84be6 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:56.438252 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-abd9717f-fb44-4190-b3d0-54adb4d84be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:56.541836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6845c05-cca9-4b30-9f44-8ff48a662652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:56.545064 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6845c05-cca9-4b30-9f44-8ff48a662652 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:56.570159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 850/1677] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:56.577224 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6845c05-cca9-4b30-9f44-8ff48a662652 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:56.581944 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b6845c05-cca9-4b30-9f44-8ff48a662652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:56.607957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 828/1678] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:56.607957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01146-8fd2-4a33-8b0c-87b3ae3d9d54 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:56.607957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01146-8fd2-4a33-8b0c-87b3ae3d9d54 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:56.607957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01146-8fd2-4a33-8b0c-87b3ae3d9d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:56.611661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6845c05-cca9-4b30-9f44-8ff48a662652 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:56.629602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10da95c-9dcc-47cb-9a52-001a6a3356f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:56.631257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10da95c-9dcc-47cb-9a52-001a6a3356f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:56.631257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10da95c-9dcc-47cb-9a52-001a6a3356f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:56.631525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10da95c-9dcc-47cb-9a52-001a6a3356f0 admin admin] PATH_INFO: `/v3/users/13c49056cf7f49dd8d31a0430f026030` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:56.634048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10da95c-9dcc-47cb-9a52-001a6a3356f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c49056cf7f49dd8d31a0430f026030)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:56.637066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10da95c-9dcc-47cb-9a52-001a6a3356f0 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:56.693636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d7e01146-8fd2-4a33-8b0c-87b3ae3d9d54 None None] MFA Rules not processed for user `84d2de5b7eb34c0893fa8f37d1341b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:56.695184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d7e01146-8fd2-4a33-8b0c-87b3ae3d9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:56.939869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 829/1679] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:56.942520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76faa70d-c3e2-4401-80b8-67606abc6643 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:56.942959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76faa70d-c3e2-4401-80b8-67606abc6643 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:56.943427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76faa70d-c3e2-4401-80b8-67606abc6643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:56.995472 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-76faa70d-c3e2-4401-80b8-67606abc6643 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:56.996755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-76faa70d-c3e2-4401-80b8-67606abc6643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:57.046523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 830/1680] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:57.046523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f6d7-7fec-4f11-8db5-051b8d21b423 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:57.046523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f6d7-7fec-4f11-8db5-051b8d21b423 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:57.046523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f6d7-7fec-4f11-8db5-051b8d21b423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:57.079702 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e10da95c-9dcc-47cb-9a52-001a6a3356f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c49056cf7f49dd8d31a0430f026030'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:57.103922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9e01f6d7-7fec-4f11-8db5-051b8d21b423 None None] MFA Rules not processed for user `84d2de5b7eb34c0893fa8f37d1341b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:57.105635 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9e01f6d7-7fec-4f11-8db5-051b8d21b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:57.114330 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 831/1681] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:22:57.120694 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01f6d7-7fec-4f11-8db5-051b8d21b423 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:57.132907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e10da95c-9dcc-47cb-9a52-001a6a3356f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c49056cf7f49dd8d31a0430f026030'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:57.140496 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01f6d7-7fec-4f11-8db5-051b8d21b423 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:57.145825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cead6-63a5-4940-a6b4-174e5d40e08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:57.148086 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cead6-63a5-4940-a6b4-174e5d40e08b admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:57.148532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cead6-63a5-4940-a6b4-174e5d40e08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:57.148953 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cead6-63a5-4940-a6b4-174e5d40e08b admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:57.151374 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cead6-63a5-4940-a6b4-174e5d40e08b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:22:57.151374 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cead6-63a5-4940-a6b4-174e5d40e08b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:57.152194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cead6-63a5-4940-a6b4-174e5d40e08b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:57.184240 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 832/1682] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:22:57.193136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cead6-63a5-4940-a6b4-174e5d40e08b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:57.199719 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ba5cead6-63a5-4940-a6b4-174e5d40e08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:57.233161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e10da95c-9dcc-47cb-9a52-001a6a3356f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c49056cf7f49dd8d31a0430f026030'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:57.233924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e10da95c-9dcc-47cb-9a52-001a6a3356f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c49056cf7f49dd8d31a0430f026030'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:57.271335 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e10da95c-9dcc-47cb-9a52-001a6a3356f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c49056cf7f49dd8d31a0430f026030'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:22:57.317399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 851/1683] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:22:56 2022] DELETE /identity/v3/users/13c49056cf7f49dd8d31a0430f026030 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:57.321769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10da95c-9dcc-47cb-9a52-001a6a3356f0 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:57.326736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e10da95c-9dcc-47cb-9a52-001a6a3356f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:57.546328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cead6-63a5-4940-a6b4-174e5d40e08b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:57.605936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10da95c-9dcc-47cb-9a52-001a6a3356f0 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:57.633421 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c97cb-76af-46b7-a8ce-20a80662c543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:57.633997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c97cb-76af-46b7-a8ce-20a80662c543 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:57.634269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c97cb-76af-46b7-a8ce-20a80662c543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:57.634552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c97cb-76af-46b7-a8ce-20a80662c543 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:57.635261 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c97cb-76af-46b7-a8ce-20a80662c543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:57.644373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c97cb-76af-46b7-a8ce-20a80662c543 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:57.777058 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:57.779387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef233f57-dffc-4690-b297-281a4b845031 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:57.780331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef233f57-dffc-4690-b297-281a4b845031 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:57.781716 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef233f57-dffc-4690-b297-281a4b845031 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:57.781716 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef233f57-dffc-4690-b297-281a4b845031 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:57.784322 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ef233f57-dffc-4690-b297-281a4b845031 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:57.816657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 852/1684] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:22:57 2022] POST /identity/v3/projects => generated 365 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:57.819402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c97cb-76af-46b7-a8ce-20a80662c543 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:57.958059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef233f57-dffc-4690-b297-281a4b845031 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:57.960142 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef233f57-dffc-4690-b297-281a4b845031 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:57.965096 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c97cb-76af-46b7-a8ce-20a80662c543 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:57.971082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ab7a0-90e7-4597-afcb-74f13d7cf064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:57.972085 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ab7a0-90e7-4597-afcb-74f13d7cf064 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:57.972542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ab7a0-90e7-4597-afcb-74f13d7cf064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:57.973032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ab7a0-90e7-4597-afcb-74f13d7cf064 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:57.974011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ab7a0-90e7-4597-afcb-74f13d7cf064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:57.976496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ab7a0-90e7-4597-afcb-74f13d7cf064 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:57.984763 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 833/1685] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 792 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:22:58.120319 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 853/1686] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:22:57 2022] POST /identity/v3/users => generated 283 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:58.126433 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef233f57-dffc-4690-b297-281a4b845031 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:58.150794 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef233f57-dffc-4690-b297-281a4b845031 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:58.164776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708d9c7-c64c-4f56-918a-69944dfa2ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:58.166745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708d9c7-c64c-4f56-918a-69944dfa2ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:58.167152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708d9c7-c64c-4f56-918a-69944dfa2ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:58.172611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708d9c7-c64c-4f56-918a-69944dfa2ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:58.173986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708d9c7-c64c-4f56-918a-69944dfa2ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:58.177049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708d9c7-c64c-4f56-918a-69944dfa2ccb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:58.204592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 834/1687] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:58.204704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ab7a0-90e7-4597-afcb-74f13d7cf064 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:58.219053 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ab7a0-90e7-4597-afcb-74f13d7cf064 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:58.226144 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5b9a1-2299-4fae-a8cb-11d67e9f4a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:58.226901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b9a1-2299-4fae-a8cb-11d67e9f4a73 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:58.227709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b9a1-2299-4fae-a8cb-11d67e9f4a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:58.228369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b9a1-2299-4fae-a8cb-11d67e9f4a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:58.230100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5b9a1-2299-4fae-a8cb-11d67e9f4a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:58.233193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5b9a1-2299-4fae-a8cb-11d67e9f4a73 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:58.258429 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708d9c7-c64c-4f56-918a-69944dfa2ccb admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:58.264479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 854/1688] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:58.272792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:58.275908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708d9c7-c64c-4f56-918a-69944dfa2ccb admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:58.287150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec209098-4d72-4a65-8000-36d6086b414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:58.288334 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec209098-4d72-4a65-8000-36d6086b414a admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:58.289077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec209098-4d72-4a65-8000-36d6086b414a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:58.289425 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec209098-4d72-4a65-8000-36d6086b414a admin admin] PATH_INFO: `/v3/projects/3f4101e87eee481db9b00010f75c15e4/users/93a623c39a4542cfbd720338f7a215d7/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:58.313637 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec209098-4d72-4a65-8000-36d6086b414a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4101e87eee481db9b00010f75c15e4, user_id=93a623c39a4542cfbd720338f7a215d7, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:58.319117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec209098-4d72-4a65-8000-36d6086b414a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:58.421225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 835/1689] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:58 2022] PUT /identity/v3/projects/3f4101e87eee481db9b00010f75c15e4/users/93a623c39a4542cfbd720338f7a215d7/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:58.422375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5571f-209d-423c-96e4-92a61746aa08 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:58.422667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5571f-209d-423c-96e4-92a61746aa08 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:58.422946 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5571f-209d-423c-96e4-92a61746aa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:58.487037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-90d5571f-209d-423c-96e4-92a61746aa08 None None] MFA Rules not processed for user `93a623c39a4542cfbd720338f7a215d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:58.488328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-90d5571f-209d-423c-96e4-92a61746aa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:58.716780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 855/1690] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:22:58.721837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec209098-4d72-4a65-8000-36d6086b414a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:58.862412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec209098-4d72-4a65-8000-36d6086b414a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:58.867258 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3c9b2-d460-4145-9130-cb126fc2424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:58.867952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3c9b2-d460-4145-9130-cb126fc2424a admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:58.868248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3c9b2-d460-4145-9130-cb126fc2424a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:58.868523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3c9b2-d460-4145-9130-cb126fc2424a admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:58.873975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3c9b2-d460-4145-9130-cb126fc2424a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:58.873975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3c9b2-d460-4145-9130-cb126fc2424a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:58.996093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 836/1691] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:22:58 2022] POST /identity/v3/projects => generated 365 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:59.001536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5571f-209d-423c-96e4-92a61746aa08 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:59.035906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5571f-209d-423c-96e4-92a61746aa08 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:59.167363 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fb7ba-d51a-4101-9463-4f8ce736fa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:59.170036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fb7ba-d51a-4101-9463-4f8ce736fa1f admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:59.170754 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fb7ba-d51a-4101-9463-4f8ce736fa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:59.171236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fb7ba-d51a-4101-9463-4f8ce736fa1f admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:59.172233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fb7ba-d51a-4101-9463-4f8ce736fa1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:59.174866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fb7ba-d51a-4101-9463-4f8ce736fa1f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:59.262014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 856/1692] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:22:59 2022] POST /identity/v3/users => generated 289 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:22:59.266375 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3c9b2-d460-4145-9130-cb126fc2424a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:59.283429 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3c9b2-d460-4145-9130-cb126fc2424a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:59.298897 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8398217-fa13-4711-9f78-fc2f97e282ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:59.299909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8398217-fa13-4711-9f78-fc2f97e282ba admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:59.299909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8398217-fa13-4711-9f78-fc2f97e282ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:59.300250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8398217-fa13-4711-9f78-fc2f97e282ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:59.303436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8398217-fa13-4711-9f78-fc2f97e282ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:59.313504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8398217-fa13-4711-9f78-fc2f97e282ba admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:59.343257 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 837/1693] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:59.348518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fb7ba-d51a-4101-9463-4f8ce736fa1f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:59.379292 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fb7ba-d51a-4101-9463-4f8ce736fa1f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:59.386550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63b1a9-864d-4d7d-b55d-52d9a9344aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:59.388715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63b1a9-864d-4d7d-b55d-52d9a9344aef admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:59.389158 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63b1a9-864d-4d7d-b55d-52d9a9344aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:59.389617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63b1a9-864d-4d7d-b55d-52d9a9344aef admin admin] PATH_INFO: `/v3/projects/c6eb420c9ef54c16906865e822da4aba/users/478f42f52430458582459fbf4c24a7fc/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:59.411096 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63b1a9-864d-4d7d-b55d-52d9a9344aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6eb420c9ef54c16906865e822da4aba, user_id=478f42f52430458582459fbf4c24a7fc, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:59.415243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63b1a9-864d-4d7d-b55d-52d9a9344aef admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:59.460369 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc02cf6-be19-4833-a111-a0b9a385336f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:59.460661 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc02cf6-be19-4833-a111-a0b9a385336f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:59.460936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc02cf6-be19-4833-a111-a0b9a385336f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:59.467363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 838/1694] 10.222.0.74 () {54 vars in 912 bytes} [Thu Jul 14 10:22:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:22:59.473151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc222155-7a54-46bc-9eac-d584f66dc2e3 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:59.473439 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc222155-7a54-46bc-9eac-d584f66dc2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:59.474002 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc222155-7a54-46bc-9eac-d584f66dc2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:59.537277 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-cc222155-7a54-46bc-9eac-d584f66dc2e3 None None] MFA Rules not processed for user `bf41e7a4968e4ab9bce98f6e1c050b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:59.538537 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-cc222155-7a54-46bc-9eac-d584f66dc2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:59.551165 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 857/1695] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:59 2022] PUT /identity/v3/projects/c6eb420c9ef54c16906865e822da4aba/users/478f42f52430458582459fbf4c24a7fc/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:59.555318 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63b1a9-864d-4d7d-b55d-52d9a9344aef admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:59.746046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 839/1696] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:22:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:22:59.781119 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63b1a9-864d-4d7d-b55d-52d9a9344aef admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:59.789292 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf5d0c-efa6-4b7d-a0c6-c0cb10aa139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:59.790126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf5d0c-efa6-4b7d-a0c6-c0cb10aa139d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:59.790517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf5d0c-efa6-4b7d-a0c6-c0cb10aa139d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:59.790870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf5d0c-efa6-4b7d-a0c6-c0cb10aa139d admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:59.791782 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf5d0c-efa6-4b7d-a0c6-c0cb10aa139d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:59.793854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf5d0c-efa6-4b7d-a0c6-c0cb10aa139d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:59.811358 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 858/1697] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:22:59.812705 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc222155-7a54-46bc-9eac-d584f66dc2e3 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:59.827359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc222155-7a54-46bc-9eac-d584f66dc2e3 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:22:59.832467 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e076a6-7f73-46a6-8397-72ee700cede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:22:59.833475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e076a6-7f73-46a6-8397-72ee700cede6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:59.833829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e076a6-7f73-46a6-8397-72ee700cede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:59.834179 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e076a6-7f73-46a6-8397-72ee700cede6 admin admin] PATH_INFO: `/v3/projects/c6eb420c9ef54c16906865e822da4aba/users/478f42f52430458582459fbf4c24a7fc/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:59.836544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e076a6-7f73-46a6-8397-72ee700cede6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6eb420c9ef54c16906865e822da4aba, user_id=478f42f52430458582459fbf4c24a7fc, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:22:59.839445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e076a6-7f73-46a6-8397-72ee700cede6 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:22:59.860038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 840/1698] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:22:59 2022] PUT /identity/v3/projects/c6eb420c9ef54c16906865e822da4aba/users/478f42f52430458582459fbf4c24a7fc/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:22:59.867869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:59.873088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517cac-9890-4e98-9c8a-6d3cc0e42880 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:22:59.873088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517cac-9890-4e98-9c8a-6d3cc0e42880 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:22:59.873088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517cac-9890-4e98-9c8a-6d3cc0e42880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:22:59.878358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e076a6-7f73-46a6-8397-72ee700cede6 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:22:59.880686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d3e076a6-7f73-46a6-8397-72ee700cede6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:22:59.907564 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0c517cac-9890-4e98-9c8a-6d3cc0e42880 None None] MFA Rules not processed for user `478f42f52430458582459fbf4c24a7fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:22:59.909695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0c517cac-9890-4e98-9c8a-6d3cc0e42880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:00.007363 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 859/1699] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:22:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:00.016971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c517cac-9890-4e98-9c8a-6d3cc0e42880 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:00.018731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0c517cac-9890-4e98-9c8a-6d3cc0e42880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:00.036713 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e076a6-7f73-46a6-8397-72ee700cede6 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:00.045113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204aa3c-0cc3-4258-abdb-139493bc9f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:00.050405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204aa3c-0cc3-4258-abdb-139493bc9f0d service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:00.050405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204aa3c-0cc3-4258-abdb-139493bc9f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:00.050405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204aa3c-0cc3-4258-abdb-139493bc9f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:00.104719 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204aa3c-0cc3-4258-abdb-139493bc9f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:00.104719 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204aa3c-0cc3-4258-abdb-139493bc9f0d service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:00.134294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 841/1700] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:22:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:00.154513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c517cac-9890-4e98-9c8a-6d3cc0e42880 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:00.165896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd519b6-76d3-469e-88c5-1157f6ccd3d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:00.166593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd519b6-76d3-469e-88c5-1157f6ccd3d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:00.166882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd519b6-76d3-469e-88c5-1157f6ccd3d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:00.167176 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd519b6-76d3-469e-88c5-1157f6ccd3d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:00.186351 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd519b6-76d3-469e-88c5-1157f6ccd3d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:00.187926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd519b6-76d3-469e-88c5-1157f6ccd3d2 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:00.221399 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad483e3-322e-4ccd-a596-4416e825d841 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:00.221695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad483e3-322e-4ccd-a596-4416e825d841 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:00.221976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad483e3-322e-4ccd-a596-4416e825d841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:00.250808 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 860/1701] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:00.292948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd519b6-76d3-469e-88c5-1157f6ccd3d2 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:00.295888 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7bd519b6-76d3-469e-88c5-1157f6ccd3d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:00.300252 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-dad483e3-322e-4ccd-a596-4416e825d841 None None] MFA Rules not processed for user `8acb1c9eead84a11a48c1a217ce82584`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:00.306894 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-dad483e3-322e-4ccd-a596-4416e825d841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:00.361407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:00.456140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd519b6-76d3-469e-88c5-1157f6ccd3d2 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:00.473662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328706cd-2e96-477d-80b3-4de24332deec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:00.473662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328706cd-2e96-477d-80b3-4de24332deec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:00.473662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328706cd-2e96-477d-80b3-4de24332deec admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:00.473662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328706cd-2e96-477d-80b3-4de24332deec admin admin] PATH_INFO: `/v3/projects/a12be0c2cf5a462bafa2cc216d88834d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:00.476508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328706cd-2e96-477d-80b3-4de24332deec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12be0c2cf5a462bafa2cc216d88834d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:00.478885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328706cd-2e96-477d-80b3-4de24332deec admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:00.515870 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:00.523810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 842/1702] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:00.529248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07de7f-d721-4366-aec6-d38c3e9743b3 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:00.529248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07de7f-d721-4366-aec6-d38c3e9743b3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:00.530638 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07de7f-d721-4366-aec6-d38c3e9743b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:00.587153 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3d07de7f-d721-4366-aec6-d38c3e9743b3 None None] MFA Rules not processed for user `8acb1c9eead84a11a48c1a217ce82584`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:00.589287 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3d07de7f-d721-4366-aec6-d38c3e9743b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:00.605528 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 843/1703] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:00.617488 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07de7f-d721-4366-aec6-d38c3e9743b3 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:00.620776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3d07de7f-d721-4366-aec6-d38c3e9743b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:00.693045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-328706cd-2e96-477d-80b3-4de24332deec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12be0c2cf5a462bafa2cc216d88834d', 'request_id': 'req-328706cd-2e96-477d-80b3-4de24332deec'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:00.771569 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07de7f-d721-4366-aec6-d38c3e9743b3 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:00.818306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-328706cd-2e96-477d-80b3-4de24332deec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12be0c2cf5a462bafa2cc216d88834d', 'request_id': 'req-328706cd-2e96-477d-80b3-4de24332deec'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:00.833207 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-328706cd-2e96-477d-80b3-4de24332deec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12be0c2cf5a462bafa2cc216d88834d', 'request_id': 'req-328706cd-2e96-477d-80b3-4de24332deec'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:00.854163 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-328706cd-2e96-477d-80b3-4de24332deec admin admin] The token cache is being invalidate because project a12be0c2cf5a462bafa2cc216d88834d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:00.854528 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-328706cd-2e96-477d-80b3-4de24332deec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:00.872135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-328706cd-2e96-477d-80b3-4de24332deec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:00.882016 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 861/1704] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:00 2022] DELETE /identity/v3/projects/a12be0c2cf5a462bafa2cc216d88834d => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:00.883536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb72b25-9efc-42b2-8a8f-ac40b918f28a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:00.884630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb72b25-9efc-42b2-8a8f-ac40b918f28a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:00.884630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb72b25-9efc-42b2-8a8f-ac40b918f28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:00.936334 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b32c3-6553-430f-af0c-be534ab09f09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:00.936989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b32c3-6553-430f-af0c-be534ab09f09 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:00.941955 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b32c3-6553-430f-af0c-be534ab09f09 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:00.941955 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b32c3-6553-430f-af0c-be534ab09f09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:00.941955 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-334b32c3-6553-430f-af0c-be534ab09f09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:00.943576 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8eb72b25-9efc-42b2-8a8f-ac40b918f28a None None] MFA Rules not processed for user `f168a96ba20a4d3abc694fc6bd4a9d52`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:00.945179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8eb72b25-9efc-42b2-8a8f-ac40b918f28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:01.098082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b32c3-6553-430f-af0c-be534ab09f09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:01.102867 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b32c3-6553-430f-af0c-be534ab09f09 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:01.113511 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 844/1705] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:23:01.117063 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803095a-c21e-4281-8443-75cf029ae2a3 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:01.118137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803095a-c21e-4281-8443-75cf029ae2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:01.118523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803095a-c21e-4281-8443-75cf029ae2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:01.150971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 862/1706] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:01.161603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb72b25-9efc-42b2-8a8f-ac40b918f28a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:01.161603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8eb72b25-9efc-42b2-8a8f-ac40b918f28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:01.196407 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2803095a-c21e-4281-8443-75cf029ae2a3 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:01.198822 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2803095a-c21e-4281-8443-75cf029ae2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:01.400911 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb72b25-9efc-42b2-8a8f-ac40b918f28a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:01.422652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1cafa-961b-4198-9fe5-fc6a679c7b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:01.423477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1cafa-961b-4198-9fe5-fc6a679c7b50 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:01.423823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1cafa-961b-4198-9fe5-fc6a679c7b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:01.428253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1cafa-961b-4198-9fe5-fc6a679c7b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:01.428253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1cafa-961b-4198-9fe5-fc6a679c7b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:01.439028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1cafa-961b-4198-9fe5-fc6a679c7b50 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:01.496360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 845/1707] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:01.499152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6336eb-d6d8-4e9d-9fc2-8fab8be74688 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:01.499609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6336eb-d6d8-4e9d-9fc2-8fab8be74688 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:01.500066 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6336eb-d6d8-4e9d-9fc2-8fab8be74688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:01.587433 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8b6336eb-d6d8-4e9d-9fc2-8fab8be74688 None None] MFA Rules not processed for user `35057047c93946a7a1ff01bd649abd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:01.589471 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8b6336eb-d6d8-4e9d-9fc2-8fab8be74688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:01.613254 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 863/1708] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:01 2022] POST /identity/v3/projects => generated 405 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:01.614935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c0486-ab79-4bb2-8ad5-f2f01bc46bda None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:01.615242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c0486-ab79-4bb2-8ad5-f2f01bc46bda None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:01.615522 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c0486-ab79-4bb2-8ad5-f2f01bc46bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:01.648410 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b40c0486-ab79-4bb2-8ad5-f2f01bc46bda None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:01.649667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b40c0486-ab79-4bb2-8ad5-f2f01bc46bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:01.723531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:01.806053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 846/1709] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:01.806053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6336eb-d6d8-4e9d-9fc2-8fab8be74688 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:01.806053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:01.828619 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6336eb-d6d8-4e9d-9fc2-8fab8be74688 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:01.860270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 864/1710] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:01.862699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2826593-ed62-4c7f-b76c-9e9344ed32ef None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:01.863002 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2826593-ed62-4c7f-b76c-9e9344ed32ef None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:01.865927 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2826593-ed62-4c7f-b76c-9e9344ed32ef None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:01.866225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 865/1711] 10.222.0.74 () {54 vars in 960 bytes} [Thu Jul 14 10:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:23:01.867508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd82b4f-588d-448b-a4ef-4b4c911a1d05 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:01.867864 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd82b4f-588d-448b-a4ef-4b4c911a1d05 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:01.868289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd82b4f-588d-448b-a4ef-4b4c911a1d05 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:01.870158 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 866/1712] 10.222.0.74 () {54 vars in 912 bytes} [Thu Jul 14 10:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:23:01.871324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb823b-c3ce-4e9e-afab-6625152e24ae None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:01.871745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb823b-c3ce-4e9e-afab-6625152e24ae None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:01.872134 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb823b-c3ce-4e9e-afab-6625152e24ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:01.893824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-90cb823b-c3ce-4e9e-afab-6625152e24ae None None] MFA Rules not processed for user `69e33c07f0844f228bef34d242d3be11`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:01.894977 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-90cb823b-c3ce-4e9e-afab-6625152e24ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:01.921303 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce572ea3-3008-4135-bfc4-1e13307e188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:01.922001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce572ea3-3008-4135-bfc4-1e13307e188f admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:01.922700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce572ea3-3008-4135-bfc4-1e13307e188f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:01.922700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce572ea3-3008-4135-bfc4-1e13307e188f admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:01.924065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce572ea3-3008-4135-bfc4-1e13307e188f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:01.925517 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce572ea3-3008-4135-bfc4-1e13307e188f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:01.979049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 867/1713] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:01.979049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb823b-c3ce-4e9e-afab-6625152e24ae None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:01.987137 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb823b-c3ce-4e9e-afab-6625152e24ae None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:01.992564 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a348c9-2d3e-464e-bf44-bb33791086bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:01.993350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a348c9-2d3e-464e-bf44-bb33791086bd admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:01.993727 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a348c9-2d3e-464e-bf44-bb33791086bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:01.994204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a348c9-2d3e-464e-bf44-bb33791086bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:01.995054 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a348c9-2d3e-464e-bf44-bb33791086bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:01.995443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a348c9-2d3e-464e-bf44-bb33791086bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:01.997525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a348c9-2d3e-464e-bf44-bb33791086bd admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:02.010172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 868/1714] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:23:02.011638 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d94ed-e353-4db1-a467-bf9f04386190 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:02.011940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d94ed-e353-4db1-a467-bf9f04386190 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:02.012822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d94ed-e353-4db1-a467-bf9f04386190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:02.033198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ed1d94ed-e353-4db1-a467-bf9f04386190 None None] MFA Rules not processed for user `2784d36c16d343cc961a22d956ee30f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:02.034434 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ed1d94ed-e353-4db1-a467-bf9f04386190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:02.119494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 869/1715] 10.222.0.74 () {58 vars in 1057 bytes} [Thu Jul 14 10:23:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:02.125551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5197a-1e07-44a9-8753-64dcfd2d41df None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:02.125551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5197a-1e07-44a9-8753-64dcfd2d41df None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:02.125551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5197a-1e07-44a9-8753-64dcfd2d41df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:02.139479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 847/1716] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:01 2022] POST /identity/v3/users => generated 309 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:02.139479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce572ea3-3008-4135-bfc4-1e13307e188f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:02.140659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ce572ea3-3008-4135-bfc4-1e13307e188f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:02.142114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-cbd5197a-1e07-44a9-8753-64dcfd2d41df None None] MFA Rules not processed for user `bf41e7a4968e4ab9bce98f6e1c050b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:02.143417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cbd5197a-1e07-44a9-8753-64dcfd2d41df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:02.227286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 870/1717] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:23:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:02.241299 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce572ea3-3008-4135-bfc4-1e13307e188f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:02.248788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5197a-1e07-44a9-8753-64dcfd2d41df None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:02.249853 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76b236-58c5-40fb-9c78-2e649a4989db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:02.250341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cbd5197a-1e07-44a9-8753-64dcfd2d41df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:02.250728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76b236-58c5-40fb-9c78-2e649a4989db service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:02.251110 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76b236-58c5-40fb-9c78-2e649a4989db service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:02.251604 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76b236-58c5-40fb-9c78-2e649a4989db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:02.268989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5197a-1e07-44a9-8753-64dcfd2d41df None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:02.275605 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394f900-e43c-47ce-83e8-ecc274ae4819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:02.280788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394f900-e43c-47ce-83e8-ecc274ae4819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:02.280788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394f900-e43c-47ce-83e8-ecc274ae4819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:02.280788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394f900-e43c-47ce-83e8-ecc274ae4819 admin admin] PATH_INFO: `/v3/users/93a623c39a4542cfbd720338f7a215d7` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:02.280788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394f900-e43c-47ce-83e8-ecc274ae4819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a623c39a4542cfbd720338f7a215d7)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:02.282103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394f900-e43c-47ce-83e8-ecc274ae4819 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:02.330928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:02.357013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76b236-58c5-40fb-9c78-2e649a4989db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:02.359006 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76b236-58c5-40fb-9c78-2e649a4989db service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:02.378092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 848/1718] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:02.378906 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76b236-58c5-40fb-9c78-2e649a4989db service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:02.393144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76b236-58c5-40fb-9c78-2e649a4989db service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:02.398450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59904d33-66d5-4c7e-8544-0f1948bb630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:02.405260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59904d33-66d5-4c7e-8544-0f1948bb630d admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:02.405260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59904d33-66d5-4c7e-8544-0f1948bb630d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:02.405260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59904d33-66d5-4c7e-8544-0f1948bb630d admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:02.405260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59904d33-66d5-4c7e-8544-0f1948bb630d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:02.405260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59904d33-66d5-4c7e-8544-0f1948bb630d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:02.532140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 849/1719] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:02 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:02.533735 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59904d33-66d5-4c7e-8544-0f1948bb630d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:02.601939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8394f900-e43c-47ce-83e8-ecc274ae4819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a623c39a4542cfbd720338f7a215d7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:02.630705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8394f900-e43c-47ce-83e8-ecc274ae4819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a623c39a4542cfbd720338f7a215d7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:02.736560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59904d33-66d5-4c7e-8544-0f1948bb630d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:02.745922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8394f900-e43c-47ce-83e8-ecc274ae4819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a623c39a4542cfbd720338f7a215d7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:02.747156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8394f900-e43c-47ce-83e8-ecc274ae4819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a623c39a4542cfbd720338f7a215d7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:02.749256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a075a-6ef5-429d-8ba5-510ff3bc4cc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784d36c16d343cc961a22d956ee30f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:02.749987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a075a-6ef5-429d-8ba5-510ff3bc4cc7 service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:02.750350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a075a-6ef5-429d-8ba5-510ff3bc4cc7 service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:02.750636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a075a-6ef5-429d-8ba5-510ff3bc4cc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:02.757230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8394f900-e43c-47ce-83e8-ecc274ae4819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a623c39a4542cfbd720338f7a215d7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:02.759980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ea4a075a-6ef5-429d-8ba5-510ff3bc4cc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:02.770069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 871/1720] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:02 2022] DELETE /identity/v3/users/93a623c39a4542cfbd720338f7a215d7 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:02.771054 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394f900-e43c-47ce-83e8-ecc274ae4819 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:02.775721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8394f900-e43c-47ce-83e8-ecc274ae4819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:02.788634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a075a-6ef5-429d-8ba5-510ff3bc4cc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:02.790449 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a075a-6ef5-429d-8ba5-510ff3bc4cc7 service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:02.814272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 850/1721] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:02.827520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a075a-6ef5-429d-8ba5-510ff3bc4cc7 service placement] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:02.845053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ea4a075a-6ef5-429d-8ba5-510ff3bc4cc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:02.850058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:02.912455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:02.941111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394f900-e43c-47ce-83e8-ecc274ae4819 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:02.956779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe2498-4330-4557-981c-05fe1aef69a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:02.957555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe2498-4330-4557-981c-05fe1aef69a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:02.958101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe2498-4330-4557-981c-05fe1aef69a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:02.958101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe2498-4330-4557-981c-05fe1aef69a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:02.958929 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe2498-4330-4557-981c-05fe1aef69a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:02.983896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe2498-4330-4557-981c-05fe1aef69a0 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:03.008866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 872/1722] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:03.010377 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe2498-4330-4557-981c-05fe1aef69a0 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:03.019941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-01fe2498-4330-4557-981c-05fe1aef69a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:03.099618 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe2498-4330-4557-981c-05fe1aef69a0 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:03.107087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7fc83-2c80-4cb0-ad16-90362d530652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:03.109659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7fc83-2c80-4cb0-ad16-90362d530652 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:03.111656 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7fc83-2c80-4cb0-ad16-90362d530652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:03.113034 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7fc83-2c80-4cb0-ad16-90362d530652 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:03.115137 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7fc83-2c80-4cb0-ad16-90362d530652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:03.122699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7fc83-2c80-4cb0-ad16-90362d530652 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:03.139200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a075a-6ef5-429d-8ba5-510ff3bc4cc7 service placement] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:03.297227 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 873/1723] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:03 2022] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:03.298575 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b59f55-76be-4650-bdcf-b94f033cb211 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:03.303187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b59f55-76be-4650-bdcf-b94f033cb211 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:03.304959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b59f55-76be-4650-bdcf-b94f033cb211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:03.364952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0156f63-0d4f-4d9b-95f6-c2122cd6e60b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:03.367815 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0156f63-0d4f-4d9b-95f6-c2122cd6e60b service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:03.369256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0156f63-0d4f-4d9b-95f6-c2122cd6e60b service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:03.373342 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0156f63-0d4f-4d9b-95f6-c2122cd6e60b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:03.381951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f5b59f55-76be-4650-bdcf-b94f033cb211 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:03.381951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f5b59f55-76be-4650-bdcf-b94f033cb211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:03.390978 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e0156f63-0d4f-4d9b-95f6-c2122cd6e60b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:03.400476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 874/1724] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:03.408544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b59f55-76be-4650-bdcf-b94f033cb211 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:03.437754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0156f63-0d4f-4d9b-95f6-c2122cd6e60b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:03.440228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0156f63-0d4f-4d9b-95f6-c2122cd6e60b service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:03.440700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b59f55-76be-4650-bdcf-b94f033cb211 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:03.447016 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc4649-51cd-4d44-88b5-3f7a1528f3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:03.448417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc4649-51cd-4d44-88b5-3f7a1528f3e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:03.448911 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc4649-51cd-4d44-88b5-3f7a1528f3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:03.449446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc4649-51cd-4d44-88b5-3f7a1528f3e8 admin admin] PATH_INFO: `/v3/projects/01f3254235f1410aa0d29cbef8d71f5b/users/ae1c6446852f47e187aa84ce9b28a3ef/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:03.468185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 851/1725] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:03.469288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0156f63-0d4f-4d9b-95f6-c2122cd6e60b service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:03.471678 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc4649-51cd-4d44-88b5-3f7a1528f3e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f3254235f1410aa0d29cbef8d71f5b, user_id=ae1c6446852f47e187aa84ce9b28a3ef, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:03.474980 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc4649-51cd-4d44-88b5-3f7a1528f3e8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:03.508016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0156f63-0d4f-4d9b-95f6-c2122cd6e60b service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:03.521572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11b418-e7ff-4159-a05c-4f7421e4a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:03.523100 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11b418-e7ff-4159-a05c-4f7421e4a6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:03.525042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11b418-e7ff-4159-a05c-4f7421e4a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:03.525445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11b418-e7ff-4159-a05c-4f7421e4a6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:03.526325 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11b418-e7ff-4159-a05c-4f7421e4a6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:03.532478 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11b418-e7ff-4159-a05c-4f7421e4a6c7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:03.564754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 852/1726] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:03.565970 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11b418-e7ff-4159-a05c-4f7421e4a6c7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:03.570900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-de11b418-e7ff-4159-a05c-4f7421e4a6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:03.599645 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 875/1727] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:03 2022] PUT /identity/v3/projects/01f3254235f1410aa0d29cbef8d71f5b/users/ae1c6446852f47e187aa84ce9b28a3ef/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:03.600925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc4649-51cd-4d44-88b5-3f7a1528f3e8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:03.611510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11b418-e7ff-4159-a05c-4f7421e4a6c7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:03.693944 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034aa93-44a2-4940-b2f5-ea73a2d0fb67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:03.698875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034aa93-44a2-4940-b2f5-ea73a2d0fb67 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:03.698875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034aa93-44a2-4940-b2f5-ea73a2d0fb67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:03.698875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034aa93-44a2-4940-b2f5-ea73a2d0fb67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:03.742545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc4649-51cd-4d44-88b5-3f7a1528f3e8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:03.757812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f273daf-53ac-42cd-b6e1-cc0499f0d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:03.758494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f273daf-53ac-42cd-b6e1-cc0499f0d478 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:03.759461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f273daf-53ac-42cd-b6e1-cc0499f0d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:03.759642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f273daf-53ac-42cd-b6e1-cc0499f0d478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:03.760471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f273daf-53ac-42cd-b6e1-cc0499f0d478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:03.766836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f273daf-53ac-42cd-b6e1-cc0499f0d478 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:03.782890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 876/1728] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:03.782890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f273daf-53ac-42cd-b6e1-cc0499f0d478 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:03.789315 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034aa93-44a2-4940-b2f5-ea73a2d0fb67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:03.791940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034aa93-44a2-4940-b2f5-ea73a2d0fb67 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:03.799055 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f273daf-53ac-42cd-b6e1-cc0499f0d478 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:03.811043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 853/1729] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:03.811597 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034aa93-44a2-4940-b2f5-ea73a2d0fb67 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:03.813298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3015dd7-4967-4f97-b77a-ad23d167c5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:03.814030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3015dd7-4967-4f97-b77a-ad23d167c5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:03.814269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3015dd7-4967-4f97-b77a-ad23d167c5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:03.814545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3015dd7-4967-4f97-b77a-ad23d167c5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:03.815280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3015dd7-4967-4f97-b77a-ad23d167c5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:03.816915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3015dd7-4967-4f97-b77a-ad23d167c5bb admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:03.826590 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034aa93-44a2-4940-b2f5-ea73a2d0fb67 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:03.832919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05717f6-1340-4fdf-ba12-4474f928cfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:03.834722 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05717f6-1340-4fdf-ba12-4474f928cfc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:03.838033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05717f6-1340-4fdf-ba12-4474f928cfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:03.838033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05717f6-1340-4fdf-ba12-4474f928cfc7 admin admin] PATH_INFO: `/v3/projects/574d12b755c74174ae76eb996075d8c5/users/017285358d7949458d18d85d00e7f9e3/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:03.842935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 877/1730] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:03.847785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3015dd7-4967-4f97-b77a-ad23d167c5bb admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:03.854351 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:03.864514 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3015dd7-4967-4f97-b77a-ad23d167c5bb admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:03.867279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05717f6-1340-4fdf-ba12-4474f928cfc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574d12b755c74174ae76eb996075d8c5, user_id=017285358d7949458d18d85d00e7f9e3, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:03.870017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05717f6-1340-4fdf-ba12-4474f928cfc7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:03.879437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4be5c-6689-4f42-a12f-b1e762f785da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:03.888464 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4be5c-6689-4f42-a12f-b1e762f785da admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:03.888883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4be5c-6689-4f42-a12f-b1e762f785da admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:03.889175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4be5c-6689-4f42-a12f-b1e762f785da admin admin] PATH_INFO: `/v3/projects/01f3254235f1410aa0d29cbef8d71f5b/users/ae1c6446852f47e187aa84ce9b28a3ef/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:03.893906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4be5c-6689-4f42-a12f-b1e762f785da admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f3254235f1410aa0d29cbef8d71f5b, user_id=ae1c6446852f47e187aa84ce9b28a3ef, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:03.906112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4be5c-6689-4f42-a12f-b1e762f785da admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:03.941948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 878/1731] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:03 2022] PUT /identity/v3/projects/01f3254235f1410aa0d29cbef8d71f5b/users/ae1c6446852f47e187aa84ce9b28a3ef/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:03.993513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 854/1732] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:03 2022] PUT /identity/v3/projects/574d12b755c74174ae76eb996075d8c5/users/017285358d7949458d18d85d00e7f9e3/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:04.005905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854926d-18ab-40c3-8984-16a27b3f18a1 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:04.007065 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854926d-18ab-40c3-8984-16a27b3f18a1 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:04.007568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854926d-18ab-40c3-8984-16a27b3f18a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:04.081092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3854926d-18ab-40c3-8984-16a27b3f18a1 None None] MFA Rules not processed for user `017285358d7949458d18d85d00e7f9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:04.082333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3854926d-18ab-40c3-8984-16a27b3f18a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:04.308581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 879/1733] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:04.309460 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05717f6-1340-4fdf-ba12-4474f928cfc7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:04.501454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05717f6-1340-4fdf-ba12-4474f928cfc7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:04.516182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:04.518564 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8601a83-648f-4329-af7e-8b0b8aa6b0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:04.519560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8601a83-648f-4329-af7e-8b0b8aa6b0ee admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:04.519950 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8601a83-648f-4329-af7e-8b0b8aa6b0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:04.520360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8601a83-648f-4329-af7e-8b0b8aa6b0ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:04.521557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8601a83-648f-4329-af7e-8b0b8aa6b0ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:04.523633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8601a83-648f-4329-af7e-8b0b8aa6b0ee admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:04.668093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 855/1734] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:04 2022] POST /identity/v3/projects => generated 385 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:23:04.672463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854926d-18ab-40c3-8984-16a27b3f18a1 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:04.686195 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854926d-18ab-40c3-8984-16a27b3f18a1 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:04.801708 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58f50b-fdbf-4282-9238-dfc305c6c268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:04.802465 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f50b-fdbf-4282-9238-dfc305c6c268 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:04.802749 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f50b-fdbf-4282-9238-dfc305c6c268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:04.803076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f50b-fdbf-4282-9238-dfc305c6c268 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:04.803720 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58f50b-fdbf-4282-9238-dfc305c6c268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:04.805825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58f50b-fdbf-4282-9238-dfc305c6c268 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:04.977900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 880/1735] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:04 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:04.982542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8601a83-648f-4329-af7e-8b0b8aa6b0ee admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:05.007604 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8601a83-648f-4329-af7e-8b0b8aa6b0ee admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:05.042710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aabd0d-1fd2-4bec-ae42-76fa6690a2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:05.053057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aabd0d-1fd2-4bec-ae42-76fa6690a2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:05.053057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aabd0d-1fd2-4bec-ae42-76fa6690a2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:05.053057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aabd0d-1fd2-4bec-ae42-76fa6690a2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:05.053057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aabd0d-1fd2-4bec-ae42-76fa6690a2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:05.068373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aabd0d-1fd2-4bec-ae42-76fa6690a2b1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:05.104023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 856/1736] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:05.106354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58f50b-fdbf-4282-9238-dfc305c6c268 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:05.122211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58f50b-fdbf-4282-9238-dfc305c6c268 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:05.149668 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20d497-7847-4977-b752-0e36dc504752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:05.150607 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20d497-7847-4977-b752-0e36dc504752 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:05.151027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20d497-7847-4977-b752-0e36dc504752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:05.151622 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20d497-7847-4977-b752-0e36dc504752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:05.153879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20d497-7847-4977-b752-0e36dc504752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:05.156299 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20d497-7847-4977-b752-0e36dc504752 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:05.174198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aabd0d-1fd2-4bec-ae42-76fa6690a2b1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:05.174972 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 881/1737] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:05.203691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20d497-7847-4977-b752-0e36dc504752 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:05.204533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aabd0d-1fd2-4bec-ae42-76fa6690a2b1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:05.208159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2a20d497-7847-4977-b752-0e36dc504752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:05.212325 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d2e1b-d0b9-4592-8b67-39f511065e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:05.221911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d2e1b-d0b9-4592-8b67-39f511065e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:05.222655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d2e1b-d0b9-4592-8b67-39f511065e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:05.224296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d2e1b-d0b9-4592-8b67-39f511065e7f admin admin] PATH_INFO: `/v3/projects/f532df0e52074c858b12ff4eec9e0c13/users/de40f91ecba643818ff6ef16f86fbf51/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:05.249105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d2e1b-d0b9-4592-8b67-39f511065e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f532df0e52074c858b12ff4eec9e0c13, user_id=de40f91ecba643818ff6ef16f86fbf51, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:05.252556 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d2e1b-d0b9-4592-8b67-39f511065e7f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:05.262712 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20d497-7847-4977-b752-0e36dc504752 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:05.268805 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:05.270021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:05.271202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:05.271665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] PATH_INFO: `/v3/projects/3f4101e87eee481db9b00010f75c15e4` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:05.273691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4101e87eee481db9b00010f75c15e4)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:05.294063 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:05.329639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 857/1738] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:05 2022] PUT /identity/v3/projects/f532df0e52074c858b12ff4eec9e0c13/users/de40f91ecba643818ff6ef16f86fbf51/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:05.331790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333129-5246-4c1b-9a00-1df7d795cd42 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:05.332235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333129-5246-4c1b-9a00-1df7d795cd42 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:05.332732 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333129-5246-4c1b-9a00-1df7d795cd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:05.383205 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:05.440888 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2b333129-5246-4c1b-9a00-1df7d795cd42 None None] MFA Rules not processed for user `de40f91ecba643818ff6ef16f86fbf51`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:05.442237 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2b333129-5246-4c1b-9a00-1df7d795cd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:05.515563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4101e87eee481db9b00010f75c15e4', 'request_id': 'req-835d5e86-8774-4acc-8a00-cf57aaba3753'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:05.569504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 858/1739] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:05.570919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b333129-5246-4c1b-9a00-1df7d795cd42 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:05.626202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4101e87eee481db9b00010f75c15e4', 'request_id': 'req-835d5e86-8774-4acc-8a00-cf57aaba3753'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:05.638083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4101e87eee481db9b00010f75c15e4', 'request_id': 'req-835d5e86-8774-4acc-8a00-cf57aaba3753'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:05.680941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] The token cache is being invalidate because project 3f4101e87eee481db9b00010f75c15e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:05.681370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:05.682900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:05.707570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 882/1740] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:05 2022] DELETE /identity/v3/projects/3f4101e87eee481db9b00010f75c15e4 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:05.712111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:05.732711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:05.761411 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b333129-5246-4c1b-9a00-1df7d795cd42 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:05.890945 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d5e86-8774-4acc-8a00-cf57aaba3753 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:05.912803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e85d6-f321-4a8b-9606-f8780eb05dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:05.913850 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e85d6-f321-4a8b-9606-f8780eb05dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:05.914210 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e85d6-f321-4a8b-9606-f8780eb05dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:05.914562 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e85d6-f321-4a8b-9606-f8780eb05dac admin admin] PATH_INFO: `/v3/users/478f42f52430458582459fbf4c24a7fc` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:05.917763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e85d6-f321-4a8b-9606-f8780eb05dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=478f42f52430458582459fbf4c24a7fc)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:05.921049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e85d6-f321-4a8b-9606-f8780eb05dac admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:05.989445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1134f96-39d0-4c53-b0ed-041f082d288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:05.990135 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1134f96-39d0-4c53-b0ed-041f082d288d admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:05.990425 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1134f96-39d0-4c53-b0ed-041f082d288d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:05.990705 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1134f96-39d0-4c53-b0ed-041f082d288d admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:05.997630 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1134f96-39d0-4c53-b0ed-041f082d288d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:06.002650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1134f96-39d0-4c53-b0ed-041f082d288d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:06.240196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 859/1741] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:05 2022] POST /identity/v3/projects => generated 387 bytes in 667 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:06.240196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf5ba2-bb6b-4809-b523-10383fd783f2 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:06.240196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf5ba2-bb6b-4809-b523-10383fd783f2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:06.240196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf5ba2-bb6b-4809-b523-10383fd783f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:06.318111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a48e85d6-f321-4a8b-9606-f8780eb05dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478f42f52430458582459fbf4c24a7fc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:06.376306 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9daf5ba2-bb6b-4809-b523-10383fd783f2 None None] MFA Rules not processed for user `8acb1c9eead84a11a48c1a217ce82584`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:06.380818 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9daf5ba2-bb6b-4809-b523-10383fd783f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:06.391380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a48e85d6-f321-4a8b-9606-f8780eb05dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478f42f52430458582459fbf4c24a7fc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:06.518500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a48e85d6-f321-4a8b-9606-f8780eb05dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478f42f52430458582459fbf4c24a7fc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:06.519390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a48e85d6-f321-4a8b-9606-f8780eb05dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478f42f52430458582459fbf4c24a7fc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:06.529274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a48e85d6-f321-4a8b-9606-f8780eb05dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478f42f52430458582459fbf4c24a7fc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:06.542274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 860/1742] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:06.542274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf5ba2-bb6b-4809-b523-10383fd783f2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:06.555614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9daf5ba2-bb6b-4809-b523-10383fd783f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:06.559858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 883/1743] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:05 2022] DELETE /identity/v3/users/478f42f52430458582459fbf4c24a7fc => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:06.711509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf5ba2-bb6b-4809-b523-10383fd783f2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:06.723476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:06.784620 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474ffd6-c6bf-4221-a2fa-056beb435234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:06.785324 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474ffd6-c6bf-4221-a2fa-056beb435234 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:06.785612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474ffd6-c6bf-4221-a2fa-056beb435234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:06.785890 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474ffd6-c6bf-4221-a2fa-056beb435234 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:06.786592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474ffd6-c6bf-4221-a2fa-056beb435234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:06.789335 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474ffd6-c6bf-4221-a2fa-056beb435234 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:06.901023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 861/1744] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:06 2022] POST /identity/v3/users => generated 300 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:06.911030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e85d6-f321-4a8b-9606-f8780eb05dac admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:06.911030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a48e85d6-f321-4a8b-9606-f8780eb05dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:06.930675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100a10b-51c7-4aad-99e1-80291ace832d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:06.930675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100a10b-51c7-4aad-99e1-80291ace832d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:06.930675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100a10b-51c7-4aad-99e1-80291ace832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:06.934217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e85d6-f321-4a8b-9606-f8780eb05dac admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:06.946782 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8906450-73ed-42d2-9c0a-5016614b3b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:06.950757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8906450-73ed-42d2-9c0a-5016614b3b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:06.950757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8906450-73ed-42d2-9c0a-5016614b3b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:06.950757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8906450-73ed-42d2-9c0a-5016614b3b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:06.950757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8906450-73ed-42d2-9c0a-5016614b3b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:06.953103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8906450-73ed-42d2-9c0a-5016614b3b02 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:06.963178 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9100a10b-51c7-4aad-99e1-80291ace832d None None] MFA Rules not processed for user `ae1c6446852f47e187aa84ce9b28a3ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:06.965499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9100a10b-51c7-4aad-99e1-80291ace832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:06.972263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 884/1745] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:06.973468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8906450-73ed-42d2-9c0a-5016614b3b02 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:07.010953 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8906450-73ed-42d2-9c0a-5016614b3b02 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:07.025769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e85357-34cf-470f-a14f-89dba691504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:07.030701 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e85357-34cf-470f-a14f-89dba691504b admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:07.031319 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e85357-34cf-470f-a14f-89dba691504b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:07.032186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e85357-34cf-470f-a14f-89dba691504b admin admin] PATH_INFO: `/v3/projects/9f59602eafb74c94b0ec37b0acd9c069/users/7c83e9c18768452b95215a9463b18a25/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:07.066241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e85357-34cf-470f-a14f-89dba691504b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f59602eafb74c94b0ec37b0acd9c069, user_id=7c83e9c18768452b95215a9463b18a25, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:07.069075 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e85357-34cf-470f-a14f-89dba691504b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:07.155723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 885/1746] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:06 2022] PUT /identity/v3/projects/9f59602eafb74c94b0ec37b0acd9c069/users/7c83e9c18768452b95215a9463b18a25/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:07.159981 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e85357-34cf-470f-a14f-89dba691504b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:07.161366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 862/1747] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:06 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:23:07.296134 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e85357-34cf-470f-a14f-89dba691504b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:07.321320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ef36a-168f-497b-8331-0096521a699c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:07.330462 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ef36a-168f-497b-8331-0096521a699c admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:07.331002 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ef36a-168f-497b-8331-0096521a699c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:07.344471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ef36a-168f-497b-8331-0096521a699c admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:07.344471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ef36a-168f-497b-8331-0096521a699c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:07.349123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ef36a-168f-497b-8331-0096521a699c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:07.366394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 886/1748] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:07.370559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100a10b-51c7-4aad-99e1-80291ace832d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:07.388416 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100a10b-51c7-4aad-99e1-80291ace832d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:07.395822 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ce506-09ed-49c8-89a0-8c9a6f00358c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:07.397019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ce506-09ed-49c8-89a0-8c9a6f00358c admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:07.405668 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ce506-09ed-49c8-89a0-8c9a6f00358c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:07.405668 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ce506-09ed-49c8-89a0-8c9a6f00358c admin admin] PATH_INFO: `/v3/projects/9f59602eafb74c94b0ec37b0acd9c069/users/7c83e9c18768452b95215a9463b18a25/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:07.405668 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ce506-09ed-49c8-89a0-8c9a6f00358c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f59602eafb74c94b0ec37b0acd9c069, user_id=7c83e9c18768452b95215a9463b18a25, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:07.405668 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ce506-09ed-49c8-89a0-8c9a6f00358c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:07.451900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 863/1749] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:07 2022] PUT /identity/v3/projects/9f59602eafb74c94b0ec37b0acd9c069/users/7c83e9c18768452b95215a9463b18a25/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:07.467584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff20d0-fd25-42f9-a206-2675c644bce2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:07.468420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff20d0-fd25-42f9-a206-2675c644bce2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:07.468852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff20d0-fd25-42f9-a206-2675c644bce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:07.517947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:07.580684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d8ff20d0-fd25-42f9-a206-2675c644bce2 None None] MFA Rules not processed for user `7c83e9c18768452b95215a9463b18a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:07.581963 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d8ff20d0-fd25-42f9-a206-2675c644bce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:07.726579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ce506-09ed-49c8-89a0-8c9a6f00358c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:07.728749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c38ce506-09ed-49c8-89a0-8c9a6f00358c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:07.778644 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 887/1750] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:07.790117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff20d0-fd25-42f9-a206-2675c644bce2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:07.794006 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d8ff20d0-fd25-42f9-a206-2675c644bce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:07.958799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff20d0-fd25-42f9-a206-2675c644bce2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:07.963824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dbe67-e5bb-4724-9308-540e0aa6ff6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:07.965306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dbe67-e5bb-4724-9308-540e0aa6ff6f service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:07.965619 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dbe67-e5bb-4724-9308-540e0aa6ff6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:07.965903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dbe67-e5bb-4724-9308-540e0aa6ff6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:07.974176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ce506-09ed-49c8-89a0-8c9a6f00358c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:07.981523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dbe67-e5bb-4724-9308-540e0aa6ff6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:07.984909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dbe67-e5bb-4724-9308-540e0aa6ff6f service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:07.987314 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34806f6e-902d-4113-8aa8-49ad66ea8d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:07.988255 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34806f6e-902d-4113-8aa8-49ad66ea8d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:07.988547 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34806f6e-902d-4113-8aa8-49ad66ea8d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:07.989988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34806f6e-902d-4113-8aa8-49ad66ea8d88 admin admin] PATH_INFO: `/v3/projects/c6eb420c9ef54c16906865e822da4aba` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:07.991432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34806f6e-902d-4113-8aa8-49ad66ea8d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6eb420c9ef54c16906865e822da4aba)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:07.993442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34806f6e-902d-4113-8aa8-49ad66ea8d88 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:08.066952 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 888/1751] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:08.221534 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-34806f6e-902d-4113-8aa8-49ad66ea8d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6eb420c9ef54c16906865e822da4aba', 'request_id': 'req-34806f6e-902d-4113-8aa8-49ad66ea8d88'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:08.254216 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:08.302274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-34806f6e-902d-4113-8aa8-49ad66ea8d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6eb420c9ef54c16906865e822da4aba', 'request_id': 'req-34806f6e-902d-4113-8aa8-49ad66ea8d88'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:08.322601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-34806f6e-902d-4113-8aa8-49ad66ea8d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6eb420c9ef54c16906865e822da4aba', 'request_id': 'req-34806f6e-902d-4113-8aa8-49ad66ea8d88'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:08.372899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-34806f6e-902d-4113-8aa8-49ad66ea8d88 admin admin] The token cache is being invalidate because project c6eb420c9ef54c16906865e822da4aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:08.373204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-34806f6e-902d-4113-8aa8-49ad66ea8d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:08.379555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-34806f6e-902d-4113-8aa8-49ad66ea8d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:08.389154 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 864/1752] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:07 2022] DELETE /identity/v3/projects/c6eb420c9ef54c16906865e822da4aba => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:08.394238 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12035-197d-4975-89d4-d627a4b32dca None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:08.395083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12035-197d-4975-89d4-d627a4b32dca None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:08.395557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12035-197d-4975-89d4-d627a4b32dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:08.473334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1ca12035-197d-4975-89d4-d627a4b32dca None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:08.474570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1ca12035-197d-4975-89d4-d627a4b32dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:08.702385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 889/1753] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:08.709141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b426d-c171-42c6-b21c-8acab4dae33e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:08.718940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b426d-c171-42c6-b21c-8acab4dae33e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:08.718940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b426d-c171-42c6-b21c-8acab4dae33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:08.750600 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:08.764817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-505b426d-c171-42c6-b21c-8acab4dae33e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:08.770818 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-505b426d-c171-42c6-b21c-8acab4dae33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:08.785944 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe0309-f0ac-4ac5-9ec0-9a92244fc1ee None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:08.786238 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe0309-f0ac-4ac5-9ec0-9a92244fc1ee None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:08.786525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe0309-f0ac-4ac5-9ec0-9a92244fc1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:08.791428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 865/1754] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:23:08.796212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b426d-c171-42c6-b21c-8acab4dae33e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:08.809133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b426d-c171-42c6-b21c-8acab4dae33e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:08.816073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97f60e-c5f8-458e-b1ac-3e9e7859923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:08.817062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97f60e-c5f8-458e-b1ac-3e9e7859923f admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:08.817548 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97f60e-c5f8-458e-b1ac-3e9e7859923f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:08.818043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97f60e-c5f8-458e-b1ac-3e9e7859923f admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:08.819028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97f60e-c5f8-458e-b1ac-3e9e7859923f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:08.819534 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97f60e-c5f8-458e-b1ac-3e9e7859923f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:08.821793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97f60e-c5f8-458e-b1ac-3e9e7859923f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:08.841377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 866/1755] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:23:08.846783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97f60e-c5f8-458e-b1ac-3e9e7859923f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:08.869441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97f60e-c5f8-458e-b1ac-3e9e7859923f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:08.881314 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe8350-0a98-4290-a145-17de04917308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:08.882234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe8350-0a98-4290-a145-17de04917308 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:08.882234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe8350-0a98-4290-a145-17de04917308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:08.882535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe8350-0a98-4290-a145-17de04917308 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:08.883247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe8350-0a98-4290-a145-17de04917308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:08.887947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe8350-0a98-4290-a145-17de04917308 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:08.934215 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1efe0309-f0ac-4ac5-9ec0-9a92244fc1ee None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:08.936686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1efe0309-f0ac-4ac5-9ec0-9a92244fc1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:09.060623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 867/1756] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:08 2022] POST /identity/v3/projects => generated 355 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:09.069430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe8350-0a98-4290-a145-17de04917308 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:09.124288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 890/1757] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:23:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:09.221061 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe8350-0a98-4290-a145-17de04917308 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:09.234821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7be463-762c-4d17-8a70-e755d469da12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:09.236403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7be463-762c-4d17-8a70-e755d469da12 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:09.236858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7be463-762c-4d17-8a70-e755d469da12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:09.237276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7be463-762c-4d17-8a70-e755d469da12 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:09.238140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7be463-762c-4d17-8a70-e755d469da12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:09.247748 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7be463-762c-4d17-8a70-e755d469da12 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:09.346823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc71a3f-378d-4b34-8fa5-2f7af6051186 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:09.347105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc71a3f-378d-4b34-8fa5-2f7af6051186 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:09.347692 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc71a3f-378d-4b34-8fa5-2f7af6051186 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:09.349172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 891/1758] 10.222.0.74 () {54 vars in 921 bytes} [Thu Jul 14 10:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:23:09.356696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3715080-0972-4759-a1ab-062ce32a2547 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:09.361994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3715080-0972-4759-a1ab-062ce32a2547 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:09.361994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3715080-0972-4759-a1ab-062ce32a2547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:09.393223 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 868/1759] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:09 2022] POST /identity/v3/users => generated 278 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:09.394250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7be463-762c-4d17-8a70-e755d469da12 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:09.416792 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7be463-762c-4d17-8a70-e755d469da12 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:09.420693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad6885-025f-4e4c-925d-0558e464a145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:09.421707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad6885-025f-4e4c-925d-0558e464a145 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:09.424592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad6885-025f-4e4c-925d-0558e464a145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:09.424982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad6885-025f-4e4c-925d-0558e464a145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:09.425725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad6885-025f-4e4c-925d-0558e464a145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:09.428828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad6885-025f-4e4c-925d-0558e464a145 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:09.449718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 869/1760] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:23:09.451666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a3715080-0972-4759-a1ab-062ce32a2547 None None] MFA Rules not processed for user `2784d36c16d343cc961a22d956ee30f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:09.455433 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad6885-025f-4e4c-925d-0558e464a145 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:09.465320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a3715080-0972-4759-a1ab-062ce32a2547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:09.499774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad6885-025f-4e4c-925d-0558e464a145 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:09.521082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a55de7-9183-4808-ae70-a442a2ea57f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:09.521769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a55de7-9183-4808-ae70-a442a2ea57f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:09.522054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a55de7-9183-4808-ae70-a442a2ea57f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:09.522326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a55de7-9183-4808-ae70-a442a2ea57f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:09.523065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a55de7-9183-4808-ae70-a442a2ea57f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:09.524709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a55de7-9183-4808-ae70-a442a2ea57f0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:09.589598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 870/1761] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:09.590660 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a55de7-9183-4808-ae70-a442a2ea57f0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:09.621571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a55de7-9183-4808-ae70-a442a2ea57f0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:09.630243 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20988e83-7879-46b9-9687-2bd479369630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:09.631138 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20988e83-7879-46b9-9687-2bd479369630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:09.631423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20988e83-7879-46b9-9687-2bd479369630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:09.633870 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20988e83-7879-46b9-9687-2bd479369630 admin admin] PATH_INFO: `/v3/projects/e5f8f7ea66a0459b832db8bc868a2667/users/0f1f7ecbd41a46b4a8e3ca7bd648b0f1/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:09.684612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20988e83-7879-46b9-9687-2bd479369630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f8f7ea66a0459b832db8bc868a2667, user_id=0f1f7ecbd41a46b4a8e3ca7bd648b0f1, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:09.687782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20988e83-7879-46b9-9687-2bd479369630 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:09.788935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 892/1762] 10.222.0.74 () {58 vars in 1018 bytes} [Thu Jul 14 10:23:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:09.789934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3715080-0972-4759-a1ab-062ce32a2547 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:09.797999 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a3715080-0972-4759-a1ab-062ce32a2547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:09.817168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 871/1763] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:09 2022] PUT /identity/v3/projects/e5f8f7ea66a0459b832db8bc868a2667/users/0f1f7ecbd41a46b4a8e3ca7bd648b0f1/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:09.834889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1de82c-9e67-40a5-9b4a-bba009135660 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:09.835422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1de82c-9e67-40a5-9b4a-bba009135660 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:09.842392 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1de82c-9e67-40a5-9b4a-bba009135660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:09.975141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-da1de82c-9e67-40a5-9b4a-bba009135660 None None] MFA Rules not processed for user `0f1f7ecbd41a46b4a8e3ca7bd648b0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:09.976715 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-da1de82c-9e67-40a5-9b4a-bba009135660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:10.091007 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3715080-0972-4759-a1ab-062ce32a2547 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:10.155113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 872/1764] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:09 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:23:10.156268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1de82c-9e67-40a5-9b4a-bba009135660 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:10.161039 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-da1de82c-9e67-40a5-9b4a-bba009135660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:10.294801 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:10.322296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb3519-72d0-4d74-b9df-70dd87bbd920 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:10.328414 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb3519-72d0-4d74-b9df-70dd87bbd920 service swift] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:10.328713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb3519-72d0-4d74-b9df-70dd87bbd920 service swift] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:10.328998 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb3519-72d0-4d74-b9df-70dd87bbd920 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:10.350363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1de82c-9e67-40a5-9b4a-bba009135660 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:10.373441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0379f06-2834-4d5d-b37f-d5cab2133c0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784d36c16d343cc961a22d956ee30f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:10.374349 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0379f06-2834-4d5d-b37f-d5cab2133c0b service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:10.374832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0379f06-2834-4d5d-b37f-d5cab2133c0b service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:10.375299 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0379f06-2834-4d5d-b37f-d5cab2133c0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:10.398503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0379f06-2834-4d5d-b37f-d5cab2133c0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:10.400111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0379f06-2834-4d5d-b37f-d5cab2133c0b service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:10.413991 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 873/1765] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:10.416797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0379f06-2834-4d5d-b37f-d5cab2133c0b service placement] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:10.487365 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:10.567839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb3519-72d0-4d74-b9df-70dd87bbd920 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:10.570710 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb3519-72d0-4d74-b9df-70dd87bbd920 service swift] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:10.580219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0379f06-2834-4d5d-b37f-d5cab2133c0b service placement] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:10.586250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d7d48-47b2-4680-a445-37c1cfff43a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:10.586936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d7d48-47b2-4680-a445-37c1cfff43a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:10.590761 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d7d48-47b2-4680-a445-37c1cfff43a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:10.591095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d7d48-47b2-4680-a445-37c1cfff43a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:10.594722 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d7d48-47b2-4680-a445-37c1cfff43a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:10.595082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 893/1766] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:23:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:23:10.597335 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb3519-72d0-4d74-b9df-70dd87bbd920 service swift] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:10.598707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d7d48-47b2-4680-a445-37c1cfff43a2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:10.601642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c2eb3519-72d0-4d74-b9df-70dd87bbd920 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:10.711299 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 874/1767] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:10 2022] POST /identity/v3/projects => generated 357 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:10.713788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d70802-521c-40e1-8419-75a2edba922e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:10.714131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d70802-521c-40e1-8419-75a2edba922e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:10.714453 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d70802-521c-40e1-8419-75a2edba922e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:10.729005 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb3519-72d0-4d74-b9df-70dd87bbd920 service swift] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:10.742401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-35d70802-521c-40e1-8419-75a2edba922e None None] MFA Rules not processed for user `35057047c93946a7a1ff01bd649abd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:10.743937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-35d70802-521c-40e1-8419-75a2edba922e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:10.928551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 875/1768] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:10.929692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d70802-521c-40e1-8419-75a2edba922e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:11.081733 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc2f52-1de7-4b9c-aa3c-da4f801da4fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:11.082438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc2f52-1de7-4b9c-aa3c-da4f801da4fc service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:11.088244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc2f52-1de7-4b9c-aa3c-da4f801da4fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:11.088583 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc2f52-1de7-4b9c-aa3c-da4f801da4fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:11.097065 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-08bc2f52-1de7-4b9c-aa3c-da4f801da4fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:11.118793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d70802-521c-40e1-8419-75a2edba922e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:11.127164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d1dc5-5ba5-4df6-9de2-081ee18829c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:11.128843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d1dc5-5ba5-4df6-9de2-081ee18829c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:11.128843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d1dc5-5ba5-4df6-9de2-081ee18829c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:11.128843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d1dc5-5ba5-4df6-9de2-081ee18829c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:11.129560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d1dc5-5ba5-4df6-9de2-081ee18829c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:11.131923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d1dc5-5ba5-4df6-9de2-081ee18829c0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:11.279077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 876/1769] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:10 2022] POST /identity/v3/users => generated 285 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:11.280266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d1dc5-5ba5-4df6-9de2-081ee18829c0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:11.361236 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d1dc5-5ba5-4df6-9de2-081ee18829c0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:11.376387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11209-576e-4102-9d4b-0af46f4b6f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:11.377710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11209-576e-4102-9d4b-0af46f4b6f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:11.378191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11209-576e-4102-9d4b-0af46f4b6f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:11.378878 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11209-576e-4102-9d4b-0af46f4b6f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:11.379234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11209-576e-4102-9d4b-0af46f4b6f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:11.381165 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11209-576e-4102-9d4b-0af46f4b6f73 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:11.405553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 877/1770] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:11.410659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11209-576e-4102-9d4b-0af46f4b6f73 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:11.466279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11209-576e-4102-9d4b-0af46f4b6f73 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:11.489021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764ca19-9227-4438-90e7-85c013ce55ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:11.489949 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764ca19-9227-4438-90e7-85c013ce55ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:11.490227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764ca19-9227-4438-90e7-85c013ce55ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:11.492176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764ca19-9227-4438-90e7-85c013ce55ab admin admin] PATH_INFO: `/v3/projects/0e6733bec6c148b08bf8cde7e9d1a53d/users/036cec8472fa46cfb59c75b1873fa218/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:11.492301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc2f52-1de7-4b9c-aa3c-da4f801da4fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:11.496706 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc2f52-1de7-4b9c-aa3c-da4f801da4fc service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:11.538086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 894/1771] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 942 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:11.549607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764ca19-9227-4438-90e7-85c013ce55ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6733bec6c148b08bf8cde7e9d1a53d, user_id=036cec8472fa46cfb59c75b1873fa218, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:11.557482 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764ca19-9227-4438-90e7-85c013ce55ab admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:11.670013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 878/1772] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:11 2022] PUT /identity/v3/projects/0e6733bec6c148b08bf8cde7e9d1a53d/users/036cec8472fa46cfb59c75b1873fa218/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:11.674386 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc2f52-1de7-4b9c-aa3c-da4f801da4fc service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:11.693452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc2f52-1de7-4b9c-aa3c-da4f801da4fc service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:11.858360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c69e6-64f8-4eea-a733-efae6efe9173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:11.859057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c69e6-64f8-4eea-a733-efae6efe9173 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:11.859340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c69e6-64f8-4eea-a733-efae6efe9173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:11.859612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c69e6-64f8-4eea-a733-efae6efe9173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:11.871440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c69e6-64f8-4eea-a733-efae6efe9173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:11.873157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c69e6-64f8-4eea-a733-efae6efe9173 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:11.917226 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 895/1773] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:11.918905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764ca19-9227-4438-90e7-85c013ce55ab admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:11.935224 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764ca19-9227-4438-90e7-85c013ce55ab admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:11.955880 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebe01b-23dc-46dc-9ac6-2c442b3f03e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:11.957055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe01b-23dc-46dc-9ac6-2c442b3f03e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:11.957546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe01b-23dc-46dc-9ac6-2c442b3f03e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:11.957976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe01b-23dc-46dc-9ac6-2c442b3f03e5 admin admin] PATH_INFO: `/v3/projects/0e6733bec6c148b08bf8cde7e9d1a53d/users/036cec8472fa46cfb59c75b1873fa218/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:11.961896 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebe01b-23dc-46dc-9ac6-2c442b3f03e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6733bec6c148b08bf8cde7e9d1a53d, user_id=036cec8472fa46cfb59c75b1873fa218, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:11.967576 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebe01b-23dc-46dc-9ac6-2c442b3f03e5 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:12.002929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 879/1774] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:11 2022] PUT /identity/v3/projects/0e6733bec6c148b08bf8cde7e9d1a53d/users/036cec8472fa46cfb59c75b1873fa218/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:12.005032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66015ca-e97b-4d2a-b3d2-0451771f76c1 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:12.005730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66015ca-e97b-4d2a-b3d2-0451771f76c1 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:12.006161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66015ca-e97b-4d2a-b3d2-0451771f76c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:12.046529 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f66015ca-e97b-4d2a-b3d2-0451771f76c1 None None] MFA Rules not processed for user `036cec8472fa46cfb59c75b1873fa218`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:12.048142 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f66015ca-e97b-4d2a-b3d2-0451771f76c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:12.282215 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 896/1775] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:12 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:12.469155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66015ca-e97b-4d2a-b3d2-0451771f76c1 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:12.470148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebe01b-23dc-46dc-9ac6-2c442b3f03e5 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:12.473553 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f66015ca-e97b-4d2a-b3d2-0451771f76c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:12.474529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9cebe01b-23dc-46dc-9ac6-2c442b3f03e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:12.626383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebe01b-23dc-46dc-9ac6-2c442b3f03e5 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:12.637926 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29b20c-3149-40ca-8442-b7db1e240ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:12.640968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29b20c-3149-40ca-8442-b7db1e240ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:12.642204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29b20c-3149-40ca-8442-b7db1e240ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:12.642607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29b20c-3149-40ca-8442-b7db1e240ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:12.643489 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66015ca-e97b-4d2a-b3d2-0451771f76c1 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:12.672173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29b20c-3149-40ca-8442-b7db1e240ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:12.686305 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8897d7-ed17-4900-bec0-e4c835ceacc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:12.687346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8897d7-ed17-4900-bec0-e4c835ceacc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:12.687636 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8897d7-ed17-4900-bec0-e4c835ceacc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:12.687969 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29b20c-3149-40ca-8442-b7db1e240ec1 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:12.712166 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8897d7-ed17-4900-bec0-e4c835ceacc3 admin admin] PATH_INFO: `/v3/users/f168a96ba20a4d3abc694fc6bd4a9d52` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:12.717635 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8897d7-ed17-4900-bec0-e4c835ceacc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f168a96ba20a4d3abc694fc6bd4a9d52)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:12.719736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8897d7-ed17-4900-bec0-e4c835ceacc3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:12.727225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 880/1776] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:12 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:12.831682 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:12.954120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af7cb9-489a-4079-8d2a-70b298242b14 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:12.954413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af7cb9-489a-4079-8d2a-70b298242b14 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:12.954757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af7cb9-489a-4079-8d2a-70b298242b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:13.021052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-78af7cb9-489a-4079-8d2a-70b298242b14 None None] MFA Rules not processed for user `bf41e7a4968e4ab9bce98f6e1c050b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:13.024162 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-78af7cb9-489a-4079-8d2a-70b298242b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:13.078204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ff8897d7-ed17-4900-bec0-e4c835ceacc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f168a96ba20a4d3abc694fc6bd4a9d52'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:13.102935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ff8897d7-ed17-4900-bec0-e4c835ceacc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f168a96ba20a4d3abc694fc6bd4a9d52'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:13.248333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ff8897d7-ed17-4900-bec0-e4c835ceacc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f168a96ba20a4d3abc694fc6bd4a9d52'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:13.248974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ff8897d7-ed17-4900-bec0-e4c835ceacc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f168a96ba20a4d3abc694fc6bd4a9d52'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:13.256555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 881/1777] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Jul 14 10:23:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:13.268102 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ff8897d7-ed17-4900-bec0-e4c835ceacc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f168a96ba20a4d3abc694fc6bd4a9d52'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:13.304440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 897/1778] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:12 2022] DELETE /identity/v3/users/f168a96ba20a4d3abc694fc6bd4a9d52 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:13.329698 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af7cb9-489a-4079-8d2a-70b298242b14 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:13.340723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af7cb9-489a-4079-8d2a-70b298242b14 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:13.425799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:13.449432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8897d7-ed17-4900-bec0-e4c835ceacc3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:13.451199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ff8897d7-ed17-4900-bec0-e4c835ceacc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:13.498445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81e2d9-1529-4451-8a7a-3a3bb4caaeeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:13.499132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81e2d9-1529-4451-8a7a-3a3bb4caaeeb service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:13.499418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81e2d9-1529-4451-8a7a-3a3bb4caaeeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:13.499692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81e2d9-1529-4451-8a7a-3a3bb4caaeeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:13.501898 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4b81e2d9-1529-4451-8a7a-3a3bb4caaeeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:13.631809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81e2d9-1529-4451-8a7a-3a3bb4caaeeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:13.633562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81e2d9-1529-4451-8a7a-3a3bb4caaeeb service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:13.654695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8897d7-ed17-4900-bec0-e4c835ceacc3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:13.659557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d0d9a-1859-4738-8bd4-3f95bfbfff67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:13.661750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d0d9a-1859-4738-8bd4-3f95bfbfff67 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:13.661750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d0d9a-1859-4738-8bd4-3f95bfbfff67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:13.661750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d0d9a-1859-4738-8bd4-3f95bfbfff67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:13.664556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a36d0d9a-1859-4738-8bd4-3f95bfbfff67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:13.683481 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d0d9a-1859-4738-8bd4-3f95bfbfff67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:13.683806 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 882/1779] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:13 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:13.686230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d0d9a-1859-4738-8bd4-3f95bfbfff67 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:13.715976 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 898/1780] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:23:14.139130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81e2d9-1529-4451-8a7a-3a3bb4caaeeb service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:14.140744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4b81e2d9-1529-4451-8a7a-3a3bb4caaeeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:14.284621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81e2d9-1529-4451-8a7a-3a3bb4caaeeb service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:14.291158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:14.293081 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:14.293450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:14.293843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] PATH_INFO: `/v3/projects/252fe0b83ba64e079209b8a2a02ba4a6` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:14.295311 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=252fe0b83ba64e079209b8a2a02ba4a6)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:14.297467 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:14.336461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:14.479519 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '252fe0b83ba64e079209b8a2a02ba4a6', 'request_id': 'req-300d7d9c-9498-4c21-9e50-30e4311cc75e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:14.580026 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '252fe0b83ba64e079209b8a2a02ba4a6', 'request_id': 'req-300d7d9c-9498-4c21-9e50-30e4311cc75e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:14.588943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '252fe0b83ba64e079209b8a2a02ba4a6', 'request_id': 'req-300d7d9c-9498-4c21-9e50-30e4311cc75e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:14.618623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] The token cache is being invalidate because project 252fe0b83ba64e079209b8a2a02ba4a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:14.619400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:14.626134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:14.628036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 883/1781] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:14 2022] DELETE /identity/v3/projects/252fe0b83ba64e079209b8a2a02ba4a6 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:14.631868 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d0d9a-1859-4738-8bd4-3f95bfbfff67 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:14.658520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d0d9a-1859-4738-8bd4-3f95bfbfff67 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:14.844116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061b2ef-55f0-4948-bd62-a954f19e2b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:14.849632 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061b2ef-55f0-4948-bd62-a954f19e2b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:14.850530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061b2ef-55f0-4948-bd62-a954f19e2b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:14.851114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061b2ef-55f0-4948-bd62-a954f19e2b98 admin admin] PATH_INFO: `/v3/users/ae1c6446852f47e187aa84ce9b28a3ef` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:14.855923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061b2ef-55f0-4948-bd62-a954f19e2b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1c6446852f47e187aa84ce9b28a3ef)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:14.861897 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061b2ef-55f0-4948-bd62-a954f19e2b98 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:15.141390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1061b2ef-55f0-4948-bd62-a954f19e2b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1c6446852f47e187aa84ce9b28a3ef'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:15.179891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1061b2ef-55f0-4948-bd62-a954f19e2b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1c6446852f47e187aa84ce9b28a3ef'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:15.293073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1061b2ef-55f0-4948-bd62-a954f19e2b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1c6446852f47e187aa84ce9b28a3ef'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:15.293073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1061b2ef-55f0-4948-bd62-a954f19e2b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1c6446852f47e187aa84ce9b28a3ef'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:15.308597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1061b2ef-55f0-4948-bd62-a954f19e2b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1c6446852f47e187aa84ce9b28a3ef'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:15.325587 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 899/1782] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:14 2022] DELETE /identity/v3/users/ae1c6446852f47e187aa84ce9b28a3ef => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:15.351104 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:15.896442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:16.036587 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:16.711399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:17.228720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:17.240873 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:17.283299 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d7d9c-9498-4c21-9e50-30e4311cc75e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:17.442371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da001e40-73f7-4f41-8657-99ef9f4e0d7c None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:17.443311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da001e40-73f7-4f41-8657-99ef9f4e0d7c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:17.443817 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da001e40-73f7-4f41-8657-99ef9f4e0d7c None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:17.446744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 900/1783] 10.222.0.74 () {54 vars in 921 bytes} [Thu Jul 14 10:23:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:23:17.482263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:17.499891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb185-670d-4944-bb6c-7edd137518b7 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:17.501381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb185-670d-4944-bb6c-7edd137518b7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:17.501701 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb185-670d-4944-bb6c-7edd137518b7 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:17.507671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9992f4-5757-4e8c-80a3-8eab62447155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:17.508747 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9992f4-5757-4e8c-80a3-8eab62447155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:17.509265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9992f4-5757-4e8c-80a3-8eab62447155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:17.509704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9992f4-5757-4e8c-80a3-8eab62447155 admin admin] PATH_INFO: `/v3/projects/01f3254235f1410aa0d29cbef8d71f5b` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:17.509826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 901/1784] 10.222.0.74 () {54 vars in 921 bytes} [Thu Jul 14 10:23:17 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:23:17.511895 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9992f4-5757-4e8c-80a3-8eab62447155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f3254235f1410aa0d29cbef8d71f5b)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:17.519704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9992f4-5757-4e8c-80a3-8eab62447155 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:17.524173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d2e74-c2cf-4374-9b8a-fdecc2def408 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:17.529431 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d2e74-c2cf-4374-9b8a-fdecc2def408 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:17.529431 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d2e74-c2cf-4374-9b8a-fdecc2def408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:17.542889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:17.582879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9d4d2e74-c2cf-4374-9b8a-fdecc2def408 None None] MFA Rules not processed for user `2a0626754b40449ba2346d05c5c90a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:17.591483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9d4d2e74-c2cf-4374-9b8a-fdecc2def408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:17.826788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6a9992f4-5757-4e8c-80a3-8eab62447155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f3254235f1410aa0d29cbef8d71f5b', 'request_id': 'req-6a9992f4-5757-4e8c-80a3-8eab62447155'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:17.831590 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 902/1785] 10.222.0.74 () {58 vars in 1018 bytes} [Thu Jul 14 10:23:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:17.887463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aad36-5398-46db-937d-00bd10ce7700 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:17.887463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aad36-5398-46db-937d-00bd10ce7700 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:17.887463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aad36-5398-46db-937d-00bd10ce7700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:17.956416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-295aad36-5398-46db-937d-00bd10ce7700 None None] MFA Rules not processed for user `2a0626754b40449ba2346d05c5c90a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:17.957677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-295aad36-5398-46db-937d-00bd10ce7700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:17.969142 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6a9992f4-5757-4e8c-80a3-8eab62447155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f3254235f1410aa0d29cbef8d71f5b', 'request_id': 'req-6a9992f4-5757-4e8c-80a3-8eab62447155'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:17.977742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6a9992f4-5757-4e8c-80a3-8eab62447155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f3254235f1410aa0d29cbef8d71f5b', 'request_id': 'req-6a9992f4-5757-4e8c-80a3-8eab62447155'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:18.016901 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6a9992f4-5757-4e8c-80a3-8eab62447155 admin admin] The token cache is being invalidate because project 01f3254235f1410aa0d29cbef8d71f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:18.017202 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6a9992f4-5757-4e8c-80a3-8eab62447155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:18.017889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6a9992f4-5757-4e8c-80a3-8eab62447155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:18.020522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 884/1786] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:17 2022] DELETE /identity/v3/projects/01f3254235f1410aa0d29cbef8d71f5b => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:18.025539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9785a4-eda1-4bda-a897-5b29e279c70c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:18.026037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9785a4-eda1-4bda-a897-5b29e279c70c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:18.026917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9785a4-eda1-4bda-a897-5b29e279c70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:18.068707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1f9785a4-eda1-4bda-a897-5b29e279c70c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:18.070585 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1f9785a4-eda1-4bda-a897-5b29e279c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:18.100862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:18.182674 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 903/1787] 10.222.0.74 () {58 vars in 1018 bytes} [Thu Jul 14 10:23:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:18.299355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667b988-45be-41a9-9d7e-0aab8fa0d970 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:18.300546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667b988-45be-41a9-9d7e-0aab8fa0d970 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:18.300934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667b988-45be-41a9-9d7e-0aab8fa0d970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:18.302966 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 885/1788] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:23:18.350650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e667b988-45be-41a9-9d7e-0aab8fa0d970 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:18.353425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e667b988-45be-41a9-9d7e-0aab8fa0d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:18.401317 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9785a4-eda1-4bda-a897-5b29e279c70c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:18.411928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 904/1789] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:18.418909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9785a4-eda1-4bda-a897-5b29e279c70c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:18.437119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f59c9b-2d4d-43b0-8d10-644e1ae99edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:18.437308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f59c9b-2d4d-43b0-8d10-644e1ae99edb admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:18.437587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f59c9b-2d4d-43b0-8d10-644e1ae99edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:18.437867 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f59c9b-2d4d-43b0-8d10-644e1ae99edb admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:18.445256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f59c9b-2d4d-43b0-8d10-644e1ae99edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:18.446657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f59c9b-2d4d-43b0-8d10-644e1ae99edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:18.455147 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f59c9b-2d4d-43b0-8d10-644e1ae99edb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:18.491512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667b988-45be-41a9-9d7e-0aab8fa0d970 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:18.493257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e667b988-45be-41a9-9d7e-0aab8fa0d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:18.518727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 886/1790] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:23:18.524962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f59c9b-2d4d-43b0-8d10-644e1ae99edb admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:18.540051 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f59c9b-2d4d-43b0-8d10-644e1ae99edb admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:18.546554 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be9d6b-c7c3-49df-b0ea-4dfcbbd814f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:18.548618 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be9d6b-c7c3-49df-b0ea-4dfcbbd814f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:18.549123 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be9d6b-c7c3-49df-b0ea-4dfcbbd814f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:18.549579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be9d6b-c7c3-49df-b0ea-4dfcbbd814f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:18.550760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be9d6b-c7c3-49df-b0ea-4dfcbbd814f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:18.554884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be9d6b-c7c3-49df-b0ea-4dfcbbd814f2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:18.567493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667b988-45be-41a9-9d7e-0aab8fa0d970 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:18.600137 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6242e-cee3-45ae-ae56-0821a7ca3434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:18.601021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6242e-cee3-45ae-ae56-0821a7ca3434 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:18.604306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6242e-cee3-45ae-ae56-0821a7ca3434 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:18.604930 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6242e-cee3-45ae-ae56-0821a7ca3434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:18.620364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c7a6242e-cee3-45ae-ae56-0821a7ca3434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:18.641725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6242e-cee3-45ae-ae56-0821a7ca3434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:18.643667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6242e-cee3-45ae-ae56-0821a7ca3434 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:18.661906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 905/1791] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:23:18.741116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 887/1792] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:18 2022] POST /identity/v3/projects => generated 367 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:18.742582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6242e-cee3-45ae-ae56-0821a7ca3434 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:18.762180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6242e-cee3-45ae-ae56-0821a7ca3434 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:18.880139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be9d6b-c7c3-49df-b0ea-4dfcbbd814f2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:18.882599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b2be9d6b-c7c3-49df-b0ea-4dfcbbd814f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:18.974033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a3996-96ae-4362-8280-dafd1239421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:18.975928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a3996-96ae-4362-8280-dafd1239421d admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:18.976380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a3996-96ae-4362-8280-dafd1239421d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:18.977482 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a3996-96ae-4362-8280-dafd1239421d admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:18.978739 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a3996-96ae-4362-8280-dafd1239421d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:18.984469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a3996-96ae-4362-8280-dafd1239421d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:19.113942 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 906/1793] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:18 2022] POST /identity/v3/users => generated 284 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:19.115087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a3996-96ae-4362-8280-dafd1239421d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:19.122511 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-632a3996-96ae-4362-8280-dafd1239421d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:19.126921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be9d6b-c7c3-49df-b0ea-4dfcbbd814f2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:19.139309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce98011-1adb-44c8-8e5e-f55b80fe357d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:19.140032 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98011-1adb-44c8-8e5e-f55b80fe357d service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:19.140322 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98011-1adb-44c8-8e5e-f55b80fe357d service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:19.141810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98011-1adb-44c8-8e5e-f55b80fe357d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:19.160671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce98011-1adb-44c8-8e5e-f55b80fe357d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:19.164157 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce98011-1adb-44c8-8e5e-f55b80fe357d service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:19.188610 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 888/1794] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:19.190112 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce98011-1adb-44c8-8e5e-f55b80fe357d service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:19.210217 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce98011-1adb-44c8-8e5e-f55b80fe357d service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:19.218040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fcad2-4557-4797-ba1d-764bd24521f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:19.218735 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fcad2-4557-4797-ba1d-764bd24521f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:19.219019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fcad2-4557-4797-ba1d-764bd24521f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:19.219296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fcad2-4557-4797-ba1d-764bd24521f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:19.220276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fcad2-4557-4797-ba1d-764bd24521f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:19.223279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fcad2-4557-4797-ba1d-764bd24521f7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:19.262942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 889/1795] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:19.266303 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fcad2-4557-4797-ba1d-764bd24521f7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:19.290511 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fcad2-4557-4797-ba1d-764bd24521f7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:19.308238 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a3996-96ae-4362-8280-dafd1239421d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:19.311378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e334103-e2e6-490e-936f-dfd05b1e1ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:19.314068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e334103-e2e6-490e-936f-dfd05b1e1ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:19.314361 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e334103-e2e6-490e-936f-dfd05b1e1ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:19.315196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e334103-e2e6-490e-936f-dfd05b1e1ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:19.319934 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e334103-e2e6-490e-936f-dfd05b1e1ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:19.321508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57be33d-f0c8-4b9b-8a15-3a372c90d12a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:19.323227 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57be33d-f0c8-4b9b-8a15-3a372c90d12a service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:19.323516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57be33d-f0c8-4b9b-8a15-3a372c90d12a service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:19.323792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57be33d-f0c8-4b9b-8a15-3a372c90d12a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:19.325117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e334103-e2e6-490e-936f-dfd05b1e1ea4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:19.350076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f57be33d-f0c8-4b9b-8a15-3a372c90d12a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:19.411434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 890/1796] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:19.414494 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e334103-e2e6-490e-936f-dfd05b1e1ea4 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:19.505480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e334103-e2e6-490e-936f-dfd05b1e1ea4 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:19.542013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad382a-a3ed-4eb3-9540-038c94aba948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:19.547634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad382a-a3ed-4eb3-9540-038c94aba948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:19.547923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad382a-a3ed-4eb3-9540-038c94aba948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:19.548249 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad382a-a3ed-4eb3-9540-038c94aba948 admin admin] PATH_INFO: `/v3/projects/194029650cca4037bbc62b6183a59701/users/4701b6ad779144d9808ba67aaf150131/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:19.622102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:19.672404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad382a-a3ed-4eb3-9540-038c94aba948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194029650cca4037bbc62b6183a59701, user_id=4701b6ad779144d9808ba67aaf150131, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:19.681892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad382a-a3ed-4eb3-9540-038c94aba948 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:19.749023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57be33d-f0c8-4b9b-8a15-3a372c90d12a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:19.753045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57be33d-f0c8-4b9b-8a15-3a372c90d12a service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:19.770301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 891/1797] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:19 2022] PUT /identity/v3/projects/194029650cca4037bbc62b6183a59701/users/4701b6ad779144d9808ba67aaf150131/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:19.781483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3498032-24aa-4fb8-ae8d-9ca5537ca0c8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:19.781678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3498032-24aa-4fb8-ae8d-9ca5537ca0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:19.782056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3498032-24aa-4fb8-ae8d-9ca5537ca0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:19.819667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 907/1798] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:19.881668 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d3498032-24aa-4fb8-ae8d-9ca5537ca0c8 None None] MFA Rules not processed for user `4701b6ad779144d9808ba67aaf150131`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:19.893324 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d3498032-24aa-4fb8-ae8d-9ca5537ca0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:19.956038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:20.133912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 892/1799] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:23:20.142351 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57be33d-f0c8-4b9b-8a15-3a372c90d12a service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:20.169098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57be33d-f0c8-4b9b-8a15-3a372c90d12a service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:20.322636 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c0235-66b9-491c-85fb-ca4f9ac3ae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:20.324438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c0235-66b9-491c-85fb-ca4f9ac3ae88 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:20.326043 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c0235-66b9-491c-85fb-ca4f9ac3ae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:20.326768 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c0235-66b9-491c-85fb-ca4f9ac3ae88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:20.328219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c0235-66b9-491c-85fb-ca4f9ac3ae88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:20.334455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c0235-66b9-491c-85fb-ca4f9ac3ae88 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:20.476435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 908/1800] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:20 2022] POST /identity/v3/projects => generated 369 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:20.476921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3498032-24aa-4fb8-ae8d-9ca5537ca0c8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:20.498563 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3498032-24aa-4fb8-ae8d-9ca5537ca0c8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:20.641559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f507f-b24b-41d2-ad01-4909cb43b312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:20.653060 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f507f-b24b-41d2-ad01-4909cb43b312 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:20.653552 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f507f-b24b-41d2-ad01-4909cb43b312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:20.653845 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f507f-b24b-41d2-ad01-4909cb43b312 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:20.655874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f507f-b24b-41d2-ad01-4909cb43b312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:20.661534 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f507f-b24b-41d2-ad01-4909cb43b312 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:20.787664 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 893/1801] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:20 2022] POST /identity/v3/users => generated 291 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:23:20.793214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c0235-66b9-491c-85fb-ca4f9ac3ae88 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:20.813854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c0235-66b9-491c-85fb-ca4f9ac3ae88 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:20.826451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050264b-4437-423e-a98d-e82ee8a6e4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:20.829897 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050264b-4437-423e-a98d-e82ee8a6e4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:20.832161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050264b-4437-423e-a98d-e82ee8a6e4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:20.832675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050264b-4437-423e-a98d-e82ee8a6e4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:20.836208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050264b-4437-423e-a98d-e82ee8a6e4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:20.840147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050264b-4437-423e-a98d-e82ee8a6e4f6 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:20.903458 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 909/1802] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:20.904361 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f507f-b24b-41d2-ad01-4909cb43b312 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:20.924273 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f507f-b24b-41d2-ad01-4909cb43b312 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:20.938096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22671a5-54a4-440d-a4de-22cd933f848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:20.941505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22671a5-54a4-440d-a4de-22cd933f848a admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:20.942035 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22671a5-54a4-440d-a4de-22cd933f848a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:20.946638 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22671a5-54a4-440d-a4de-22cd933f848a admin admin] PATH_INFO: `/v3/projects/ede524836bed4464b94946e051b5f5c0/users/86de285473d941038d5559f2477afde1/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:20.971923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22671a5-54a4-440d-a4de-22cd933f848a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede524836bed4464b94946e051b5f5c0, user_id=86de285473d941038d5559f2477afde1, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:20.971923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22671a5-54a4-440d-a4de-22cd933f848a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:20.978685 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:21.113332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 894/1803] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:20 2022] PUT /identity/v3/projects/ede524836bed4464b94946e051b5f5c0/users/86de285473d941038d5559f2477afde1/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:21.113647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050264b-4437-423e-a98d-e82ee8a6e4f6 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:21.143150 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050264b-4437-423e-a98d-e82ee8a6e4f6 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:21.254520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e726b6-6956-4847-a7bc-3c195e235231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:21.255714 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e726b6-6956-4847-a7bc-3c195e235231 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:21.256181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e726b6-6956-4847-a7bc-3c195e235231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:21.256604 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e726b6-6956-4847-a7bc-3c195e235231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:21.257486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e726b6-6956-4847-a7bc-3c195e235231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:21.259317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e726b6-6956-4847-a7bc-3c195e235231 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:21.274211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 910/1804] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:21.279119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22671a5-54a4-440d-a4de-22cd933f848a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:21.293198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22671a5-54a4-440d-a4de-22cd933f848a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:21.299004 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038e8f7-afed-42c3-9e89-70f02eb675c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:21.307885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038e8f7-afed-42c3-9e89-70f02eb675c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:21.307885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038e8f7-afed-42c3-9e89-70f02eb675c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:21.307885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038e8f7-afed-42c3-9e89-70f02eb675c1 admin admin] PATH_INFO: `/v3/projects/ede524836bed4464b94946e051b5f5c0/users/86de285473d941038d5559f2477afde1/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:21.307885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038e8f7-afed-42c3-9e89-70f02eb675c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede524836bed4464b94946e051b5f5c0, user_id=86de285473d941038d5559f2477afde1, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:21.307885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038e8f7-afed-42c3-9e89-70f02eb675c1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:21.352027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 895/1805] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:21 2022] PUT /identity/v3/projects/ede524836bed4464b94946e051b5f5c0/users/86de285473d941038d5559f2477afde1/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:21.362753 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb2c15-4254-40b2-9c6a-b4878e5e8661 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:21.362943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb2c15-4254-40b2-9c6a-b4878e5e8661 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:21.363755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb2c15-4254-40b2-9c6a-b4878e5e8661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:21.395288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c4cb2c15-4254-40b2-9c6a-b4878e5e8661 None None] MFA Rules not processed for user `86de285473d941038d5559f2477afde1`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:21.396598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c4cb2c15-4254-40b2-9c6a-b4878e5e8661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:21.551092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 911/1806] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:21 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:21.631656 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:21.671973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038e8f7-afed-42c3-9e89-70f02eb675c1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:21.846735 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038e8f7-afed-42c3-9e89-70f02eb675c1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:21.878043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114e76-9b99-47f8-aec2-18eb346a7392 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:21.878043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114e76-9b99-47f8-aec2-18eb346a7392 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:21.878043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114e76-9b99-47f8-aec2-18eb346a7392 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:21.878043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114e76-9b99-47f8-aec2-18eb346a7392 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:21.883265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35114e76-9b99-47f8-aec2-18eb346a7392 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:21.885061 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35114e76-9b99-47f8-aec2-18eb346a7392 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:21.899107 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 896/1807] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:22.935671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb2c15-4254-40b2-9c6a-b4878e5e8661 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:22.945462 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb2c15-4254-40b2-9c6a-b4878e5e8661 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:22.950361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51348a20-4a48-48d1-b26b-a194aee7613f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:22.951035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51348a20-4a48-48d1-b26b-a194aee7613f service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:22.951322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51348a20-4a48-48d1-b26b-a194aee7613f service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:22.951599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51348a20-4a48-48d1-b26b-a194aee7613f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:23.036220 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51348a20-4a48-48d1-b26b-a194aee7613f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:23.037928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51348a20-4a48-48d1-b26b-a194aee7613f service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:23.058727 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 912/1808] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:24.549838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:26.384951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114e76-9b99-47f8-aec2-18eb346a7392 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:26.387062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-35114e76-9b99-47f8-aec2-18eb346a7392 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:26.463723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114e76-9b99-47f8-aec2-18eb346a7392 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:26.473166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25f11e-dee3-4efc-a2ca-383a01905ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:26.474096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25f11e-dee3-4efc-a2ca-383a01905ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:26.474388 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25f11e-dee3-4efc-a2ca-383a01905ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:26.474669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25f11e-dee3-4efc-a2ca-383a01905ce5 admin admin] PATH_INFO: `/v3/users/017285358d7949458d18d85d00e7f9e3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:26.475891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25f11e-dee3-4efc-a2ca-383a01905ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=017285358d7949458d18d85d00e7f9e3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:26.478044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25f11e-dee3-4efc-a2ca-383a01905ce5 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:26.679552 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-bc25f11e-dee3-4efc-a2ca-383a01905ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '017285358d7949458d18d85d00e7f9e3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:26.694786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-bc25f11e-dee3-4efc-a2ca-383a01905ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '017285358d7949458d18d85d00e7f9e3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:26.695386 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-bc25f11e-dee3-4efc-a2ca-383a01905ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '017285358d7949458d18d85d00e7f9e3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:26.766627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-bc25f11e-dee3-4efc-a2ca-383a01905ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '017285358d7949458d18d85d00e7f9e3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:26.767297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-bc25f11e-dee3-4efc-a2ca-383a01905ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '017285358d7949458d18d85d00e7f9e3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:26.781964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 897/1809] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:26 2022] DELETE /identity/v3/users/017285358d7949458d18d85d00e7f9e3 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:26.786543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dce07b-0e6c-4a67-9e94-2ec9b8561ec0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:26.787046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dce07b-0e6c-4a67-9e94-2ec9b8561ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:26.787137 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dce07b-0e6c-4a67-9e94-2ec9b8561ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:26.804382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-78dce07b-0e6c-4a67-9e94-2ec9b8561ec0 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:26.805590 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-78dce07b-0e6c-4a67-9e94-2ec9b8561ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:26.868448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 913/1810] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:26.878334 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25f11e-dee3-4efc-a2ca-383a01905ce5 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:26.879917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bc25f11e-dee3-4efc-a2ca-383a01905ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:26.885867 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:26.938329 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25f11e-dee3-4efc-a2ca-383a01905ce5 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:26.942147 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2926a1-c02e-4b87-af34-2147ac8ad374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:26.942861 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2926a1-c02e-4b87-af34-2147ac8ad374 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:26.943171 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2926a1-c02e-4b87-af34-2147ac8ad374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:26.943449 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2926a1-c02e-4b87-af34-2147ac8ad374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:26.953271 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2926a1-c02e-4b87-af34-2147ac8ad374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:26.955071 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2926a1-c02e-4b87-af34-2147ac8ad374 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:26.966556 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 898/1811] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:27.725667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dce07b-0e6c-4a67-9e94-2ec9b8561ec0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:27.727237 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-78dce07b-0e6c-4a67-9e94-2ec9b8561ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:27.743187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dce07b-0e6c-4a67-9e94-2ec9b8561ec0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:27.753949 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:27.755106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:27.755400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:27.755683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] PATH_INFO: `/v3/projects/574d12b755c74174ae76eb996075d8c5` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:27.757060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=574d12b755c74174ae76eb996075d8c5)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:27.778305 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:27.934045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574d12b755c74174ae76eb996075d8c5', 'request_id': 'req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:28.081334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574d12b755c74174ae76eb996075d8c5', 'request_id': 'req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:28.087863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574d12b755c74174ae76eb996075d8c5', 'request_id': 'req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:28.100775 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] The token cache is being invalidate because project 574d12b755c74174ae76eb996075d8c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:28.101170 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:28.102018 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:28.106991 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 914/1812] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:27 2022] DELETE /identity/v3/projects/574d12b755c74174ae76eb996075d8c5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:28.108448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2926a1-c02e-4b87-af34-2147ac8ad374 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:28.119213 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2926a1-c02e-4b87-af34-2147ac8ad374 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:28.217970 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e157be-288e-40f1-8a04-b26a4a7c4e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:28.219174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e157be-288e-40f1-8a04-b26a4a7c4e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:28.219812 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e157be-288e-40f1-8a04-b26a4a7c4e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:28.220356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e157be-288e-40f1-8a04-b26a4a7c4e46 admin admin] PATH_INFO: `/v3/users/de40f91ecba643818ff6ef16f86fbf51` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:28.221902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e157be-288e-40f1-8a04-b26a4a7c4e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de40f91ecba643818ff6ef16f86fbf51)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:28.224586 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e157be-288e-40f1-8a04-b26a4a7c4e46 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:28.501453 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-61e157be-288e-40f1-8a04-b26a4a7c4e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de40f91ecba643818ff6ef16f86fbf51'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:28.524921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-61e157be-288e-40f1-8a04-b26a4a7c4e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de40f91ecba643818ff6ef16f86fbf51'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:28.524921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-61e157be-288e-40f1-8a04-b26a4a7c4e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de40f91ecba643818ff6ef16f86fbf51'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:28.612744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-61e157be-288e-40f1-8a04-b26a4a7c4e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de40f91ecba643818ff6ef16f86fbf51'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:28.613408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-61e157be-288e-40f1-8a04-b26a4a7c4e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de40f91ecba643818ff6ef16f86fbf51'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:28.639836 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 899/1813] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:28 2022] DELETE /identity/v3/users/de40f91ecba643818ff6ef16f86fbf51 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:29.379019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:29.379019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:29.409291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c0b34-bcdb-4b2b-bf15-a9c14c4c0dfa admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:29.457176 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:29.487204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:29.488164 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:29.488448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:29.488722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] PATH_INFO: `/v3/projects/f532df0e52074c858b12ff4eec9e0c13` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:29.489926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f532df0e52074c858b12ff4eec9e0c13)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:29.491909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:29.537115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e157be-288e-40f1-8a04-b26a4a7c4e46 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:29.538690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-61e157be-288e-40f1-8a04-b26a4a7c4e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:29.552764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e157be-288e-40f1-8a04-b26a4a7c4e46 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:29.560289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223502cc-ca2b-4fe5-9f9f-049782c6a49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:29.560289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223502cc-ca2b-4fe5-9f9f-049782c6a49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:29.560289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223502cc-ca2b-4fe5-9f9f-049782c6a49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:29.560289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223502cc-ca2b-4fe5-9f9f-049782c6a49e admin admin] PATH_INFO: `/v3/users/4701b6ad779144d9808ba67aaf150131` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:29.561362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223502cc-ca2b-4fe5-9f9f-049782c6a49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4701b6ad779144d9808ba67aaf150131)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:29.563346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223502cc-ca2b-4fe5-9f9f-049782c6a49e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:29.585243 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:29.612704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f532df0e52074c858b12ff4eec9e0c13', 'request_id': 'req-55239a83-02a4-444b-b549-96002a05895d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:29.704118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f532df0e52074c858b12ff4eec9e0c13', 'request_id': 'req-55239a83-02a4-444b-b549-96002a05895d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:29.710691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f532df0e52074c858b12ff4eec9e0c13', 'request_id': 'req-55239a83-02a4-444b-b549-96002a05895d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:29.722796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] The token cache is being invalidate because project f532df0e52074c858b12ff4eec9e0c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:29.723101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:29.723780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:29.725894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 915/1814] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:29 2022] DELETE /identity/v3/projects/f532df0e52074c858b12ff4eec9e0c13 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:29.731971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:29.733800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:29.741260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-223502cc-ca2b-4fe5-9f9f-049782c6a49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4701b6ad779144d9808ba67aaf150131'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:29.759439 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-223502cc-ca2b-4fe5-9f9f-049782c6a49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4701b6ad779144d9808ba67aaf150131'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:29.761070 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-223502cc-ca2b-4fe5-9f9f-049782c6a49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4701b6ad779144d9808ba67aaf150131'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:29.811401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55239a83-02a4-444b-b549-96002a05895d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:29.816626 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62635636-5338-457b-ab9b-96719930026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:29.817747 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62635636-5338-457b-ab9b-96719930026d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:29.818199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62635636-5338-457b-ab9b-96719930026d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:29.818608 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62635636-5338-457b-ab9b-96719930026d admin admin] PATH_INFO: `/v3/users/7c83e9c18768452b95215a9463b18a25` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:29.820723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62635636-5338-457b-ab9b-96719930026d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c83e9c18768452b95215a9463b18a25)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:29.823599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62635636-5338-457b-ab9b-96719930026d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:29.858184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-223502cc-ca2b-4fe5-9f9f-049782c6a49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4701b6ad779144d9808ba67aaf150131'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:29.859206 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-223502cc-ca2b-4fe5-9f9f-049782c6a49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4701b6ad779144d9808ba67aaf150131'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:29.874708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 900/1815] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:29 2022] DELETE /identity/v3/users/4701b6ad779144d9808ba67aaf150131 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:29.881887 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92516991-2f35-43e0-ae0f-f1c92cbfcf39 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:29.882277 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92516991-2f35-43e0-ae0f-f1c92cbfcf39 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:29.882669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92516991-2f35-43e0-ae0f-f1c92cbfcf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:29.904481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-92516991-2f35-43e0-ae0f-f1c92cbfcf39 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:29.907425 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-92516991-2f35-43e0-ae0f-f1c92cbfcf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:29.970911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 901/1816] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:29.982403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92516991-2f35-43e0-ae0f-f1c92cbfcf39 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:29.987214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-92516991-2f35-43e0-ae0f-f1c92cbfcf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:30.062070 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92516991-2f35-43e0-ae0f-f1c92cbfcf39 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:30.068040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48fe01-3df8-485b-a9fb-77c3258e4f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:30.068795 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48fe01-3df8-485b-a9fb-77c3258e4f62 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:30.069207 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48fe01-3df8-485b-a9fb-77c3258e4f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:30.069581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48fe01-3df8-485b-a9fb-77c3258e4f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:30.085396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48fe01-3df8-485b-a9fb-77c3258e4f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:30.085396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48fe01-3df8-485b-a9fb-77c3258e4f62 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:30.095559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 902/1817] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:23:30.205359 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-62635636-5338-457b-ab9b-96719930026d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c83e9c18768452b95215a9463b18a25'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:30.223457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-62635636-5338-457b-ab9b-96719930026d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c83e9c18768452b95215a9463b18a25'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:30.312217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-62635636-5338-457b-ab9b-96719930026d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c83e9c18768452b95215a9463b18a25'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:30.312887 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-62635636-5338-457b-ab9b-96719930026d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c83e9c18768452b95215a9463b18a25'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:30.328248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-62635636-5338-457b-ab9b-96719930026d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c83e9c18768452b95215a9463b18a25'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:30.356228 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 916/1818] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:29 2022] DELETE /identity/v3/users/7c83e9c18768452b95215a9463b18a25 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:30.387305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7446c90-cbf1-45b2-90f4-d120a0d79f2c None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:30.387305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7446c90-cbf1-45b2-90f4-d120a0d79f2c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:30.387305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7446c90-cbf1-45b2-90f4-d120a0d79f2c None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:30.387305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 903/1819] 10.222.0.74 () {54 vars in 921 bytes} [Thu Jul 14 10:23:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:23:30.406017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb20d3-6d3a-4b04-8ead-d683f459aa0d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:30.406471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb20d3-6d3a-4b04-8ead-d683f459aa0d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:30.406677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb20d3-6d3a-4b04-8ead-d683f459aa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:30.442672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-51fb20d3-6d3a-4b04-8ead-d683f459aa0d None None] MFA Rules not processed for user `2a0626754b40449ba2346d05c5c90a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:30.446667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-51fb20d3-6d3a-4b04-8ead-d683f459aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:30.588731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 917/1820] 10.222.0.74 () {58 vars in 1018 bytes} [Thu Jul 14 10:23:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:30.597870 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7446c90-cbf1-45b2-90f4-d120a0d79f2c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:30.599651 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d7446c90-cbf1-45b2-90f4-d120a0d79f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:30.628214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb20d3-6d3a-4b04-8ead-d683f459aa0d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:30.629805 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-51fb20d3-6d3a-4b04-8ead-d683f459aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:30.642431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7446c90-cbf1-45b2-90f4-d120a0d79f2c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:30.656139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44aa146-4bb3-45f5-a59d-caa24adfb397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:30.656809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aa146-4bb3-45f5-a59d-caa24adfb397 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:30.657328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aa146-4bb3-45f5-a59d-caa24adfb397 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:30.657789 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aa146-4bb3-45f5-a59d-caa24adfb397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:30.675158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44aa146-4bb3-45f5-a59d-caa24adfb397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:30.679099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44aa146-4bb3-45f5-a59d-caa24adfb397 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:30.707804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 904/1821] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:30.741699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb20d3-6d3a-4b04-8ead-d683f459aa0d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:30.749031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:30.750064 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:30.750426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:30.750802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] PATH_INFO: `/v3/projects/194029650cca4037bbc62b6183a59701` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:30.752370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] RBAC: Authorizing `identity:delete_project(project_id=194029650cca4037bbc62b6183a59701)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:30.754894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:30.954825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194029650cca4037bbc62b6183a59701', 'request_id': 'req-300c54c6-7b13-4c29-849c-050ddd32d87b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.015945 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44aa146-4bb3-45f5-a59d-caa24adfb397 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:31.018641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d44aa146-4bb3-45f5-a59d-caa24adfb397 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:31.046092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44aa146-4bb3-45f5-a59d-caa24adfb397 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:31.135688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194029650cca4037bbc62b6183a59701', 'request_id': 'req-300c54c6-7b13-4c29-849c-050ddd32d87b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.143430 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194029650cca4037bbc62b6183a59701', 'request_id': 'req-300c54c6-7b13-4c29-849c-050ddd32d87b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.168537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] The token cache is being invalidate because project 194029650cca4037bbc62b6183a59701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:31.168820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.169524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.172879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 918/1822] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:30 2022] DELETE /identity/v3/projects/194029650cca4037bbc62b6183a59701 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:31.179234 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:31.183250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:31.202012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e287e9c-9034-4b94-9a61-aaa408d2b97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:31.203585 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e287e9c-9034-4b94-9a61-aaa408d2b97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:31.207638 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e287e9c-9034-4b94-9a61-aaa408d2b97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:31.211871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e287e9c-9034-4b94-9a61-aaa408d2b97d admin admin] PATH_INFO: `/v3/projects/9f59602eafb74c94b0ec37b0acd9c069` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:31.211871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e287e9c-9034-4b94-9a61-aaa408d2b97d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f59602eafb74c94b0ec37b0acd9c069)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:31.219686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e287e9c-9034-4b94-9a61-aaa408d2b97d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:31.318319 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c54c6-7b13-4c29-849c-050ddd32d87b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:31.323951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338de170-fd39-498c-8749-75c5f21252ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:31.324874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338de170-fd39-498c-8749-75c5f21252ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:31.325159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338de170-fd39-498c-8749-75c5f21252ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:31.326607 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338de170-fd39-498c-8749-75c5f21252ef admin admin] PATH_INFO: `/v3/users/86de285473d941038d5559f2477afde1` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:31.326784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338de170-fd39-498c-8749-75c5f21252ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=86de285473d941038d5559f2477afde1)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:31.328759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338de170-fd39-498c-8749-75c5f21252ef admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:31.426093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e287e9c-9034-4b94-9a61-aaa408d2b97d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f59602eafb74c94b0ec37b0acd9c069', 'request_id': 'req-0e287e9c-9034-4b94-9a61-aaa408d2b97d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.509553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e287e9c-9034-4b94-9a61-aaa408d2b97d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f59602eafb74c94b0ec37b0acd9c069', 'request_id': 'req-0e287e9c-9034-4b94-9a61-aaa408d2b97d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.521191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e287e9c-9034-4b94-9a61-aaa408d2b97d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f59602eafb74c94b0ec37b0acd9c069', 'request_id': 'req-0e287e9c-9034-4b94-9a61-aaa408d2b97d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.531078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-338de170-fd39-498c-8749-75c5f21252ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86de285473d941038d5559f2477afde1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.537857 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e287e9c-9034-4b94-9a61-aaa408d2b97d admin admin] The token cache is being invalidate because project 9f59602eafb74c94b0ec37b0acd9c069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:31.538396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e287e9c-9034-4b94-9a61-aaa408d2b97d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.548799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e287e9c-9034-4b94-9a61-aaa408d2b97d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.553388 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 905/1823] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:31 2022] DELETE /identity/v3/projects/9f59602eafb74c94b0ec37b0acd9c069 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:31.555555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ed60-feed-4a38-a256-d5b4c67e1617 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:31.556700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ed60-feed-4a38-a256-d5b4c67e1617 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:31.557001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ed60-feed-4a38-a256-d5b4c67e1617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:31.563884 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-338de170-fd39-498c-8749-75c5f21252ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86de285473d941038d5559f2477afde1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.595653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-98b0ed60-feed-4a38-a256-d5b4c67e1617 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:31.596916 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-98b0ed60-feed-4a38-a256-d5b4c67e1617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:31.658893 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-338de170-fd39-498c-8749-75c5f21252ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86de285473d941038d5559f2477afde1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.659640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-338de170-fd39-498c-8749-75c5f21252ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86de285473d941038d5559f2477afde1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.669688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-338de170-fd39-498c-8749-75c5f21252ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86de285473d941038d5559f2477afde1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:31.679669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 906/1824] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:31.684880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 919/1825] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:31 2022] DELETE /identity/v3/users/86de285473d941038d5559f2477afde1 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:31.688837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285b791-6b01-42ab-a897-8d7edfa1c681 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:31.689307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285b791-6b01-42ab-a897-8d7edfa1c681 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:31.689764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285b791-6b01-42ab-a897-8d7edfa1c681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:31.714777 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0285b791-6b01-42ab-a897-8d7edfa1c681 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:31.716369 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0285b791-6b01-42ab-a897-8d7edfa1c681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:31.790024 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 907/1826] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:31.794620 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338de170-fd39-498c-8749-75c5f21252ef admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:31.805350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338de170-fd39-498c-8749-75c5f21252ef admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:31.811007 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509f52f-767a-4034-86c6-bae1cc678b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:31.811764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509f52f-767a-4034-86c6-bae1cc678b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:31.812087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509f52f-767a-4034-86c6-bae1cc678b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:31.817341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509f52f-767a-4034-86c6-bae1cc678b64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:31.817341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509f52f-767a-4034-86c6-bae1cc678b64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:31.817341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509f52f-767a-4034-86c6-bae1cc678b64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:31.817341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509f52f-767a-4034-86c6-bae1cc678b64 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:31.827764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 920/1827] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:23:31.831903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285b791-6b01-42ab-a897-8d7edfa1c681 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:31.842840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285b791-6b01-42ab-a897-8d7edfa1c681 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:31.847578 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd993773-9b99-4c87-949b-134f5dec6bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:31.848283 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd993773-9b99-4c87-949b-134f5dec6bad admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:31.848571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd993773-9b99-4c87-949b-134f5dec6bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:31.848848 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd993773-9b99-4c87-949b-134f5dec6bad admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:31.849582 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd993773-9b99-4c87-949b-134f5dec6bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:31.851486 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd993773-9b99-4c87-949b-134f5dec6bad admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:31.945732 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 908/1828] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:31 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:31.952484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509f52f-767a-4034-86c6-bae1cc678b64 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:31.976529 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509f52f-767a-4034-86c6-bae1cc678b64 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:32.055576 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c5cf7-060a-4f52-bb9a-ea35f07b815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:32.056617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c5cf7-060a-4f52-bb9a-ea35f07b815d admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:32.056906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c5cf7-060a-4f52-bb9a-ea35f07b815d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:32.057180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c5cf7-060a-4f52-bb9a-ea35f07b815d admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:32.057880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c5cf7-060a-4f52-bb9a-ea35f07b815d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:32.059815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c5cf7-060a-4f52-bb9a-ea35f07b815d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:32.156177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 921/1829] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:31 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:32.160314 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd993773-9b99-4c87-949b-134f5dec6bad admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:32.170993 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd993773-9b99-4c87-949b-134f5dec6bad admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:32.176892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b974f88-a45e-4911-b491-1bd2cf5c6ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:32.177683 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b974f88-a45e-4911-b491-1bd2cf5c6ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:32.178102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b974f88-a45e-4911-b491-1bd2cf5c6ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:32.178774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b974f88-a45e-4911-b491-1bd2cf5c6ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:32.180220 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c5cf7-060a-4f52-bb9a-ea35f07b815d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:32.180827 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b974f88-a45e-4911-b491-1bd2cf5c6ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:32.182319 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-dd9c5cf7-060a-4f52-bb9a-ea35f07b815d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:32.183856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b974f88-a45e-4911-b491-1bd2cf5c6ba7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:32.199695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 909/1830] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:32.200699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b974f88-a45e-4911-b491-1bd2cf5c6ba7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:32.208487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c5cf7-060a-4f52-bb9a-ea35f07b815d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:32.211161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b974f88-a45e-4911-b491-1bd2cf5c6ba7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:32.215354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda23246-5143-4c67-abbb-a7fb6d09db87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:32.216677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda23246-5143-4c67-abbb-a7fb6d09db87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:32.217013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70002eba-5f7b-4f68-8ef2-5ca93760d081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:32.217591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda23246-5143-4c67-abbb-a7fb6d09db87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:32.217909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda23246-5143-4c67-abbb-a7fb6d09db87 admin admin] PATH_INFO: `/v3/projects/ede524836bed4464b94946e051b5f5c0` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:32.218665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70002eba-5f7b-4f68-8ef2-5ca93760d081 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:32.218946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70002eba-5f7b-4f68-8ef2-5ca93760d081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:32.219402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70002eba-5f7b-4f68-8ef2-5ca93760d081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:32.219582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda23246-5143-4c67-abbb-a7fb6d09db87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede524836bed4464b94946e051b5f5c0)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:32.220383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70002eba-5f7b-4f68-8ef2-5ca93760d081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:32.222076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda23246-5143-4c67-abbb-a7fb6d09db87 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:32.223281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70002eba-5f7b-4f68-8ef2-5ca93760d081 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:32.238668 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 910/1831] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:32.241918 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70002eba-5f7b-4f68-8ef2-5ca93760d081 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:32.252826 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70002eba-5f7b-4f68-8ef2-5ca93760d081 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:32.258219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03003d8e-80f3-4d39-9cda-26c5c727fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:32.259129 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03003d8e-80f3-4d39-9cda-26c5c727fe8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:32.259468 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03003d8e-80f3-4d39-9cda-26c5c727fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:32.260379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03003d8e-80f3-4d39-9cda-26c5c727fe8e admin admin] PATH_INFO: `/v3/projects/c7575311e95a45ce939f80f56fe7da35/users/b3580ef7359e4f2e8220eccaa5576812/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:32.274928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03003d8e-80f3-4d39-9cda-26c5c727fe8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7575311e95a45ce939f80f56fe7da35, user_id=b3580ef7359e4f2e8220eccaa5576812, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:32.278275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03003d8e-80f3-4d39-9cda-26c5c727fe8e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:32.359029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-eda23246-5143-4c67-abbb-a7fb6d09db87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede524836bed4464b94946e051b5f5c0', 'request_id': 'req-eda23246-5143-4c67-abbb-a7fb6d09db87'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:32.359659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 911/1832] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:32 2022] PUT /identity/v3/projects/c7575311e95a45ce939f80f56fe7da35/users/b3580ef7359e4f2e8220eccaa5576812/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:32.375834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975d362-b0e6-408f-9b5c-3bb4d0c281d7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:32.376210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975d362-b0e6-408f-9b5c-3bb4d0c281d7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:32.376558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975d362-b0e6-408f-9b5c-3bb4d0c281d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:32.406564 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f975d362-b0e6-408f-9b5c-3bb4d0c281d7 None None] MFA Rules not processed for user `b3580ef7359e4f2e8220eccaa5576812`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:32.407867 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f975d362-b0e6-408f-9b5c-3bb4d0c281d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:32.441490 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-eda23246-5143-4c67-abbb-a7fb6d09db87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede524836bed4464b94946e051b5f5c0', 'request_id': 'req-eda23246-5143-4c67-abbb-a7fb6d09db87'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:32.455415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-eda23246-5143-4c67-abbb-a7fb6d09db87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede524836bed4464b94946e051b5f5c0', 'request_id': 'req-eda23246-5143-4c67-abbb-a7fb6d09db87'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:32.469808 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-eda23246-5143-4c67-abbb-a7fb6d09db87 admin admin] The token cache is being invalidate because project ede524836bed4464b94946e051b5f5c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:32.470309 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-eda23246-5143-4c67-abbb-a7fb6d09db87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:32.475380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-eda23246-5143-4c67-abbb-a7fb6d09db87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:32.477232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 922/1833] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:32 2022] DELETE /identity/v3/projects/ede524836bed4464b94946e051b5f5c0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:32.493135 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 912/1834] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:23:32.494991 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307c697-2321-43be-8635-6d10ccf22b01 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:32.495281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307c697-2321-43be-8635-6d10ccf22b01 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:32.495560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307c697-2321-43be-8635-6d10ccf22b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:32.498823 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975d362-b0e6-408f-9b5c-3bb4d0c281d7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:32.501587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f975d362-b0e6-408f-9b5c-3bb4d0c281d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:32.517683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4307c697-2321-43be-8635-6d10ccf22b01 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:32.518971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4307c697-2321-43be-8635-6d10ccf22b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:32.605382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975d362-b0e6-408f-9b5c-3bb4d0c281d7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:32.611692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6eae40-a5c0-4904-afcc-8a713a500dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:32.612818 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eae40-a5c0-4904-afcc-8a713a500dbe admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:32.613255 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eae40-a5c0-4904-afcc-8a713a500dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:32.615239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eae40-a5c0-4904-afcc-8a713a500dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:32.615239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6eae40-a5c0-4904-afcc-8a713a500dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:32.616698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 923/1835] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:32.617489 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6eae40-a5c0-4904-afcc-8a713a500dbe admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:32.626294 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdb8a6-ec78-4e85-8b69-edcb12d8891e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:32.627041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdb8a6-ec78-4e85-8b69-edcb12d8891e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:32.628061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdb8a6-ec78-4e85-8b69-edcb12d8891e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:32.651375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4bcdb8a6-ec78-4e85-8b69-edcb12d8891e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:32.652541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4bcdb8a6-ec78-4e85-8b69-edcb12d8891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:32.660743 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 924/1836] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:32.665302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdb8a6-ec78-4e85-8b69-edcb12d8891e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:32.676087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdb8a6-ec78-4e85-8b69-edcb12d8891e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:32.680802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e728250-27f1-4ec4-9608-7e85877a3b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:32.682026 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728250-27f1-4ec4-9608-7e85877a3b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:32.682306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728250-27f1-4ec4-9608-7e85877a3b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:32.682582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728250-27f1-4ec4-9608-7e85877a3b48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:32.683310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e728250-27f1-4ec4-9608-7e85877a3b48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:32.683615 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e728250-27f1-4ec4-9608-7e85877a3b48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:32.685263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e728250-27f1-4ec4-9608-7e85877a3b48 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:32.694088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:32.700161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 925/1837] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:23:32.704591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e728250-27f1-4ec4-9608-7e85877a3b48 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:32.716568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e728250-27f1-4ec4-9608-7e85877a3b48 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:32.721426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef18f4-bacc-4fbf-b6ab-73f60ac6f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:32.722181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef18f4-bacc-4fbf-b6ab-73f60ac6f650 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:32.722516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef18f4-bacc-4fbf-b6ab-73f60ac6f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:32.723014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef18f4-bacc-4fbf-b6ab-73f60ac6f650 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:32.723846 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef18f4-bacc-4fbf-b6ab-73f60ac6f650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:32.726033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef18f4-bacc-4fbf-b6ab-73f60ac6f650 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:32.770242 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 913/1838] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:32 2022] POST /identity/v3/projects => generated 379 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:32.771762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6eae40-a5c0-4904-afcc-8a713a500dbe admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:32.784330 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:32.861453 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 926/1839] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:32 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:32.864948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef18f4-bacc-4fbf-b6ab-73f60ac6f650 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:32.874383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6eae40-a5c0-4904-afcc-8a713a500dbe admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:32.936593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef18f4-bacc-4fbf-b6ab-73f60ac6f650 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:32.940229 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47362407-48bc-4342-80e0-178c3202fe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:32.941381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47362407-48bc-4342-80e0-178c3202fe95 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:32.941727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47362407-48bc-4342-80e0-178c3202fe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:32.942044 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450d6ef-4ef2-4b02-b166-bb7407cf3bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:32.942151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47362407-48bc-4342-80e0-178c3202fe95 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:32.942855 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450d6ef-4ef2-4b02-b166-bb7407cf3bde admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:32.943207 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450d6ef-4ef2-4b02-b166-bb7407cf3bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:32.943343 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47362407-48bc-4342-80e0-178c3202fe95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:32.943606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450d6ef-4ef2-4b02-b166-bb7407cf3bde admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:32.944395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450d6ef-4ef2-4b02-b166-bb7407cf3bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:32.945771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47362407-48bc-4342-80e0-178c3202fe95 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:32.946455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450d6ef-4ef2-4b02-b166-bb7407cf3bde admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:33.058517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 927/1840] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:32 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:23:33.062711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450d6ef-4ef2-4b02-b166-bb7407cf3bde admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:33.073183 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450d6ef-4ef2-4b02-b166-bb7407cf3bde admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:33.077856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6098b4-e942-4b22-93dd-69f3d05fd4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:33.078537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6098b4-e942-4b22-93dd-69f3d05fd4cc admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:33.078819 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6098b4-e942-4b22-93dd-69f3d05fd4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:33.079058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6098b4-e942-4b22-93dd-69f3d05fd4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:33.079782 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6098b4-e942-4b22-93dd-69f3d05fd4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:33.081540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6098b4-e942-4b22-93dd-69f3d05fd4cc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:33.088584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 914/1841] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:32 2022] POST /identity/v3/users => generated 296 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:33.092031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 928/1842] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:23:33.093128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47362407-48bc-4342-80e0-178c3202fe95 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:33.095372 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6098b4-e942-4b22-93dd-69f3d05fd4cc admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:33.103745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47362407-48bc-4342-80e0-178c3202fe95 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:33.105212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6098b4-e942-4b22-93dd-69f3d05fd4cc admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:33.108633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937f71b-17be-4861-8a20-0a09f656e689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:33.109304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937f71b-17be-4861-8a20-0a09f656e689 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:33.109654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937f71b-17be-4861-8a20-0a09f656e689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:33.109933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937f71b-17be-4861-8a20-0a09f656e689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:33.110037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cba02-cf4d-4b2c-a93d-f5334e5ec9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:33.110649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cba02-cf4d-4b2c-a93d-f5334e5ec9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:33.110744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937f71b-17be-4861-8a20-0a09f656e689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:33.110941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cba02-cf4d-4b2c-a93d-f5334e5ec9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:33.111218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cba02-cf4d-4b2c-a93d-f5334e5ec9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:33.111938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cba02-cf4d-4b2c-a93d-f5334e5ec9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:33.112405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937f71b-17be-4861-8a20-0a09f656e689 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:33.113541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cba02-cf4d-4b2c-a93d-f5334e5ec9a9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:33.126636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 915/1843] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:33.126820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 929/1844] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:33.128034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937f71b-17be-4861-8a20-0a09f656e689 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:33.128902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cba02-cf4d-4b2c-a93d-f5334e5ec9a9 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:33.139466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cba02-cf4d-4b2c-a93d-f5334e5ec9a9 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:33.146218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937f71b-17be-4861-8a20-0a09f656e689 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:33.146218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ce944-9f6f-4568-8996-eea88b88beac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:33.146430 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfced14-e42a-45fc-8f8a-564f47ec1758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:33.146531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ce944-9f6f-4568-8996-eea88b88beac admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:33.146631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfced14-e42a-45fc-8f8a-564f47ec1758 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:33.146738 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ce944-9f6f-4568-8996-eea88b88beac admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:33.146738 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ce944-9f6f-4568-8996-eea88b88beac admin admin] PATH_INFO: `/v3/projects/d38b6712a08e47a78b322b8f80fa8736/users/1fab5241d453410f9958b2181c67129e/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:33.146910 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfced14-e42a-45fc-8f8a-564f47ec1758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:33.146910 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfced14-e42a-45fc-8f8a-564f47ec1758 admin admin] PATH_INFO: `/v3/projects/bab087b80acc47ef93bfc6220f9f9557/users/b3b45464f34d48579527d9b66f20935c/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:33.161426 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfced14-e42a-45fc-8f8a-564f47ec1758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab087b80acc47ef93bfc6220f9f9557, user_id=b3b45464f34d48579527d9b66f20935c, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:33.161840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ce944-9f6f-4568-8996-eea88b88beac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38b6712a08e47a78b322b8f80fa8736, user_id=1fab5241d453410f9958b2181c67129e, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:33.164255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfced14-e42a-45fc-8f8a-564f47ec1758 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:33.169152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ce944-9f6f-4568-8996-eea88b88beac admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:33.281851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 930/1845] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:33 2022] PUT /identity/v3/projects/bab087b80acc47ef93bfc6220f9f9557/users/b3b45464f34d48579527d9b66f20935c/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:33.282468 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 916/1846] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:33 2022] PUT /identity/v3/projects/d38b6712a08e47a78b322b8f80fa8736/users/1fab5241d453410f9958b2181c67129e/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:33.286210 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfced14-e42a-45fc-8f8a-564f47ec1758 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:33.292422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535081d-6704-4b6a-9c36-128293427b5c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:33.292717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535081d-6704-4b6a-9c36-128293427b5c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:33.292998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535081d-6704-4b6a-9c36-128293427b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:33.319032 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2535081d-6704-4b6a-9c36-128293427b5c None None] MFA Rules not processed for user `b3b45464f34d48579527d9b66f20935c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:33.320292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2535081d-6704-4b6a-9c36-128293427b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:33.347946 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfced14-e42a-45fc-8f8a-564f47ec1758 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:33.392337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 917/1847] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:23:33.402193 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535081d-6704-4b6a-9c36-128293427b5c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:33.413815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2111ee-e305-4ea6-b120-c8eb72eba672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:33.414538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2111ee-e305-4ea6-b120-c8eb72eba672 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:33.414825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2111ee-e305-4ea6-b120-c8eb72eba672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:33.415104 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2111ee-e305-4ea6-b120-c8eb72eba672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:33.416050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2111ee-e305-4ea6-b120-c8eb72eba672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:33.418019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2111ee-e305-4ea6-b120-c8eb72eba672 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:33.429752 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 931/1848] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:23:33.433716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2111ee-e305-4ea6-b120-c8eb72eba672 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:33.445678 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2111ee-e305-4ea6-b120-c8eb72eba672 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:33.451989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bfaf6-3217-446b-bbf5-60678f990f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:33.452947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bfaf6-3217-446b-bbf5-60678f990f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:33.453230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bfaf6-3217-446b-bbf5-60678f990f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:33.453506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bfaf6-3217-446b-bbf5-60678f990f9e admin admin] PATH_INFO: `/v3/projects/d38b6712a08e47a78b322b8f80fa8736/users/1fab5241d453410f9958b2181c67129e/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:33.455726 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bfaf6-3217-446b-bbf5-60678f990f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38b6712a08e47a78b322b8f80fa8736, user_id=1fab5241d453410f9958b2181c67129e, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:33.458425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bfaf6-3217-446b-bbf5-60678f990f9e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:33.470518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 932/1849] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:33 2022] PUT /identity/v3/projects/d38b6712a08e47a78b322b8f80fa8736/users/1fab5241d453410f9958b2181c67129e/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:33.481700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8866-3a66-490a-b035-9f3329245cb0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:33.481998 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8866-3a66-490a-b035-9f3329245cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:33.482420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8866-3a66-490a-b035-9f3329245cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:33.491267 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535081d-6704-4b6a-9c36-128293427b5c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:33.524865 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-cf4e8866-3a66-490a-b035-9f3329245cb0 None None] MFA Rules not processed for user `1fab5241d453410f9958b2181c67129e`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:33.526101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cf4e8866-3a66-490a-b035-9f3329245cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:33.563297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79e21e-f2cd-4e24-adbc-9dd6e71afe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:33.564288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e21e-f2cd-4e24-adbc-9dd6e71afe6a admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:33.564574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e21e-f2cd-4e24-adbc-9dd6e71afe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:33.564850 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e21e-f2cd-4e24-adbc-9dd6e71afe6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:33.565743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79e21e-f2cd-4e24-adbc-9dd6e71afe6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:33.567695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79e21e-f2cd-4e24-adbc-9dd6e71afe6a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:33.597744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 933/1850] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:33.609268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8866-3a66-490a-b035-9f3329245cb0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:33.610658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cf4e8866-3a66-490a-b035-9f3329245cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:33.645550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 918/1851] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:33 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:23:33.646395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79e21e-f2cd-4e24-adbc-9dd6e71afe6a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:33.678218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8866-3a66-490a-b035-9f3329245cb0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:33.719332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79e21e-f2cd-4e24-adbc-9dd6e71afe6a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:33.725288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7706f-e742-440b-be9f-ee556e4e542f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:33.725971 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7706f-e742-440b-be9f-ee556e4e542f admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:33.730196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7706f-e742-440b-be9f-ee556e4e542f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:33.730196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7706f-e742-440b-be9f-ee556e4e542f admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:33.730196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7706f-e742-440b-be9f-ee556e4e542f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:33.730196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7706f-e742-440b-be9f-ee556e4e542f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:33.740302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04c4d7-699d-475e-aba8-926c7139445a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:33.741123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04c4d7-699d-475e-aba8-926c7139445a service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:33.741626 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04c4d7-699d-475e-aba8-926c7139445a service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:33.742225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04c4d7-699d-475e-aba8-926c7139445a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:33.836634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04c4d7-699d-475e-aba8-926c7139445a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:33.837932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 919/1852] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:33 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:33.840664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04c4d7-699d-475e-aba8-926c7139445a service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:33.841066 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7706f-e742-440b-be9f-ee556e4e542f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:33.873782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7706f-e742-440b-be9f-ee556e4e542f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:33.877380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 934/1853] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:23:33.887356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65620ab8-a9c4-453d-ba5f-7a69dd4acb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:33.889240 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65620ab8-a9c4-453d-ba5f-7a69dd4acb59 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:33.889671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65620ab8-a9c4-453d-ba5f-7a69dd4acb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:33.890196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65620ab8-a9c4-453d-ba5f-7a69dd4acb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:33.893952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65620ab8-a9c4-453d-ba5f-7a69dd4acb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:33.899439 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65620ab8-a9c4-453d-ba5f-7a69dd4acb59 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:33.941312 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 920/1854] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:33.945379 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04c4d7-699d-475e-aba8-926c7139445a service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:33.962715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04c4d7-699d-475e-aba8-926c7139445a service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:33.984408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9ffa9-445f-4835-8874-374b40e4db89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:33.984408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9ffa9-445f-4835-8874-374b40e4db89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:33.984408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9ffa9-445f-4835-8874-374b40e4db89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:33.984408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9ffa9-445f-4835-8874-374b40e4db89 admin admin] PATH_INFO: `/v3/projects/cbb31a19370446d498d1599983d5cadb/users/9f4e3b4445aa4852824509e4b7a85e21/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:34.008457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9ffa9-445f-4835-8874-374b40e4db89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb31a19370446d498d1599983d5cadb, user_id=9f4e3b4445aa4852824509e4b7a85e21, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:34.012363 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9ffa9-445f-4835-8874-374b40e4db89 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:34.136580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 935/1855] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:33 2022] PUT /identity/v3/projects/cbb31a19370446d498d1599983d5cadb/users/9f4e3b4445aa4852824509e4b7a85e21/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:34.137703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65620ab8-a9c4-453d-ba5f-7a69dd4acb59 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:34.150724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65620ab8-a9c4-453d-ba5f-7a69dd4acb59 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:34.175308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9ffa9-445f-4835-8874-374b40e4db89 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:34.177349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-78a9ffa9-445f-4835-8874-374b40e4db89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:34.294032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9ffa9-445f-4835-8874-374b40e4db89 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:34.295289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83797a31-5258-4d1c-966b-ff77ea10cf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:34.295974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83797a31-5258-4d1c-966b-ff77ea10cf48 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:34.297365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83797a31-5258-4d1c-966b-ff77ea10cf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:34.297365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83797a31-5258-4d1c-966b-ff77ea10cf48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:34.297365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83797a31-5258-4d1c-966b-ff77ea10cf48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:34.298843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83797a31-5258-4d1c-966b-ff77ea10cf48 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:34.303943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb5437-ebbd-4b3c-9a6b-0caf343ad5a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:34.304783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb5437-ebbd-4b3c-9a6b-0caf343ad5a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:34.304980 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb5437-ebbd-4b3c-9a6b-0caf343ad5a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:34.305290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb5437-ebbd-4b3c-9a6b-0caf343ad5a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:34.313617 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 921/1856] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:23:34.316685 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83797a31-5258-4d1c-966b-ff77ea10cf48 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:34.329817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83797a31-5258-4d1c-966b-ff77ea10cf48 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:34.335814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23727ffe-13c1-408b-8f40-6040a30a6773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:34.336895 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23727ffe-13c1-408b-8f40-6040a30a6773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:34.337206 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23727ffe-13c1-408b-8f40-6040a30a6773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:34.338026 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23727ffe-13c1-408b-8f40-6040a30a6773 admin admin] PATH_INFO: `/v3/projects/cbb31a19370446d498d1599983d5cadb/users/9f4e3b4445aa4852824509e4b7a85e21/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:34.341396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23727ffe-13c1-408b-8f40-6040a30a6773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb31a19370446d498d1599983d5cadb, user_id=9f4e3b4445aa4852824509e4b7a85e21, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:34.344642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23727ffe-13c1-408b-8f40-6040a30a6773 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:34.358013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 922/1857] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:34 2022] PUT /identity/v3/projects/cbb31a19370446d498d1599983d5cadb/users/9f4e3b4445aa4852824509e4b7a85e21/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:34.369912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec200-ecdb-4224-ae52-21c768f99a12 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:34.370175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec200-ecdb-4224-ae52-21c768f99a12 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:34.370527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec200-ecdb-4224-ae52-21c768f99a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:34.396115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb5437-ebbd-4b3c-9a6b-0caf343ad5a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:34.397769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb5437-ebbd-4b3c-9a6b-0caf343ad5a8 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:34.412018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ad0ec200-ecdb-4224-ae52-21c768f99a12 None None] MFA Rules not processed for user `9f4e3b4445aa4852824509e4b7a85e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:34.413445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ad0ec200-ecdb-4224-ae52-21c768f99a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:34.434651 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 936/1858] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:34.532843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 923/1859] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:23:34.655009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb5437-ebbd-4b3c-9a6b-0caf343ad5a8 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:34.673044 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb5437-ebbd-4b3c-9a6b-0caf343ad5a8 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:34.735154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0070af-24ef-4670-b6d6-a916c70b1c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:34.735906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0070af-24ef-4670-b6d6-a916c70b1c1c service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:34.736030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0070af-24ef-4670-b6d6-a916c70b1c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:34.736314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0070af-24ef-4670-b6d6-a916c70b1c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:34.748700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:34.751778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0070af-24ef-4670-b6d6-a916c70b1c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:34.753374 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0070af-24ef-4670-b6d6-a916c70b1c1c service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:34.766007 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 937/1860] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:34.794938 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ec200-ecdb-4224-ae52-21c768f99a12 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:34.812385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:34.875943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ec200-ecdb-4224-ae52-21c768f99a12 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:34.880921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c604f-15ca-43a9-8b46-1e9df9500ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:34.881806 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c604f-15ca-43a9-8b46-1e9df9500ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:34.882098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c604f-15ca-43a9-8b46-1e9df9500ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:34.882378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c604f-15ca-43a9-8b46-1e9df9500ddd admin admin] PATH_INFO: `/v3/users/b3b45464f34d48579527d9b66f20935c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:34.883657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c604f-15ca-43a9-8b46-1e9df9500ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b45464f34d48579527d9b66f20935c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:34.885666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c604f-15ca-43a9-8b46-1e9df9500ddd admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:34.991395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0070af-24ef-4670-b6d6-a916c70b1c1c service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:34.994863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9c0070af-24ef-4670-b6d6-a916c70b1c1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:35.018090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0070af-24ef-4670-b6d6-a916c70b1c1c service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:35.025280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082d966-4211-454d-ab4e-19f91a25eab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:35.026120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082d966-4211-454d-ab4e-19f91a25eab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:35.026620 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082d966-4211-454d-ab4e-19f91a25eab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:35.027064 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082d966-4211-454d-ab4e-19f91a25eab3 admin admin] PATH_INFO: `/v3/users/9784f292f7724b7e97e84c4f75b6a767` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:35.028868 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082d966-4211-454d-ab4e-19f91a25eab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9784f292f7724b7e97e84c4f75b6a767)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:35.031216 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082d966-4211-454d-ab4e-19f91a25eab3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:35.087782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ff4c604f-15ca-43a9-8b46-1e9df9500ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b45464f34d48579527d9b66f20935c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:35.107598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ff4c604f-15ca-43a9-8b46-1e9df9500ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b45464f34d48579527d9b66f20935c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:35.108354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ff4c604f-15ca-43a9-8b46-1e9df9500ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b45464f34d48579527d9b66f20935c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:35.198872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ff4c604f-15ca-43a9-8b46-1e9df9500ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b45464f34d48579527d9b66f20935c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:35.200656 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ff4c604f-15ca-43a9-8b46-1e9df9500ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b45464f34d48579527d9b66f20935c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:35.251804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 924/1861] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:34 2022] DELETE /identity/v3/users/b3b45464f34d48579527d9b66f20935c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:35.255078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8082d966-4211-454d-ab4e-19f91a25eab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9784f292f7724b7e97e84c4f75b6a767'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:35.257715 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d9e9-f599-4743-a638-1880f62ad7f2 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:35.258957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d9e9-f599-4743-a638-1880f62ad7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:35.259744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d9e9-f599-4743-a638-1880f62ad7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:35.282588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8082d966-4211-454d-ab4e-19f91a25eab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9784f292f7724b7e97e84c4f75b6a767'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:35.307693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0a31d9e9-f599-4743-a638-1880f62ad7f2 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:35.313524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0a31d9e9-f599-4743-a638-1880f62ad7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:35.367344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8082d966-4211-454d-ab4e-19f91a25eab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9784f292f7724b7e97e84c4f75b6a767'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:35.370901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8082d966-4211-454d-ab4e-19f91a25eab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9784f292f7724b7e97e84c4f75b6a767'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:35.379673 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8082d966-4211-454d-ab4e-19f91a25eab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9784f292f7724b7e97e84c4f75b6a767'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:35.410877 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 938/1862] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:34 2022] DELETE /identity/v3/users/9784f292f7724b7e97e84c4f75b6a767 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:35.418459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0f94e-d583-4829-839a-967e3ad0d19a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:35.418754 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0f94e-d583-4829-839a-967e3ad0d19a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:35.419033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0f94e-d583-4829-839a-967e3ad0d19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:35.441079 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b0e0f94e-d583-4829-839a-967e3ad0d19a None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:35.442376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b0e0f94e-d583-4829-839a-967e3ad0d19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:35.452964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 925/1863] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:35.461280 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d9e9-f599-4743-a638-1880f62ad7f2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:35.463735 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0a31d9e9-f599-4743-a638-1880f62ad7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:35.573676 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 939/1864] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:23:35.579063 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d9e9-f599-4743-a638-1880f62ad7f2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:35.584346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0f94e-d583-4829-839a-967e3ad0d19a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:35.644411 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de105b-9a2b-49d0-8069-5a847ce7af94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:35.646113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de105b-9a2b-49d0-8069-5a847ce7af94 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:35.646471 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de105b-9a2b-49d0-8069-5a847ce7af94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:35.647103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de105b-9a2b-49d0-8069-5a847ce7af94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:35.657853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0f94e-d583-4829-839a-967e3ad0d19a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:35.659603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de105b-9a2b-49d0-8069-5a847ce7af94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:35.661160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de105b-9a2b-49d0-8069-5a847ce7af94 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:35.668186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07a7b5-17ab-40bb-b2cd-07bb3eaa3ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:35.669498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07a7b5-17ab-40bb-b2cd-07bb3eaa3ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:35.669792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07a7b5-17ab-40bb-b2cd-07bb3eaa3ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:35.670072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07a7b5-17ab-40bb-b2cd-07bb3eaa3ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:35.672824 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 926/1865] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:35.685194 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07a7b5-17ab-40bb-b2cd-07bb3eaa3ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:35.687084 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07a7b5-17ab-40bb-b2cd-07bb3eaa3ab8 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:35.698616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 940/1866] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:36.416195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de105b-9a2b-49d0-8069-5a847ce7af94 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:36.416195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d4de105b-9a2b-49d0-8069-5a847ce7af94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:36.416903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07a7b5-17ab-40bb-b2cd-07bb3eaa3ab8 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:36.416903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8b07a7b5-17ab-40bb-b2cd-07bb3eaa3ab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:36.436612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de105b-9a2b-49d0-8069-5a847ce7af94 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:36.438756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:36.439644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:36.439930 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:36.440240 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] PATH_INFO: `/v3/projects/e16fee8a36414573a2f2cbaba2df5631` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:36.441579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e16fee8a36414573a2f2cbaba2df5631)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:36.443829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:36.463742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07a7b5-17ab-40bb-b2cd-07bb3eaa3ab8 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:36.469631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:36.470709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:36.470999 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:36.471338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] PATH_INFO: `/v3/projects/bab087b80acc47ef93bfc6220f9f9557` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:36.483249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab087b80acc47ef93bfc6220f9f9557)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:36.490263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:36.605750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16fee8a36414573a2f2cbaba2df5631', 'request_id': 'req-1c22e6fd-fc01-4b1f-8956-62a87d98c867'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:36.652361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab087b80acc47ef93bfc6220f9f9557', 'request_id': 'req-0f5a276a-590f-482f-b6df-16ce5ab178b1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:36.703470 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16fee8a36414573a2f2cbaba2df5631', 'request_id': 'req-1c22e6fd-fc01-4b1f-8956-62a87d98c867'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:36.710710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16fee8a36414573a2f2cbaba2df5631', 'request_id': 'req-1c22e6fd-fc01-4b1f-8956-62a87d98c867'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:36.723465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] The token cache is being invalidate because project e16fee8a36414573a2f2cbaba2df5631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:36.723867 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:36.726591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:36.731611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:36.735357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 927/1867] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:36 2022] DELETE /identity/v3/projects/e16fee8a36414573a2f2cbaba2df5631 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:36.739491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:36.741032 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:36.801189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab087b80acc47ef93bfc6220f9f9557', 'request_id': 'req-0f5a276a-590f-482f-b6df-16ce5ab178b1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:36.802203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:36.810587 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab087b80acc47ef93bfc6220f9f9557', 'request_id': 'req-0f5a276a-590f-482f-b6df-16ce5ab178b1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:36.826915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] The token cache is being invalidate because project bab087b80acc47ef93bfc6220f9f9557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:36.827548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:36.828510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:36.830652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 941/1868] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:36 2022] DELETE /identity/v3/projects/bab087b80acc47ef93bfc6220f9f9557 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:36.833629 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22e6fd-fc01-4b1f-8956-62a87d98c867 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:36.835009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:36.836371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:36.899884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314f60-a6fb-4fd7-8b84-82ec05a98c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:36.901268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314f60-a6fb-4fd7-8b84-82ec05a98c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:36.901728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314f60-a6fb-4fd7-8b84-82ec05a98c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:36.902177 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314f60-a6fb-4fd7-8b84-82ec05a98c4b admin admin] PATH_INFO: `/v3/users/54eceb89ffd649088ca775317968eeb8` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:36.903961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1314f60-a6fb-4fd7-8b84-82ec05a98c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=54eceb89ffd649088ca775317968eeb8)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:36.907015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1314f60-a6fb-4fd7-8b84-82ec05a98c4b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:36.907722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a276a-590f-482f-b6df-16ce5ab178b1 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:36.913782 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e398995-e44b-4544-82fb-e9e9171af252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:36.914856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e398995-e44b-4544-82fb-e9e9171af252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:36.915171 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e398995-e44b-4544-82fb-e9e9171af252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:36.915445 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e398995-e44b-4544-82fb-e9e9171af252 admin admin] PATH_INFO: `/v3/users/9f4e3b4445aa4852824509e4b7a85e21` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:36.917609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e398995-e44b-4544-82fb-e9e9171af252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4e3b4445aa4852824509e4b7a85e21)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:36.920218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e398995-e44b-4544-82fb-e9e9171af252 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:37.154403 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1e398995-e44b-4544-82fb-e9e9171af252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4e3b4445aa4852824509e4b7a85e21'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:37.155272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b1314f60-a6fb-4fd7-8b84-82ec05a98c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54eceb89ffd649088ca775317968eeb8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:37.168300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1e398995-e44b-4544-82fb-e9e9171af252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4e3b4445aa4852824509e4b7a85e21'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:37.169434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b1314f60-a6fb-4fd7-8b84-82ec05a98c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54eceb89ffd649088ca775317968eeb8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:37.170589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b1314f60-a6fb-4fd7-8b84-82ec05a98c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54eceb89ffd649088ca775317968eeb8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:37.279793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1e398995-e44b-4544-82fb-e9e9171af252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4e3b4445aa4852824509e4b7a85e21'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:37.280554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1e398995-e44b-4544-82fb-e9e9171af252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4e3b4445aa4852824509e4b7a85e21'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:37.287915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1e398995-e44b-4544-82fb-e9e9171af252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4e3b4445aa4852824509e4b7a85e21'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:37.294918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 942/1869] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:36 2022] DELETE /identity/v3/users/9f4e3b4445aa4852824509e4b7a85e21 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:37.365721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b1314f60-a6fb-4fd7-8b84-82ec05a98c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54eceb89ffd649088ca775317968eeb8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:37.366623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b1314f60-a6fb-4fd7-8b84-82ec05a98c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54eceb89ffd649088ca775317968eeb8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:37.385521 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 928/1870] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:36 2022] DELETE /identity/v3/users/54eceb89ffd649088ca775317968eeb8 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:37.760549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:37.816616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e398995-e44b-4544-82fb-e9e9171af252 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:37.818934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1e398995-e44b-4544-82fb-e9e9171af252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:37.871565 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314f60-a6fb-4fd7-8b84-82ec05a98c4b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:37.873315 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b1314f60-a6fb-4fd7-8b84-82ec05a98c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:37.897262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e398995-e44b-4544-82fb-e9e9171af252 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:37.953752 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314f60-a6fb-4fd7-8b84-82ec05a98c4b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:37.958572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:37.959560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:37.960127 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:37.960518 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] PATH_INFO: `/v3/projects/cbb31a19370446d498d1599983d5cadb` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:37.961788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb31a19370446d498d1599983d5cadb)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:37.963832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:37.965898 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80781e5-541f-4fb4-abcd-a543c33abae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:37.967119 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80781e5-541f-4fb4-abcd-a543c33abae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:37.967473 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80781e5-541f-4fb4-abcd-a543c33abae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:37.967828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80781e5-541f-4fb4-abcd-a543c33abae2 admin admin] PATH_INFO: `/v3/users/b3580ef7359e4f2e8220eccaa5576812` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:37.971192 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80781e5-541f-4fb4-abcd-a543c33abae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3580ef7359e4f2e8220eccaa5576812)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:37.973943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80781e5-541f-4fb4-abcd-a543c33abae2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:38.209590 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c80781e5-541f-4fb4-abcd-a543c33abae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3580ef7359e4f2e8220eccaa5576812'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.209817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb31a19370446d498d1599983d5cadb', 'request_id': 'req-b4bf3bcc-1f8e-46a7-851e-73403f107369'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.223326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c80781e5-541f-4fb4-abcd-a543c33abae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3580ef7359e4f2e8220eccaa5576812'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.291922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb31a19370446d498d1599983d5cadb', 'request_id': 'req-b4bf3bcc-1f8e-46a7-851e-73403f107369'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.292150 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:38.302250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb31a19370446d498d1599983d5cadb', 'request_id': 'req-b4bf3bcc-1f8e-46a7-851e-73403f107369'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.316348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] The token cache is being invalidate because project cbb31a19370446d498d1599983d5cadb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:38.316639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.317334 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.321960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 929/1871] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:37 2022] DELETE /identity/v3/projects/cbb31a19370446d498d1599983d5cadb => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:38.321960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:38.325266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:38.371771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c80781e5-541f-4fb4-abcd-a543c33abae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3580ef7359e4f2e8220eccaa5576812'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.372481 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c80781e5-541f-4fb4-abcd-a543c33abae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3580ef7359e4f2e8220eccaa5576812'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.382778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c80781e5-541f-4fb4-abcd-a543c33abae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3580ef7359e4f2e8220eccaa5576812'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.394827 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 943/1872] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:37 2022] DELETE /identity/v3/users/b3580ef7359e4f2e8220eccaa5576812 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:38.396460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8a2d2-0acb-4320-8445-656176e10e4d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:38.396750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8a2d2-0acb-4320-8445-656176e10e4d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:38.397030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8a2d2-0acb-4320-8445-656176e10e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:38.404132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf3bcc-1f8e-46a7-851e-73403f107369 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:38.417955 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8fa8a2d2-0acb-4320-8445-656176e10e4d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:38.419208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8fa8a2d2-0acb-4320-8445-656176e10e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:38.467443 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:38.468185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:38.472550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:38.472550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] PATH_INFO: `/v3/projects/d220e86536a7423e8b618e1c76f6c2e6` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:38.472550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d220e86536a7423e8b618e1c76f6c2e6)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:38.472550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:38.490475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 944/1873] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:38.491822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a9aa-080c-4bef-b54e-2ee8d21694bd None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:38.492278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a9aa-080c-4bef-b54e-2ee8d21694bd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:38.492470 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a9aa-080c-4bef-b54e-2ee8d21694bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:38.514500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c6e0a9aa-080c-4bef-b54e-2ee8d21694bd None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:38.515801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c6e0a9aa-080c-4bef-b54e-2ee8d21694bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:38.528360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 945/1874] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:38.528360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807c410-4dcc-4f6e-b93f-9a0dc69cdf92 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:38.528360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807c410-4dcc-4f6e-b93f-9a0dc69cdf92 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:38.528360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807c410-4dcc-4f6e-b93f-9a0dc69cdf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:38.548721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3807c410-4dcc-4f6e-b93f-9a0dc69cdf92 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:38.549956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3807c410-4dcc-4f6e-b93f-9a0dc69cdf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:38.565325 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 946/1875] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:38.565325 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807c410-4dcc-4f6e-b93f-9a0dc69cdf92 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:38.567220 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3807c410-4dcc-4f6e-b93f-9a0dc69cdf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:38.606866 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd220e86536a7423e8b618e1c76f6c2e6', 'request_id': 'req-20641c79-2f26-4044-9921-43a132ddb405'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.639341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807c410-4dcc-4f6e-b93f-9a0dc69cdf92 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:38.689467 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f77105-88b0-4692-b932-506ff1c918fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:38.689945 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f77105-88b0-4692-b932-506ff1c918fc service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:38.690231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f77105-88b0-4692-b932-506ff1c918fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:38.690510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f77105-88b0-4692-b932-506ff1c918fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:38.698109 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd220e86536a7423e8b618e1c76f6c2e6', 'request_id': 'req-20641c79-2f26-4044-9921-43a132ddb405'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.732065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:38.740610 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd220e86536a7423e8b618e1c76f6c2e6', 'request_id': 'req-20641c79-2f26-4044-9921-43a132ddb405'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.757063 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] The token cache is being invalidate because project d220e86536a7423e8b618e1c76f6c2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:38.757359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.758087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:38.760368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 930/1876] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:38 2022] DELETE /identity/v3/projects/d220e86536a7423e8b618e1c76f6c2e6 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:38.764136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:38.764136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:38.777169 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f77105-88b0-4692-b932-506ff1c918fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:38.778619 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f77105-88b0-4692-b932-506ff1c918fc service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:38.779181 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20641c79-2f26-4044-9921-43a132ddb405 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:38.784562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdf368-6bff-4d71-ad15-d1dd62ad8e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:38.785240 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf368-6bff-4d71-ad15-d1dd62ad8e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:38.785533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf368-6bff-4d71-ad15-d1dd62ad8e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:38.785816 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf368-6bff-4d71-ad15-d1dd62ad8e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:38.786902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdf368-6bff-4d71-ad15-d1dd62ad8e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:38.786902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdf368-6bff-4d71-ad15-d1dd62ad8e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:38.795312 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdf368-6bff-4d71-ad15-d1dd62ad8e90 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:38.795406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 947/1877] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:38.795406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f77105-88b0-4692-b932-506ff1c918fc service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:38.795406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-81f77105-88b0-4692-b932-506ff1c918fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:38.801648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 931/1878] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:23:38.802990 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1b159-5794-45ef-90da-84f7eda686ea None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:38.803285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1b159-5794-45ef-90da-84f7eda686ea None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:38.803564 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1b159-5794-45ef-90da-84f7eda686ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:38.808078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f77105-88b0-4692-b932-506ff1c918fc service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:38.823884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d3c1b159-5794-45ef-90da-84f7eda686ea None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:38.824778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9b079-456f-4e2b-b844-1341f9bfacc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:38.825263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d3c1b159-5794-45ef-90da-84f7eda686ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:38.829046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9b079-456f-4e2b-b844-1341f9bfacc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:38.830397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9b079-456f-4e2b-b844-1341f9bfacc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:38.830824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9b079-456f-4e2b-b844-1341f9bfacc3 admin admin] PATH_INFO: `/v3/users/0f1f7ecbd41a46b4a8e3ca7bd648b0f1` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:38.832992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9b079-456f-4e2b-b844-1341f9bfacc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f1f7ecbd41a46b4a8e3ca7bd648b0f1)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:38.833632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 932/1879] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:38.834597 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1b159-5794-45ef-90da-84f7eda686ea None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:38.839776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9b079-456f-4e2b-b844-1341f9bfacc3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:38.845945 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1b159-5794-45ef-90da-84f7eda686ea None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:38.851698 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b8c20-73af-47b8-a3be-be77b0d26746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:38.852419 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b8c20-73af-47b8-a3be-be77b0d26746 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:38.853243 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b8c20-73af-47b8-a3be-be77b0d26746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:38.853517 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b8c20-73af-47b8-a3be-be77b0d26746 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:38.854225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b8c20-73af-47b8-a3be-be77b0d26746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:38.856948 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b8c20-73af-47b8-a3be-be77b0d26746 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:39.028442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 933/1880] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:38 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:39.028442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827d4cc-0447-4527-92bf-f2ccd859a309 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:39.028442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827d4cc-0447-4527-92bf-f2ccd859a309 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:39.028442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827d4cc-0447-4527-92bf-f2ccd859a309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:39.047736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9827d4cc-0447-4527-92bf-f2ccd859a309 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:39.049479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9827d4cc-0447-4527-92bf-f2ccd859a309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:39.132240 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 934/1881] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:39.133830 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-58d9b079-456f-4e2b-b844-1341f9bfacc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f1f7ecbd41a46b4a8e3ca7bd648b0f1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:39.138363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827d4cc-0447-4527-92bf-f2ccd859a309 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:39.150775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827d4cc-0447-4527-92bf-f2ccd859a309 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:39.157112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-58d9b079-456f-4e2b-b844-1341f9bfacc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f1f7ecbd41a46b4a8e3ca7bd648b0f1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:39.159271 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87db14-5644-4b72-af80-1f349b50fbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:39.160029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87db14-5644-4b72-af80-1f349b50fbcf admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:39.160311 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87db14-5644-4b72-af80-1f349b50fbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:39.160587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87db14-5644-4b72-af80-1f349b50fbcf admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:39.161349 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87db14-5644-4b72-af80-1f349b50fbcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:39.163405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87db14-5644-4b72-af80-1f349b50fbcf admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:39.234466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-58d9b079-456f-4e2b-b844-1341f9bfacc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f1f7ecbd41a46b4a8e3ca7bd648b0f1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:39.236092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-58d9b079-456f-4e2b-b844-1341f9bfacc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f1f7ecbd41a46b4a8e3ca7bd648b0f1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:39.245230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-58d9b079-456f-4e2b-b844-1341f9bfacc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f1f7ecbd41a46b4a8e3ca7bd648b0f1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:39.252332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 948/1882] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:38 2022] DELETE /identity/v3/users/0f1f7ecbd41a46b4a8e3ca7bd648b0f1 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:39.255937 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9b079-456f-4e2b-b844-1341f9bfacc3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:39.257501 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-58d9b079-456f-4e2b-b844-1341f9bfacc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:39.306867 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 935/1883] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:39 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:39.308800 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1a05-5f98-4d93-9d00-c1d0c5c2b4cc None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:39.309105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1a05-5f98-4d93-9d00-c1d0c5c2b4cc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:39.309524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1a05-5f98-4d93-9d00-c1d0c5c2b4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:39.359001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7eaa1a05-5f98-4d93-9d00-c1d0c5c2b4cc None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:39.360379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7eaa1a05-5f98-4d93-9d00-c1d0c5c2b4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:39.389841 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9b079-456f-4e2b-b844-1341f9bfacc3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:39.395416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aaf648-2c09-48df-9288-640dff72db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:39.396149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aaf648-2c09-48df-9288-640dff72db3f admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:39.396436 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aaf648-2c09-48df-9288-640dff72db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:39.396802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aaf648-2c09-48df-9288-640dff72db3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:39.397601 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aaf648-2c09-48df-9288-640dff72db3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:39.397914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aaf648-2c09-48df-9288-640dff72db3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:39.399935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aaf648-2c09-48df-9288-640dff72db3f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:39.416364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 949/1884] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:23:39.416364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aaf648-2c09-48df-9288-640dff72db3f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:39.416364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-52aaf648-2c09-48df-9288-640dff72db3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:39.430447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aaf648-2c09-48df-9288-640dff72db3f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:39.437010 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4e17a-8eb7-4f0a-b2d8-08471c439912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:39.437010 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4e17a-8eb7-4f0a-b2d8-08471c439912 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:39.437244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4e17a-8eb7-4f0a-b2d8-08471c439912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:39.437520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4e17a-8eb7-4f0a-b2d8-08471c439912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:39.438516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4e17a-8eb7-4f0a-b2d8-08471c439912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:39.440217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4e17a-8eb7-4f0a-b2d8-08471c439912 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:39.455218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 950/1885] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:39.456230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4e17a-8eb7-4f0a-b2d8-08471c439912 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:39.461961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a4d4e17a-8eb7-4f0a-b2d8-08471c439912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:39.480157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:39.498732 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4e17a-8eb7-4f0a-b2d8-08471c439912 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:39.502355 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 936/1886] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:39.505879 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa1a05-5f98-4d93-9d00-c1d0c5c2b4cc None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:39.509722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:39.510938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:39.511402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:39.512183 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] PATH_INFO: `/v3/projects/c7575311e95a45ce939f80f56fe7da35` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:39.513817 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7575311e95a45ce939f80f56fe7da35)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:39.517653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:39.527864 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:39.531772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa1a05-5f98-4d93-9d00-c1d0c5c2b4cc None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:39.540708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41072ebd-818c-451c-93c7-8dd2597dc4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:39.541959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41072ebd-818c-451c-93c7-8dd2597dc4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:39.542079 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41072ebd-818c-451c-93c7-8dd2597dc4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:39.542412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41072ebd-818c-451c-93c7-8dd2597dc4d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:39.543196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41072ebd-818c-451c-93c7-8dd2597dc4d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:39.545616 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41072ebd-818c-451c-93c7-8dd2597dc4d9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:39.676441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 937/1887] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:39 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:39.677467 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41072ebd-818c-451c-93c7-8dd2597dc4d9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:39.691465 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7575311e95a45ce939f80f56fe7da35', 'request_id': 'req-f84c3635-af41-47a8-a01a-a663bf6531aa'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:39.747743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41072ebd-818c-451c-93c7-8dd2597dc4d9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:39.752700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68c2b3-5201-46a6-80c4-3a017a746f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:39.753276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68c2b3-5201-46a6-80c4-3a017a746f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:39.753558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68c2b3-5201-46a6-80c4-3a017a746f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:39.753832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68c2b3-5201-46a6-80c4-3a017a746f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:39.754567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68c2b3-5201-46a6-80c4-3a017a746f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:39.756179 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68c2b3-5201-46a6-80c4-3a017a746f2b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:39.772794 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 938/1888] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:39.772794 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68c2b3-5201-46a6-80c4-3a017a746f2b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:39.775639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5f68c2b3-5201-46a6-80c4-3a017a746f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:39.777102 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7575311e95a45ce939f80f56fe7da35', 'request_id': 'req-f84c3635-af41-47a8-a01a-a663bf6531aa'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:39.796920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7575311e95a45ce939f80f56fe7da35', 'request_id': 'req-f84c3635-af41-47a8-a01a-a663bf6531aa'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:39.827789 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] The token cache is being invalidate because project c7575311e95a45ce939f80f56fe7da35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:39.830284 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:39.833485 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:39.838633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 951/1889] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:39 2022] DELETE /identity/v3/projects/c7575311e95a45ce939f80f56fe7da35 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:39.843312 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:39.846938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:39.851017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68c2b3-5201-46a6-80c4-3a017a746f2b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:39.858957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7eb5d-c5f3-4b1f-888b-a40a4be6baea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:39.859760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7eb5d-c5f3-4b1f-888b-a40a4be6baea service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:39.860185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7eb5d-c5f3-4b1f-888b-a40a4be6baea service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:39.860809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7eb5d-c5f3-4b1f-888b-a40a4be6baea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:39.864086 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e9f7eb5d-c5f3-4b1f-888b-a40a4be6baea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:39.879564 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7eb5d-c5f3-4b1f-888b-a40a4be6baea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:39.881131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7eb5d-c5f3-4b1f-888b-a40a4be6baea service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:39.909053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 939/1890] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:39.909344 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7eb5d-c5f3-4b1f-888b-a40a4be6baea service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:39.913811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e9f7eb5d-c5f3-4b1f-888b-a40a4be6baea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:39.938302 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7eb5d-c5f3-4b1f-888b-a40a4be6baea service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:39.952266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f6593-1df1-4a9b-8119-dd3a2a74d5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:39.953180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f6593-1df1-4a9b-8119-dd3a2a74d5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:39.953461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f6593-1df1-4a9b-8119-dd3a2a74d5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:39.953736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f6593-1df1-4a9b-8119-dd3a2a74d5e8 admin admin] PATH_INFO: `/v3/projects/dc1e2db230b646c2a1351acf08e9c6bc/users/7e535a3d592b400aaa944b4ffbe5d8ed/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:39.960418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c3635-af41-47a8-a01a-a663bf6531aa admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:39.970995 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b79ba-d471-4ce9-af3d-0b2b7a86d18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:39.972310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b79ba-d471-4ce9-af3d-0b2b7a86d18f admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:39.976711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:39.977533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b79ba-d471-4ce9-af3d-0b2b7a86d18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:39.979356 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b79ba-d471-4ce9-af3d-0b2b7a86d18f admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:39.981484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b79ba-d471-4ce9-af3d-0b2b7a86d18f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:39.989284 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b79ba-d471-4ce9-af3d-0b2b7a86d18f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:39.990596 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f6593-1df1-4a9b-8119-dd3a2a74d5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1e2db230b646c2a1351acf08e9c6bc, user_id=7e535a3d592b400aaa944b4ffbe5d8ed, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:40.000861 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f6593-1df1-4a9b-8119-dd3a2a74d5e8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:40.094555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 940/1891] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:39 2022] PUT /identity/v3/projects/dc1e2db230b646c2a1351acf08e9c6bc/users/7e535a3d592b400aaa944b4ffbe5d8ed/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:40.094555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f6593-1df1-4a9b-8119-dd3a2a74d5e8 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:40.094708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a28f6593-1df1-4a9b-8119-dd3a2a74d5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:40.124271 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 952/1892] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:39 2022] POST /identity/v3/users => generated 286 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:40.125939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e505098-8180-4226-9b42-ad2db7fb1a79 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:40.129563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e505098-8180-4226-9b42-ad2db7fb1a79 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:40.129563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e505098-8180-4226-9b42-ad2db7fb1a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:40.161868 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2e505098-8180-4226-9b42-ad2db7fb1a79 None None] MFA Rules not processed for user `7e535a3d592b400aaa944b4ffbe5d8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:40.163592 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2e505098-8180-4226-9b42-ad2db7fb1a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:40.187856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f6593-1df1-4a9b-8119-dd3a2a74d5e8 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:40.195215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904f2bb-31d3-46f3-83db-788d254367c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:40.196584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904f2bb-31d3-46f3-83db-788d254367c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:40.196875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904f2bb-31d3-46f3-83db-788d254367c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:40.197155 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904f2bb-31d3-46f3-83db-788d254367c8 admin admin] PATH_INFO: `/v3/users/1fab5241d453410f9958b2181c67129e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:40.199461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904f2bb-31d3-46f3-83db-788d254367c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fab5241d453410f9958b2181c67129e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:40.201471 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904f2bb-31d3-46f3-83db-788d254367c8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:40.219912 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:40.253178 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 953/1893] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:40.254079 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e505098-8180-4226-9b42-ad2db7fb1a79 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:40.271490 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e505098-8180-4226-9b42-ad2db7fb1a79 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:40.277114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9932850-39c6-4849-86cb-51903f8ae25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:40.278045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9932850-39c6-4849-86cb-51903f8ae25d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:40.278330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9932850-39c6-4849-86cb-51903f8ae25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:40.278608 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9932850-39c6-4849-86cb-51903f8ae25d admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:40.279367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9932850-39c6-4849-86cb-51903f8ae25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:40.281035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9932850-39c6-4849-86cb-51903f8ae25d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:40.299022 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:40.304707 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 954/1894] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:40.306202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9932850-39c6-4849-86cb-51903f8ae25d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:40.317618 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9932850-39c6-4849-86cb-51903f8ae25d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:40.323330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdad763-ce80-4285-a9ea-9c7db0e8687d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:40.324206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdad763-ce80-4285-a9ea-9c7db0e8687d admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:40.324563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdad763-ce80-4285-a9ea-9c7db0e8687d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:40.324912 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdad763-ce80-4285-a9ea-9c7db0e8687d admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:40.325683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdad763-ce80-4285-a9ea-9c7db0e8687d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:40.327783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdad763-ce80-4285-a9ea-9c7db0e8687d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:40.418427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7904f2bb-31d3-46f3-83db-788d254367c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fab5241d453410f9958b2181c67129e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:40.437843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7904f2bb-31d3-46f3-83db-788d254367c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fab5241d453410f9958b2181c67129e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:40.438530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7904f2bb-31d3-46f3-83db-788d254367c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fab5241d453410f9958b2181c67129e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:40.442858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 955/1895] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:40 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:40.442858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdad763-ce80-4285-a9ea-9c7db0e8687d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:40.444408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bfdad763-ce80-4285-a9ea-9c7db0e8687d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:40.514122 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdad763-ce80-4285-a9ea-9c7db0e8687d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:40.518956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda3874-9232-4872-8e93-8c13a49c7dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:40.519653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda3874-9232-4872-8e93-8c13a49c7dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:40.519936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda3874-9232-4872-8e93-8c13a49c7dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:40.520240 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda3874-9232-4872-8e93-8c13a49c7dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:40.520963 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda3874-9232-4872-8e93-8c13a49c7dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:40.522605 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda3874-9232-4872-8e93-8c13a49c7dd6 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:40.533658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 956/1896] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:40.534630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda3874-9232-4872-8e93-8c13a49c7dd6 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:40.536390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2fda3874-9232-4872-8e93-8c13a49c7dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:40.548080 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7904f2bb-31d3-46f3-83db-788d254367c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fab5241d453410f9958b2181c67129e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:40.548723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7904f2bb-31d3-46f3-83db-788d254367c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fab5241d453410f9958b2181c67129e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:40.551912 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda3874-9232-4872-8e93-8c13a49c7dd6 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:40.558211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:40.559109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:40.559411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:40.559687 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] PATH_INFO: `/v3/projects/e5f8f7ea66a0459b832db8bc868a2667` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:40.560924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5f8f7ea66a0459b832db8bc868a2667)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:40.562725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 941/1897] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:40 2022] DELETE /identity/v3/users/1fab5241d453410f9958b2181c67129e => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:40.562928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:40.563600 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904f2bb-31d3-46f3-83db-788d254367c8 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:40.564970 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7904f2bb-31d3-46f3-83db-788d254367c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:40.681121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904f2bb-31d3-46f3-83db-788d254367c8 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:40.698869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5f8f7ea66a0459b832db8bc868a2667', 'request_id': 'req-4a508d2c-8969-461d-9550-7c11c0c80f03'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:40.775974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebb85b-d470-4b6b-8953-cf6b111a102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:40.776949 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebb85b-d470-4b6b-8953-cf6b111a102a admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:40.777294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebb85b-d470-4b6b-8953-cf6b111a102a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:40.777671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebb85b-d470-4b6b-8953-cf6b111a102a admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:40.778493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebb85b-d470-4b6b-8953-cf6b111a102a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:40.782566 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebb85b-d470-4b6b-8953-cf6b111a102a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:40.817352 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5f8f7ea66a0459b832db8bc868a2667', 'request_id': 'req-4a508d2c-8969-461d-9550-7c11c0c80f03'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:40.823856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5f8f7ea66a0459b832db8bc868a2667', 'request_id': 'req-4a508d2c-8969-461d-9550-7c11c0c80f03'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:40.836128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] The token cache is being invalidate because project e5f8f7ea66a0459b832db8bc868a2667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:40.837295 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:40.837945 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:40.839597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 957/1898] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:40 2022] DELETE /identity/v3/projects/e5f8f7ea66a0459b832db8bc868a2667 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:40.842444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:40.842444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:40.871941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a508d2c-8969-461d-9550-7c11c0c80f03 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:40.887078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addde736-8175-43b1-b6c0-1142d1be2c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:40.888297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addde736-8175-43b1-b6c0-1142d1be2c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:40.888760 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addde736-8175-43b1-b6c0-1142d1be2c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:40.889189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addde736-8175-43b1-b6c0-1142d1be2c73 admin admin] PATH_INFO: `/v3/projects/db072990ef7c421483b7e0b5160f6c84/users/b8d0a4c132824caaae765238549a3087/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:40.908681 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addde736-8175-43b1-b6c0-1142d1be2c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db072990ef7c421483b7e0b5160f6c84, user_id=b8d0a4c132824caaae765238549a3087, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:40.911611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addde736-8175-43b1-b6c0-1142d1be2c73 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:40.916515 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 942/1899] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:40 2022] POST /identity/v3/users => generated 299 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:40.916515 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebb85b-d470-4b6b-8953-cf6b111a102a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:40.929128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-07ebb85b-d470-4b6b-8953-cf6b111a102a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:40.947874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebb85b-d470-4b6b-8953-cf6b111a102a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:40.954200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e540d3b-496b-423f-9e2a-1668a6032a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:40.955292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e540d3b-496b-423f-9e2a-1668a6032a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:40.955712 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e540d3b-496b-423f-9e2a-1668a6032a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:40.956321 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e540d3b-496b-423f-9e2a-1668a6032a39 admin admin] PATH_INFO: `/v3/users/036cec8472fa46cfb59c75b1873fa218` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:40.958350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e540d3b-496b-423f-9e2a-1668a6032a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036cec8472fa46cfb59c75b1873fa218)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:40.961158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e540d3b-496b-423f-9e2a-1668a6032a39 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:41.040804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 958/1900] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:40 2022] PUT /identity/v3/projects/db072990ef7c421483b7e0b5160f6c84/users/b8d0a4c132824caaae765238549a3087/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:41.061749 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addde736-8175-43b1-b6c0-1142d1be2c73 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:41.064900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-addde736-8175-43b1-b6c0-1142d1be2c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:41.141486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addde736-8175-43b1-b6c0-1142d1be2c73 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:41.146345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274eeadb-1039-4bc1-915b-d59f10284a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:41.147033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274eeadb-1039-4bc1-915b-d59f10284a72 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:41.147318 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274eeadb-1039-4bc1-915b-d59f10284a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:41.147623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274eeadb-1039-4bc1-915b-d59f10284a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:41.148513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274eeadb-1039-4bc1-915b-d59f10284a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:41.150699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274eeadb-1039-4bc1-915b-d59f10284a72 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:41.161429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 959/1901] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:41.163063 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d7f68-6f30-4805-844c-d64a8e807733 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:41.163485 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d7f68-6f30-4805-844c-d64a8e807733 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:41.163893 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d7f68-6f30-4805-844c-d64a8e807733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:41.181542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6e540d3b-496b-423f-9e2a-1668a6032a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036cec8472fa46cfb59c75b1873fa218'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:41.196711 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6e540d3b-496b-423f-9e2a-1668a6032a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036cec8472fa46cfb59c75b1873fa218'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:41.197853 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6e540d3b-496b-423f-9e2a-1668a6032a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036cec8472fa46cfb59c75b1873fa218'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:41.200566 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1e2d7f68-6f30-4805-844c-d64a8e807733 None None] MFA Rules not processed for user `b8d0a4c132824caaae765238549a3087`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:41.201975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1e2d7f68-6f30-4805-844c-d64a8e807733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:41.268925 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6e540d3b-496b-423f-9e2a-1668a6032a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036cec8472fa46cfb59c75b1873fa218'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:41.269860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6e540d3b-496b-423f-9e2a-1668a6032a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036cec8472fa46cfb59c75b1873fa218'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:41.273381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 960/1902] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:41.274702 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d7f68-6f30-4805-844c-d64a8e807733 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:41.276213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1e2d7f68-6f30-4805-844c-d64a8e807733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:41.291051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d7f68-6f30-4805-844c-d64a8e807733 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:41.291752 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 943/1903] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:40 2022] DELETE /identity/v3/users/036cec8472fa46cfb59c75b1873fa218 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:41.292912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e540d3b-496b-423f-9e2a-1668a6032a39 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:41.294773 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6e540d3b-496b-423f-9e2a-1668a6032a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:41.366817 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893edd6c-8e86-418e-9f8e-d5a95a847105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:41.368563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893edd6c-8e86-418e-9f8e-d5a95a847105 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:41.368951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893edd6c-8e86-418e-9f8e-d5a95a847105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:41.369460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893edd6c-8e86-418e-9f8e-d5a95a847105 admin admin] PATH_INFO: `/v3/projects/967b84c1408247109be3c0a66e52b47e/users/0c0d8eff7b514ddf93717bb2f036f390/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:41.385883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e540d3b-496b-423f-9e2a-1668a6032a39 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:41.390891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893edd6c-8e86-418e-9f8e-d5a95a847105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=967b84c1408247109be3c0a66e52b47e, user_id=0c0d8eff7b514ddf93717bb2f036f390, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:41.393741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77507a5-a5ca-4ea3-904c-fed2cd4a3b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:41.393883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893edd6c-8e86-418e-9f8e-d5a95a847105 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:41.394425 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77507a5-a5ca-4ea3-904c-fed2cd4a3b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:41.394716 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77507a5-a5ca-4ea3-904c-fed2cd4a3b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:41.396226 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77507a5-a5ca-4ea3-904c-fed2cd4a3b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:41.397640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77507a5-a5ca-4ea3-904c-fed2cd4a3b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:41.400957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77507a5-a5ca-4ea3-904c-fed2cd4a3b39 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:41.463689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:41.471500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 961/1904] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:41 2022] PUT /identity/v3/projects/967b84c1408247109be3c0a66e52b47e/users/0c0d8eff7b514ddf93717bb2f036f390/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:41.475536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893edd6c-8e86-418e-9f8e-d5a95a847105 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:41.516090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 944/1905] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:41 2022] POST /identity/v3/projects => generated 369 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:41.517215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77507a5-a5ca-4ea3-904c-fed2cd4a3b39 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:41.521924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c77507a5-a5ca-4ea3-904c-fed2cd4a3b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:41.532191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:41.589730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893edd6c-8e86-418e-9f8e-d5a95a847105 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:41.630591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77507a5-a5ca-4ea3-904c-fed2cd4a3b39 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:41.637445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:41.639625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:41.640013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:41.640326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] PATH_INFO: `/v3/projects/d38b6712a08e47a78b322b8f80fa8736` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:41.641880 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d38b6712a08e47a78b322b8f80fa8736)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:41.646232 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:41.681008 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1990a0-94e8-487e-bf47-40611557be73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:41.682262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1990a0-94e8-487e-bf47-40611557be73 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:41.682468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1990a0-94e8-487e-bf47-40611557be73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:41.682816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1990a0-94e8-487e-bf47-40611557be73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:41.683922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1990a0-94e8-487e-bf47-40611557be73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:41.685709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1990a0-94e8-487e-bf47-40611557be73 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:41.699647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 962/1906] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:41.700785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1990a0-94e8-487e-bf47-40611557be73 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:41.723941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1990a0-94e8-487e-bf47-40611557be73 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:41.737050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf0bd3-d101-4404-9b8e-d900be87b523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:41.738748 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf0bd3-d101-4404-9b8e-d900be87b523 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:41.739016 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf0bd3-d101-4404-9b8e-d900be87b523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:41.740202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf0bd3-d101-4404-9b8e-d900be87b523 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:41.743818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf0bd3-d101-4404-9b8e-d900be87b523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:41.745787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf0bd3-d101-4404-9b8e-d900be87b523 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:41.829052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd38b6712a08e47a78b322b8f80fa8736', 'request_id': 'req-47c080c9-3c7e-42bc-866c-716f97ae84f2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:41.893873 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 963/1907] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:41 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:41.894935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf0bd3-d101-4404-9b8e-d900be87b523 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:41.903030 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd38b6712a08e47a78b322b8f80fa8736', 'request_id': 'req-47c080c9-3c7e-42bc-866c-716f97ae84f2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:41.907241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf0bd3-d101-4404-9b8e-d900be87b523 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:41.914172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd38b6712a08e47a78b322b8f80fa8736', 'request_id': 'req-47c080c9-3c7e-42bc-866c-716f97ae84f2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:41.933148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] The token cache is being invalidate because project d38b6712a08e47a78b322b8f80fa8736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:41.933835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:41.934823 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:41.937887 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 945/1908] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:41 2022] DELETE /identity/v3/projects/d38b6712a08e47a78b322b8f80fa8736 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:41.939286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:41.941179 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:41.979349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bee443-641c-4aa9-b125-19a075f27dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:41.980543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bee443-641c-4aa9-b125-19a075f27dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:41.980978 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bee443-641c-4aa9-b125-19a075f27dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:41.981432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bee443-641c-4aa9-b125-19a075f27dc9 admin admin] PATH_INFO: `/v3/projects/967b84c1408247109be3c0a66e52b47e/users/0c0d8eff7b514ddf93717bb2f036f390/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:41.983843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bee443-641c-4aa9-b125-19a075f27dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=967b84c1408247109be3c0a66e52b47e, user_id=0c0d8eff7b514ddf93717bb2f036f390, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:41.986947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bee443-641c-4aa9-b125-19a075f27dc9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:42.000230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 964/1909] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:41 2022] PUT /identity/v3/projects/967b84c1408247109be3c0a66e52b47e/users/0c0d8eff7b514ddf93717bb2f036f390/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:42.001493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fd724-959f-48d1-a040-229a7814e9f0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:42.001773 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fd724-959f-48d1-a040-229a7814e9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:42.002341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fd724-959f-48d1-a040-229a7814e9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:42.031499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c080c9-3c7e-42bc-866c-716f97ae84f2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:42.043947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ae2fd724-959f-48d1-a040-229a7814e9f0 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:42.046146 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ae2fd724-959f-48d1-a040-229a7814e9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:42.116665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b955fe-3b2f-415a-a6e6-5efaf01de49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:42.117359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b955fe-3b2f-415a-a6e6-5efaf01de49b admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:42.117646 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b955fe-3b2f-415a-a6e6-5efaf01de49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:42.118472 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b955fe-3b2f-415a-a6e6-5efaf01de49b admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:42.119614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b955fe-3b2f-415a-a6e6-5efaf01de49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:42.121131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b955fe-3b2f-415a-a6e6-5efaf01de49b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:42.131065 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:42.144998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 946/1910] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:42.144998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5608da-c01a-4422-8ef4-7deffb1dadb1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:42.144998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5608da-c01a-4422-8ef4-7deffb1dadb1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:42.144998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5608da-c01a-4422-8ef4-7deffb1dadb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:42.152174 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 965/1911] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:42.158713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fd724-959f-48d1-a040-229a7814e9f0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:42.174663 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fd724-959f-48d1-a040-229a7814e9f0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:42.179230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-bc5608da-c01a-4422-8ef4-7deffb1dadb1 None None] MFA Rules not processed for user `0c0d8eff7b514ddf93717bb2f036f390`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:42.179583 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf8678-b04c-4ae3-875d-df7a20f8de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:42.180567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bc5608da-c01a-4422-8ef4-7deffb1dadb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:42.180691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf8678-b04c-4ae3-875d-df7a20f8de9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:42.181013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf8678-b04c-4ae3-875d-df7a20f8de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:42.181295 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf8678-b04c-4ae3-875d-df7a20f8de9a admin admin] PATH_INFO: `/v3/projects/5f6176fe8b75455e8243a10b3e67a90c/users/c4393377bfaa4f919e79bf70ab4b5f12/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:42.197346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf8678-b04c-4ae3-875d-df7a20f8de9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6176fe8b75455e8243a10b3e67a90c, user_id=c4393377bfaa4f919e79bf70ab4b5f12, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:42.200266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf8678-b04c-4ae3-875d-df7a20f8de9a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:42.234430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:42.255298 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 947/1912] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:42.257485 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736982f-3823-45c1-8ce9-b803e58973e7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:42.257574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736982f-3823-45c1-8ce9-b803e58973e7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:42.257821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736982f-3823-45c1-8ce9-b803e58973e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:42.275040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 966/1913] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:42 2022] PUT /identity/v3/projects/5f6176fe8b75455e8243a10b3e67a90c/users/c4393377bfaa4f919e79bf70ab4b5f12/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:42.282574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf8678-b04c-4ae3-875d-df7a20f8de9a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:42.286181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5abf8678-b04c-4ae3-875d-df7a20f8de9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:42.306921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1736982f-3823-45c1-8ce9-b803e58973e7 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:42.308498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1736982f-3823-45c1-8ce9-b803e58973e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:42.367698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf8678-b04c-4ae3-875d-df7a20f8de9a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:42.373200 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:42.374088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:42.374374 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:42.374651 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] PATH_INFO: `/v3/projects/0e6733bec6c148b08bf8cde7e9d1a53d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:42.376293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6733bec6c148b08bf8cde7e9d1a53d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:42.379697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:42.410597 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 948/1914] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:42.411719 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736982f-3823-45c1-8ce9-b803e58973e7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:42.413219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1736982f-3823-45c1-8ce9-b803e58973e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:42.477985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736982f-3823-45c1-8ce9-b803e58973e7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:42.496342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6733bec6c148b08bf8cde7e9d1a53d', 'request_id': 'req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:42.532248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9878e81-f0cd-4feb-9c43-6d7c93971bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:42.532908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9878e81-f0cd-4feb-9c43-6d7c93971bfc service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:42.533194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9878e81-f0cd-4feb-9c43-6d7c93971bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:42.533513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9878e81-f0cd-4feb-9c43-6d7c93971bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:42.599231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9878e81-f0cd-4feb-9c43-6d7c93971bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:42.600903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9878e81-f0cd-4feb-9c43-6d7c93971bfc service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:42.601492 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6733bec6c148b08bf8cde7e9d1a53d', 'request_id': 'req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:42.610956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6733bec6c148b08bf8cde7e9d1a53d', 'request_id': 'req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:42.612127 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 949/1915] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:42.614960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9878e81-f0cd-4feb-9c43-6d7c93971bfc service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:42.629046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] The token cache is being invalidate because project 0e6733bec6c148b08bf8cde7e9d1a53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:42.630603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:42.631564 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:42.635040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 967/1916] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:42 2022] DELETE /identity/v3/projects/0e6733bec6c148b08bf8cde7e9d1a53d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:42.638421 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:42.642424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:42.682328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:42.710633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:42.717690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9878e81-f0cd-4feb-9c43-6d7c93971bfc service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:42.723482 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de87d7-68b3-447c-b91f-963515e02f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:42.724410 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de87d7-68b3-447c-b91f-963515e02f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:42.724697 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de87d7-68b3-447c-b91f-963515e02f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:42.724975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de87d7-68b3-447c-b91f-963515e02f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:42.725714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de87d7-68b3-447c-b91f-963515e02f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:42.728077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de87d7-68b3-447c-b91f-963515e02f86 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:42.737762 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3d486-eba0-481a-8178-a8eb12b8ac5a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:42.742631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 950/1917] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:42.742631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d04ee3-dd08-4b09-9df6-0e9b662bf995 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:42.742631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d04ee3-dd08-4b09-9df6-0e9b662bf995 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:42.742631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d04ee3-dd08-4b09-9df6-0e9b662bf995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:42.746733 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cfd5d-6739-41fc-bfd2-2600dcc38dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:42.747627 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cfd5d-6739-41fc-bfd2-2600dcc38dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:42.748099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cfd5d-6739-41fc-bfd2-2600dcc38dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:42.748446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cfd5d-6739-41fc-bfd2-2600dcc38dbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:42.749530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cfd5d-6739-41fc-bfd2-2600dcc38dbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:42.750856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cfd5d-6739-41fc-bfd2-2600dcc38dbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:42.752720 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cfd5d-6739-41fc-bfd2-2600dcc38dbb admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:42.765752 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b7d04ee3-dd08-4b09-9df6-0e9b662bf995 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:42.768422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b7d04ee3-dd08-4b09-9df6-0e9b662bf995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:42.769082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 968/1918] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:23:42.773874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cfd5d-6739-41fc-bfd2-2600dcc38dbb admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:42.776115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-346cfd5d-6739-41fc-bfd2-2600dcc38dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:42.779955 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 951/1919] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:42.781001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d04ee3-dd08-4b09-9df6-0e9b662bf995 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:42.785361 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b7d04ee3-dd08-4b09-9df6-0e9b662bf995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:42.798208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cfd5d-6739-41fc-bfd2-2600dcc38dbb admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:42.803589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d04ee3-dd08-4b09-9df6-0e9b662bf995 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:42.807290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84976b16-55c4-4d77-85b6-50365681ecaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:42.808971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84976b16-55c4-4d77-85b6-50365681ecaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:42.809535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84976b16-55c4-4d77-85b6-50365681ecaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:42.809982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f638d-ff5a-4b04-90f7-b840bc73fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:42.810276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84976b16-55c4-4d77-85b6-50365681ecaa admin admin] PATH_INFO: `/v3/users/7e535a3d592b400aaa944b4ffbe5d8ed` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:42.811052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f638d-ff5a-4b04-90f7-b840bc73fc9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:42.811406 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f638d-ff5a-4b04-90f7-b840bc73fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:42.811754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f638d-ff5a-4b04-90f7-b840bc73fc9f admin admin] PATH_INFO: `/v3/projects/5f6176fe8b75455e8243a10b3e67a90c/users/c4393377bfaa4f919e79bf70ab4b5f12/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:42.813348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84976b16-55c4-4d77-85b6-50365681ecaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e535a3d592b400aaa944b4ffbe5d8ed)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:42.814329 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f638d-ff5a-4b04-90f7-b840bc73fc9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6176fe8b75455e8243a10b3e67a90c, user_id=c4393377bfaa4f919e79bf70ab4b5f12, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:42.818174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f638d-ff5a-4b04-90f7-b840bc73fc9f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:42.820963 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84976b16-55c4-4d77-85b6-50365681ecaa admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:42.846031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 952/1920] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:42 2022] PUT /identity/v3/projects/5f6176fe8b75455e8243a10b3e67a90c/users/c4393377bfaa4f919e79bf70ab4b5f12/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:42.847318 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f638d-ff5a-4b04-90f7-b840bc73fc9f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:42.939277 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f638d-ff5a-4b04-90f7-b840bc73fc9f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:42.944545 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6119aa-cb0a-4835-b9d9-5e0651f43733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:42.946085 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6119aa-cb0a-4835-b9d9-5e0651f43733 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:42.946410 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6119aa-cb0a-4835-b9d9-5e0651f43733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:42.947130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6119aa-cb0a-4835-b9d9-5e0651f43733 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:42.947757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6119aa-cb0a-4835-b9d9-5e0651f43733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:42.950008 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6119aa-cb0a-4835-b9d9-5e0651f43733 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:42.983226 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:43.033491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-84976b16-55c4-4d77-85b6-50365681ecaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e535a3d592b400aaa944b4ffbe5d8ed'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:43.051074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-84976b16-55c4-4d77-85b6-50365681ecaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e535a3d592b400aaa944b4ffbe5d8ed'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:43.054726 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 953/1921] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:42 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:43.060360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1452-61fa-4b19-bf5b-2b3873d7dfd3 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:43.060826 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1452-61fa-4b19-bf5b-2b3873d7dfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:43.061108 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1452-61fa-4b19-bf5b-2b3873d7dfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:43.083463 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d41b1452-61fa-4b19-bf5b-2b3873d7dfd3 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:43.088195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d41b1452-61fa-4b19-bf5b-2b3873d7dfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:43.131046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-84976b16-55c4-4d77-85b6-50365681ecaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e535a3d592b400aaa944b4ffbe5d8ed'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:43.131686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-84976b16-55c4-4d77-85b6-50365681ecaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e535a3d592b400aaa944b4ffbe5d8ed'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:43.139969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-84976b16-55c4-4d77-85b6-50365681ecaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e535a3d592b400aaa944b4ffbe5d8ed'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:43.147253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 969/1922] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:42 2022] DELETE /identity/v3/users/7e535a3d592b400aaa944b4ffbe5d8ed => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:43.148863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10e304-bda5-47dd-9c70-797a853817a0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:43.149177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10e304-bda5-47dd-9c70-797a853817a0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:43.149455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10e304-bda5-47dd-9c70-797a853817a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:43.157270 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 954/1923] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:43.158225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b1452-61fa-4b19-bf5b-2b3873d7dfd3 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:43.160775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:43.162589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d41b1452-61fa-4b19-bf5b-2b3873d7dfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:43.178480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b1452-61fa-4b19-bf5b-2b3873d7dfd3 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:43.181110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-bd10e304-bda5-47dd-9c70-797a853817a0 None None] MFA Rules not processed for user `c4393377bfaa4f919e79bf70ab4b5f12`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:43.182435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bd10e304-bda5-47dd-9c70-797a853817a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:43.254963 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754456de-5b53-4319-bdd0-a1a05fb12e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:43.256083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754456de-5b53-4319-bdd0-a1a05fb12e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:43.256083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754456de-5b53-4319-bdd0-a1a05fb12e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:43.256368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754456de-5b53-4319-bdd0-a1a05fb12e7a admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:43.257421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754456de-5b53-4319-bdd0-a1a05fb12e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:43.259903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754456de-5b53-4319-bdd0-a1a05fb12e7a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:43.277500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 970/1924] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:43.278947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9e34-3897-47af-a39d-1636506f578f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:43.279237 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9e34-3897-47af-a39d-1636506f578f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:43.279505 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9e34-3897-47af-a39d-1636506f578f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:43.300543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-01ca9e34-3897-47af-a39d-1636506f578f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:43.301869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-01ca9e34-3897-47af-a39d-1636506f578f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:43.310483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 971/1925] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:43.311900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9e34-3897-47af-a39d-1636506f578f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:43.324404 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9e34-3897-47af-a39d-1636506f578f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:43.329984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200adfd-3319-480c-80d0-c789443b62a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:43.330717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200adfd-3319-480c-80d0-c789443b62a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:43.331005 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200adfd-3319-480c-80d0-c789443b62a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:43.331281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200adfd-3319-480c-80d0-c789443b62a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:43.332095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200adfd-3319-480c-80d0-c789443b62a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:43.332525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200adfd-3319-480c-80d0-c789443b62a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:43.334132 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200adfd-3319-480c-80d0-c789443b62a1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:43.348376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 955/1926] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:43 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:43.348376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754456de-5b53-4319-bdd0-a1a05fb12e7a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:43.351355 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-754456de-5b53-4319-bdd0-a1a05fb12e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:43.361364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 972/1927] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:23:43.362527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200adfd-3319-480c-80d0-c789443b62a1 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:43.366985 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f200adfd-3319-480c-80d0-c789443b62a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:43.421382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754456de-5b53-4319-bdd0-a1a05fb12e7a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:43.425591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d00a2-b775-4e80-a2a2-b6340f187e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:43.431482 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d00a2-b775-4e80-a2a2-b6340f187e17 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:43.431482 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d00a2-b775-4e80-a2a2-b6340f187e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:43.431482 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d00a2-b775-4e80-a2a2-b6340f187e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:43.434851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200adfd-3319-480c-80d0-c789443b62a1 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:43.438655 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e5c5e-c97f-46fa-a188-addf2205342c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:43.438874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d00a2-b775-4e80-a2a2-b6340f187e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:43.439311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e5c5e-c97f-46fa-a188-addf2205342c service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:43.439596 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e5c5e-c97f-46fa-a188-addf2205342c service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:43.439868 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e5c5e-c97f-46fa-a188-addf2205342c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:43.440965 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d00a2-b775-4e80-a2a2-b6340f187e17 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:43.449839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e5c5e-c97f-46fa-a188-addf2205342c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:43.451313 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e5c5e-c97f-46fa-a188-addf2205342c service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:43.453913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:43.454845 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 956/1928] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:43.455669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d00a2-b775-4e80-a2a2-b6340f187e17 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:43.468360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d00a2-b775-4e80-a2a2-b6340f187e17 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:43.474004 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66245c8-01ae-49e2-84ee-711084fdc419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:43.474677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66245c8-01ae-49e2-84ee-711084fdc419 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:43.475089 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66245c8-01ae-49e2-84ee-711084fdc419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:43.475674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66245c8-01ae-49e2-84ee-711084fdc419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:43.475787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 973/1929] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:43.476139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66245c8-01ae-49e2-84ee-711084fdc419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:43.476683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e5c5e-c97f-46fa-a188-addf2205342c service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:43.483085 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66245c8-01ae-49e2-84ee-711084fdc419 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:43.489854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e5c5e-c97f-46fa-a188-addf2205342c service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:43.500818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33c7f6-46d1-42ca-a662-bb73f5c66225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:43.502505 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c7f6-46d1-42ca-a662-bb73f5c66225 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:43.502955 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c7f6-46d1-42ca-a662-bb73f5c66225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:43.503346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c7f6-46d1-42ca-a662-bb73f5c66225 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:43.504405 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33c7f6-46d1-42ca-a662-bb73f5c66225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:43.508951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33c7f6-46d1-42ca-a662-bb73f5c66225 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:43.515180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 957/1930] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:43.519740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:43.521809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66245c8-01ae-49e2-84ee-711084fdc419 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:43.546199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66245c8-01ae-49e2-84ee-711084fdc419 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:43.560211 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec47d2b-0a5c-40cd-8f21-0e6955436bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:43.560963 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec47d2b-0a5c-40cd-8f21-0e6955436bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:43.561528 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec47d2b-0a5c-40cd-8f21-0e6955436bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:43.561822 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec47d2b-0a5c-40cd-8f21-0e6955436bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:43.562680 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec47d2b-0a5c-40cd-8f21-0e6955436bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:43.564415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec47d2b-0a5c-40cd-8f21-0e6955436bd9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:43.582612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 958/1931] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:43.588767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec47d2b-0a5c-40cd-8f21-0e6955436bd9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:43.605060 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec47d2b-0a5c-40cd-8f21-0e6955436bd9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:43.610552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 974/1932] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:43 2022] POST /identity/v3/projects => generated 391 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:43.612094 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92849f6-ea54-4a6d-8c84-007771ef1a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:43.613568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92849f6-ea54-4a6d-8c84-007771ef1a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:43.613930 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92849f6-ea54-4a6d-8c84-007771ef1a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:43.614215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92849f6-ea54-4a6d-8c84-007771ef1a75 admin admin] PATH_INFO: `/v3/projects/321d23c5acb94cc894eeded10430135b/users/22bc057e908b4203b3bd4f36da4a571f/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:43.615069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33c7f6-46d1-42ca-a662-bb73f5c66225 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:43.652907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92849f6-ea54-4a6d-8c84-007771ef1a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=321d23c5acb94cc894eeded10430135b, user_id=22bc057e908b4203b3bd4f36da4a571f, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:43.655800 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92849f6-ea54-4a6d-8c84-007771ef1a75 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:43.698437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33c7f6-46d1-42ca-a662-bb73f5c66225 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:43.712199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1e881-3d39-4f15-95e9-d82ff9ddf8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:43.713138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1e881-3d39-4f15-95e9-d82ff9ddf8ed admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:43.713525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1e881-3d39-4f15-95e9-d82ff9ddf8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:43.714429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1e881-3d39-4f15-95e9-d82ff9ddf8ed admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:43.730598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1e881-3d39-4f15-95e9-d82ff9ddf8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:43.734244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1e881-3d39-4f15-95e9-d82ff9ddf8ed admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:43.807511 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 959/1933] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:43 2022] PUT /identity/v3/projects/321d23c5acb94cc894eeded10430135b/users/22bc057e908b4203b3bd4f36da4a571f/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:43.809860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a984f-f064-443a-84b9-524601cf57ed None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:43.814866 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a984f-f064-443a-84b9-524601cf57ed None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:43.814866 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a984f-f064-443a-84b9-524601cf57ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:43.847348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0b2a984f-f064-443a-84b9-524601cf57ed None None] MFA Rules not processed for user `22bc057e908b4203b3bd4f36da4a571f`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:43.848811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0b2a984f-f064-443a-84b9-524601cf57ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:43.878243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 975/1934] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:43 2022] POST /identity/v3/users => generated 296 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:23:43.882181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1e881-3d39-4f15-95e9-d82ff9ddf8ed admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:43.893039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1e881-3d39-4f15-95e9-d82ff9ddf8ed admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:43.968404 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fdf2a-d225-4795-a33d-bc4e608a0ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:43.969460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fdf2a-d225-4795-a33d-bc4e608a0ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:43.969989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fdf2a-d225-4795-a33d-bc4e608a0ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:43.970428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fdf2a-d225-4795-a33d-bc4e608a0ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:43.971546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fdf2a-d225-4795-a33d-bc4e608a0ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:43.973458 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fdf2a-d225-4795-a33d-bc4e608a0ec3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:43.976741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 960/1935] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:43.985092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a984f-f064-443a-84b9-524601cf57ed None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:43.996504 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 976/1936] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:23:44.000593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fdf2a-d225-4795-a33d-bc4e608a0ec3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:44.004749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a984f-f064-443a-84b9-524601cf57ed None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:44.011377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c3ea4-9f64-42b1-9a4f-2297d925ad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:44.012338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c3ea4-9f64-42b1-9a4f-2297d925ad48 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:44.012702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c3ea4-9f64-42b1-9a4f-2297d925ad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:44.013059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c3ea4-9f64-42b1-9a4f-2297d925ad48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:44.013362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fdf2a-d225-4795-a33d-bc4e608a0ec3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:44.013916 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c3ea4-9f64-42b1-9a4f-2297d925ad48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:44.016191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c3ea4-9f64-42b1-9a4f-2297d925ad48 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:44.018961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfa70c-3a3e-4cbb-ab6c-14dc0d247d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:44.028817 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfa70c-3a3e-4cbb-ab6c-14dc0d247d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:44.030102 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfa70c-3a3e-4cbb-ab6c-14dc0d247d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:44.030392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfa70c-3a3e-4cbb-ab6c-14dc0d247d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:44.031269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfa70c-3a3e-4cbb-ab6c-14dc0d247d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:44.033548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfa70c-3a3e-4cbb-ab6c-14dc0d247d59 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:44.048040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 977/1937] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:44.050970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfa70c-3a3e-4cbb-ab6c-14dc0d247d59 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:44.072498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfa70c-3a3e-4cbb-ab6c-14dc0d247d59 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:44.080508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93718b11-67a3-4375-804f-b972a9dd9eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:44.080508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93718b11-67a3-4375-804f-b972a9dd9eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:44.080508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93718b11-67a3-4375-804f-b972a9dd9eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:44.080866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93718b11-67a3-4375-804f-b972a9dd9eb7 admin admin] PATH_INFO: `/v3/projects/eb20eb1cee1f410487b573ce7b6282fb/users/ac2f28bd87c44f67bdbdd1bc26aed81a/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:44.119065 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93718b11-67a3-4375-804f-b972a9dd9eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb20eb1cee1f410487b573ce7b6282fb, user_id=ac2f28bd87c44f67bdbdd1bc26aed81a, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:44.121862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93718b11-67a3-4375-804f-b972a9dd9eb7 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:44.129482 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 961/1938] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:43 2022] POST /identity/v3/projects => generated 389 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:44.130463 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c3ea4-9f64-42b1-9a4f-2297d925ad48 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:44.141824 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-eb5c3ea4-9f64-42b1-9a4f-2297d925ad48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:44.163754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:44.219778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 978/1939] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:44 2022] PUT /identity/v3/projects/eb20eb1cee1f410487b573ce7b6282fb/users/ac2f28bd87c44f67bdbdd1bc26aed81a/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:44.220847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93718b11-67a3-4375-804f-b972a9dd9eb7 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:44.250469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:44.361983 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c3ea4-9f64-42b1-9a4f-2297d925ad48 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:44.366970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93718b11-67a3-4375-804f-b972a9dd9eb7 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:44.371148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:44.373689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:44.374168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:44.375111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] PATH_INFO: `/v3/projects/dc1e2db230b646c2a1351acf08e9c6bc` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:44.376331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea11b43-86ee-49b6-9029-c0057d29897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:44.377248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11b43-86ee-49b6-9029-c0057d29897c admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:44.377729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11b43-86ee-49b6-9029-c0057d29897c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:44.378089 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11b43-86ee-49b6-9029-c0057d29897c admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:44.378865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1e2db230b646c2a1351acf08e9c6bc)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:44.378986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea11b43-86ee-49b6-9029-c0057d29897c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:44.381021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea11b43-86ee-49b6-9029-c0057d29897c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:44.381487 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:44.499724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 979/1940] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:44 2022] POST /identity/v3/users => generated 301 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:44.501785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e351c-7275-4653-a54f-753709ddd958 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:44.502148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e351c-7275-4653-a54f-753709ddd958 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:44.502499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e351c-7275-4653-a54f-753709ddd958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:44.520830 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1e2db230b646c2a1351acf08e9c6bc', 'request_id': 'req-1f79283c-3327-4993-9123-72a4e26888b0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:44.542240 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a91e351c-7275-4653-a54f-753709ddd958 None None] MFA Rules not processed for user `ac2f28bd87c44f67bdbdd1bc26aed81a`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:44.543858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a91e351c-7275-4653-a54f-753709ddd958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:44.610400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1e2db230b646c2a1351acf08e9c6bc', 'request_id': 'req-1f79283c-3327-4993-9123-72a4e26888b0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:44.615507 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1e2db230b646c2a1351acf08e9c6bc', 'request_id': 'req-1f79283c-3327-4993-9123-72a4e26888b0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:44.629962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] The token cache is being invalidate because project dc1e2db230b646c2a1351acf08e9c6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:44.630236 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:44.630946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:44.637074 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 962/1941] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:44 2022] DELETE /identity/v3/projects/dc1e2db230b646c2a1351acf08e9c6bc => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:44.637916 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:44.640036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:44.657860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 980/1942] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:44.658765 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e351c-7275-4653-a54f-753709ddd958 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:44.731611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79283c-3327-4993-9123-72a4e26888b0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:44.737477 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ade223-2b94-4059-a390-80410b68ce90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:44.738826 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ade223-2b94-4059-a390-80410b68ce90 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:44.739114 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ade223-2b94-4059-a390-80410b68ce90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:44.739397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ade223-2b94-4059-a390-80410b68ce90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:44.740166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ade223-2b94-4059-a390-80410b68ce90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:44.741798 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ade223-2b94-4059-a390-80410b68ce90 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:44.751311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e351c-7275-4653-a54f-753709ddd958 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:44.757947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 963/1943] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:44.759570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ade223-2b94-4059-a390-80410b68ce90 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:44.765592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-06ade223-2b94-4059-a390-80410b68ce90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:44.767245 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd1578-fe8b-4c3f-b688-62e0cd770630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:44.768587 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd1578-fe8b-4c3f-b688-62e0cd770630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:44.769053 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd1578-fe8b-4c3f-b688-62e0cd770630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:44.772945 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd1578-fe8b-4c3f-b688-62e0cd770630 admin admin] PATH_INFO: `/v3/users/0c0d8eff7b514ddf93717bb2f036f390` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:44.772945 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd1578-fe8b-4c3f-b688-62e0cd770630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c0d8eff7b514ddf93717bb2f036f390)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:44.773787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd1578-fe8b-4c3f-b688-62e0cd770630 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:44.785510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ade223-2b94-4059-a390-80410b68ce90 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:44.792922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27229855-6f4f-4b67-8a0f-e429a64fb695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:44.793613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27229855-6f4f-4b67-8a0f-e429a64fb695 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:44.793908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27229855-6f4f-4b67-8a0f-e429a64fb695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:44.794459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27229855-6f4f-4b67-8a0f-e429a64fb695 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:44.795927 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27229855-6f4f-4b67-8a0f-e429a64fb695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:44.798176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27229855-6f4f-4b67-8a0f-e429a64fb695 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:44.895225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 964/1944] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:44 2022] POST /identity/v3/projects => generated 393 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:44.896025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27229855-6f4f-4b67-8a0f-e429a64fb695 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:44.974544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27229855-6f4f-4b67-8a0f-e429a64fb695 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:44.980490 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3858c5a-6cd9-4586-a027-67ae27996128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:44.981662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3858c5a-6cd9-4586-a027-67ae27996128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:44.981945 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3858c5a-6cd9-4586-a027-67ae27996128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:44.982238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3858c5a-6cd9-4586-a027-67ae27996128 admin admin] PATH_INFO: `/v3/projects/6ccd0cf9828f4249bc8ece6dc41fd795/users/0a0f27e3612f4e26a7ffae55203fa321/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:44.998655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3858c5a-6cd9-4586-a027-67ae27996128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ccd0cf9828f4249bc8ece6dc41fd795, user_id=0a0f27e3612f4e26a7ffae55203fa321, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:45.001733 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3858c5a-6cd9-4586-a027-67ae27996128 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:45.095972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 965/1945] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:44 2022] PUT /identity/v3/projects/6ccd0cf9828f4249bc8ece6dc41fd795/users/0a0f27e3612f4e26a7ffae55203fa321/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:45.095972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3858c5a-6cd9-4586-a027-67ae27996128 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:45.096217 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b3858c5a-6cd9-4586-a027-67ae27996128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:45.160940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e1fd1578-fe8b-4c3f-b688-62e0cd770630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c0d8eff7b514ddf93717bb2f036f390'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:45.180940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e1fd1578-fe8b-4c3f-b688-62e0cd770630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c0d8eff7b514ddf93717bb2f036f390'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:45.184491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3858c5a-6cd9-4586-a027-67ae27996128 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:45.189424 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315686-1064-42b7-8eaf-3736f5ee3013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:45.190295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315686-1064-42b7-8eaf-3736f5ee3013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:45.190573 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315686-1064-42b7-8eaf-3736f5ee3013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:45.190843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315686-1064-42b7-8eaf-3736f5ee3013 admin admin] PATH_INFO: `/v3/users/b8d0a4c132824caaae765238549a3087` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:45.192128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315686-1064-42b7-8eaf-3736f5ee3013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d0a4c132824caaae765238549a3087)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:45.194118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315686-1064-42b7-8eaf-3736f5ee3013 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:45.238774 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e1fd1578-fe8b-4c3f-b688-62e0cd770630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c0d8eff7b514ddf93717bb2f036f390'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:45.239626 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e1fd1578-fe8b-4c3f-b688-62e0cd770630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c0d8eff7b514ddf93717bb2f036f390'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:45.248234 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e1fd1578-fe8b-4c3f-b688-62e0cd770630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c0d8eff7b514ddf93717bb2f036f390'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:45.254563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 981/1946] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:44 2022] DELETE /identity/v3/users/0c0d8eff7b514ddf93717bb2f036f390 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:45.255510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd1578-fe8b-4c3f-b688-62e0cd770630 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:45.257059 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e1fd1578-fe8b-4c3f-b688-62e0cd770630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:45.337698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd1578-fe8b-4c3f-b688-62e0cd770630 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:45.342392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdf946-c521-49d7-a2bc-001427a654b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:45.343088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdf946-c521-49d7-a2bc-001427a654b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:45.343380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdf946-c521-49d7-a2bc-001427a654b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:45.343658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdf946-c521-49d7-a2bc-001427a654b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:45.344395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdf946-c521-49d7-a2bc-001427a654b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:45.346370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdf946-c521-49d7-a2bc-001427a654b3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:45.442930 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-df315686-1064-42b7-8eaf-3736f5ee3013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d0a4c132824caaae765238549a3087'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:45.453198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 982/1947] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:45 2022] POST /identity/v3/users => generated 303 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:45.454074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdf946-c521-49d7-a2bc-001427a654b3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:45.455866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3cfdf946-c521-49d7-a2bc-001427a654b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:45.459840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-df315686-1064-42b7-8eaf-3736f5ee3013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d0a4c132824caaae765238549a3087'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:45.460551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-df315686-1064-42b7-8eaf-3736f5ee3013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d0a4c132824caaae765238549a3087'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:45.469517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdf946-c521-49d7-a2bc-001427a654b3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:45.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49f014-17b2-44da-a483-01cf1ef8ec07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:45.475300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49f014-17b2-44da-a483-01cf1ef8ec07 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:45.475584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49f014-17b2-44da-a483-01cf1ef8ec07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:45.476244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49f014-17b2-44da-a483-01cf1ef8ec07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:45.476629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49f014-17b2-44da-a483-01cf1ef8ec07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:45.479033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49f014-17b2-44da-a483-01cf1ef8ec07 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:45.492273 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 983/1948] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:45.492273 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49f014-17b2-44da-a483-01cf1ef8ec07 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:45.492273 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cb49f014-17b2-44da-a483-01cf1ef8ec07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:45.505890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49f014-17b2-44da-a483-01cf1ef8ec07 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:45.507257 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-df315686-1064-42b7-8eaf-3736f5ee3013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d0a4c132824caaae765238549a3087'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:45.507979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-df315686-1064-42b7-8eaf-3736f5ee3013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d0a4c132824caaae765238549a3087'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:45.511541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a245c4-5d93-4319-8175-df19a1ab1761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:45.512364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a245c4-5d93-4319-8175-df19a1ab1761 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:45.512736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a245c4-5d93-4319-8175-df19a1ab1761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:45.512979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a245c4-5d93-4319-8175-df19a1ab1761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:45.513936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a245c4-5d93-4319-8175-df19a1ab1761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:45.515556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a245c4-5d93-4319-8175-df19a1ab1761 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:45.528988 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 984/1949] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:45.530081 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a245c4-5d93-4319-8175-df19a1ab1761 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:45.532749 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-12a245c4-5d93-4319-8175-df19a1ab1761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:45.548905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a245c4-5d93-4319-8175-df19a1ab1761 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:45.555611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbf20f-a7ea-4ee1-b751-0ae3d9b6cf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:45.555789 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 966/1950] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:45 2022] DELETE /identity/v3/users/b8d0a4c132824caaae765238549a3087 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:45.556588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315686-1064-42b7-8eaf-3736f5ee3013 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:45.556822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbf20f-a7ea-4ee1-b751-0ae3d9b6cf58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:45.557111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbf20f-a7ea-4ee1-b751-0ae3d9b6cf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:45.557394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbf20f-a7ea-4ee1-b751-0ae3d9b6cf58 admin admin] PATH_INFO: `/v3/projects/6ccd0cf9828f4249bc8ece6dc41fd795/users/0a0f27e3612f4e26a7ffae55203fa321/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:45.559732 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbf20f-a7ea-4ee1-b751-0ae3d9b6cf58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ccd0cf9828f4249bc8ece6dc41fd795, user_id=0a0f27e3612f4e26a7ffae55203fa321, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:45.564343 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbf20f-a7ea-4ee1-b751-0ae3d9b6cf58 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:45.588677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 985/1951] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:45 2022] PUT /identity/v3/projects/6ccd0cf9828f4249bc8ece6dc41fd795/users/0a0f27e3612f4e26a7ffae55203fa321/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:45.588677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528058a4-279e-4c46-ac37-3a741d78b71d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:45.588677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528058a4-279e-4c46-ac37-3a741d78b71d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:45.588677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528058a4-279e-4c46-ac37-3a741d78b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:45.589068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:45.612339 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-528058a4-279e-4c46-ac37-3a741d78b71d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:45.614674 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-528058a4-279e-4c46-ac37-3a741d78b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:45.646749 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:45.649717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315686-1064-42b7-8eaf-3736f5ee3013 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:45.692796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 986/1952] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:45.694021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cccf0-06b0-4c4e-8b91-dcf041a8bbbc None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:45.694366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cccf0-06b0-4c4e-8b91-dcf041a8bbbc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:45.694666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cccf0-06b0-4c4e-8b91-dcf041a8bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:45.718384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe4a57-73ac-4b3c-a0e4-fe897b34bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:45.719289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe4a57-73ac-4b3c-a0e4-fe897b34bb4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:45.719575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe4a57-73ac-4b3c-a0e4-fe897b34bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:45.719851 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe4a57-73ac-4b3c-a0e4-fe897b34bb4e admin admin] PATH_INFO: `/v3/projects/95fd16b7dfa24e6ab9ced34f63007f63/users/a451d939cd93494e98c31997a68790fa/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:45.723429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b88cccf0-06b0-4c4e-8b91-dcf041a8bbbc None None] MFA Rules not processed for user `0a0f27e3612f4e26a7ffae55203fa321`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:45.724776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b88cccf0-06b0-4c4e-8b91-dcf041a8bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:45.736384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe4a57-73ac-4b3c-a0e4-fe897b34bb4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=95fd16b7dfa24e6ab9ced34f63007f63, user_id=a451d939cd93494e98c31997a68790fa, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:45.739348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe4a57-73ac-4b3c-a0e4-fe897b34bb4e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:45.801627 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 987/1953] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:45.805302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cccf0-06b0-4c4e-8b91-dcf041a8bbbc None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:45.807243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b88cccf0-06b0-4c4e-8b91-dcf041a8bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:45.810330 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 967/1954] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:45 2022] PUT /identity/v3/projects/95fd16b7dfa24e6ab9ced34f63007f63/users/a451d939cd93494e98c31997a68790fa/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:45.811442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe4a57-73ac-4b3c-a0e4-fe897b34bb4e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:45.813159 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-41fe4a57-73ac-4b3c-a0e4-fe897b34bb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:45.869637 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cccf0-06b0-4c4e-8b91-dcf041a8bbbc None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:45.877760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe4a57-73ac-4b3c-a0e4-fe897b34bb4e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:45.882416 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:45.884117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:45.884409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:45.884688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] PATH_INFO: `/v3/projects/967b84c1408247109be3c0a66e52b47e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:45.885914 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=967b84c1408247109be3c0a66e52b47e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:45.887852 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:45.921990 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd8875-42f6-4860-99bf-d13be8a935ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:45.922650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd8875-42f6-4860-99bf-d13be8a935ed service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:45.922950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd8875-42f6-4860-99bf-d13be8a935ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:45.923283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd8875-42f6-4860-99bf-d13be8a935ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:45.933137 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd8875-42f6-4860-99bf-d13be8a935ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:45.934597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd8875-42f6-4860-99bf-d13be8a935ed service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:45.944260 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 988/1955] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:45.944984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd8875-42f6-4860-99bf-d13be8a935ed service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:45.954837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd8875-42f6-4860-99bf-d13be8a935ed service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:45.959580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf0f32-f807-44f4-aae4-355148a17a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:45.960309 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf0f32-f807-44f4-aae4-355148a17a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:45.960595 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf0f32-f807-44f4-aae4-355148a17a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:45.960874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf0f32-f807-44f4-aae4-355148a17a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:45.962177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf0f32-f807-44f4-aae4-355148a17a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:45.963764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf0f32-f807-44f4-aae4-355148a17a8d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:45.974241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 989/1956] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:45.974840 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf0f32-f807-44f4-aae4-355148a17a8d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:45.979319 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5cdf0f32-f807-44f4-aae4-355148a17a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:46.006552 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967b84c1408247109be3c0a66e52b47e', 'request_id': 'req-dcec787b-5fe4-4afc-bfa7-434d52ca8722'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.038939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf0f32-f807-44f4-aae4-355148a17a8d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:46.087209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1abc7-8db9-4a87-a8b0-aa1ef9335aa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:46.087868 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1abc7-8db9-4a87-a8b0-aa1ef9335aa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:46.088191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1abc7-8db9-4a87-a8b0-aa1ef9335aa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:46.088476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1abc7-8db9-4a87-a8b0-aa1ef9335aa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:46.091113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:46.125078 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967b84c1408247109be3c0a66e52b47e', 'request_id': 'req-dcec787b-5fe4-4afc-bfa7-434d52ca8722'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.131836 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967b84c1408247109be3c0a66e52b47e', 'request_id': 'req-dcec787b-5fe4-4afc-bfa7-434d52ca8722'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.144414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] The token cache is being invalidate because project 967b84c1408247109be3c0a66e52b47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:46.144703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.145470 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.147426 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 968/1957] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:45 2022] DELETE /identity/v3/projects/967b84c1408247109be3c0a66e52b47e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:46.148274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:46.150318 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:46.151589 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:46.156319 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1abc7-8db9-4a87-a8b0-aa1ef9335aa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:46.158954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1abc7-8db9-4a87-a8b0-aa1ef9335aa4 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:46.174654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 990/1958] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:46.198086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541fc1-4041-4c4f-a7a7-423e4f6994a0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:46.198382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541fc1-4041-4c4f-a7a7-423e4f6994a0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:46.198663 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541fc1-4041-4c4f-a7a7-423e4f6994a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:46.211293 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:46.260761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a4541fc1-4041-4c4f-a7a7-423e4f6994a0 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:46.262016 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a4541fc1-4041-4c4f-a7a7-423e4f6994a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:46.295716 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec787b-5fe4-4afc-bfa7-434d52ca8722 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:46.301410 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d266f-8808-45cd-9dff-f2df46cf0057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:46.302598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d266f-8808-45cd-9dff-f2df46cf0057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:46.302946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d266f-8808-45cd-9dff-f2df46cf0057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:46.303521 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d266f-8808-45cd-9dff-f2df46cf0057 admin admin] PATH_INFO: `/v3/projects/95fd16b7dfa24e6ab9ced34f63007f63/users/a451d939cd93494e98c31997a68790fa/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:46.306628 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d266f-8808-45cd-9dff-f2df46cf0057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95fd16b7dfa24e6ab9ced34f63007f63, user_id=a451d939cd93494e98c31997a68790fa, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:46.310563 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d266f-8808-45cd-9dff-f2df46cf0057 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:46.335775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 969/1959] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:46 2022] PUT /identity/v3/projects/95fd16b7dfa24e6ab9ced34f63007f63/users/a451d939cd93494e98c31997a68790fa/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:46.338689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745553c4-03e8-4c96-88fe-371d36907771 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:46.338982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745553c4-03e8-4c96-88fe-371d36907771 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:46.340642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745553c4-03e8-4c96-88fe-371d36907771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:46.369736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 991/1960] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:46.377225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-745553c4-03e8-4c96-88fe-371d36907771 None None] MFA Rules not processed for user `a451d939cd93494e98c31997a68790fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:46.377846 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31d249-1eb0-4f48-86eb-21513b03e6b8 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:46.378074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31d249-1eb0-4f48-86eb-21513b03e6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:46.378367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31d249-1eb0-4f48-86eb-21513b03e6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:46.378601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-745553c4-03e8-4c96-88fe-371d36907771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:46.403476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7f31d249-1eb0-4f48-86eb-21513b03e6b8 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:46.404729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7f31d249-1eb0-4f48-86eb-21513b03e6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:46.412941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:46.469293 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:46.473248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 970/1961] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:46.474044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745553c4-03e8-4c96-88fe-371d36907771 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:46.475423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-745553c4-03e8-4c96-88fe-371d36907771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:46.483461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 992/1962] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:46.484517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31d249-1eb0-4f48-86eb-21513b03e6b8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:46.485895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7f31d249-1eb0-4f48-86eb-21513b03e6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:46.490342 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745553c4-03e8-4c96-88fe-371d36907771 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:46.496521 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12c97b-9e0b-4ee5-9ea7-e5e626f6ee4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:46.497536 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12c97b-9e0b-4ee5-9ea7-e5e626f6ee4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:46.497671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12c97b-9e0b-4ee5-9ea7-e5e626f6ee4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:46.498095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12c97b-9e0b-4ee5-9ea7-e5e626f6ee4e admin admin] PATH_INFO: `/v3/users/22bc057e908b4203b3bd4f36da4a571f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:46.499640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12c97b-9e0b-4ee5-9ea7-e5e626f6ee4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=22bc057e908b4203b3bd4f36da4a571f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:46.501940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12c97b-9e0b-4ee5-9ea7-e5e626f6ee4e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:46.557045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31d249-1eb0-4f48-86eb-21513b03e6b8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:46.560759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7b13b-6d08-4182-9905-3bf6fc7dc07d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:46.561417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7b13b-6d08-4182-9905-3bf6fc7dc07d service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:46.561701 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7b13b-6d08-4182-9905-3bf6fc7dc07d service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:46.563156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7b13b-6d08-4182-9905-3bf6fc7dc07d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:46.571580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7b13b-6d08-4182-9905-3bf6fc7dc07d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:46.573052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7b13b-6d08-4182-9905-3bf6fc7dc07d service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:46.582551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 993/1963] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:46.583407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7b13b-6d08-4182-9905-3bf6fc7dc07d service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:46.593011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7b13b-6d08-4182-9905-3bf6fc7dc07d service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:46.598077 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601eb6e-1678-482b-810b-78337429c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:46.599103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601eb6e-1678-482b-810b-78337429c03f admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:46.599103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601eb6e-1678-482b-810b-78337429c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:46.599266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601eb6e-1678-482b-810b-78337429c03f admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:46.600009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601eb6e-1678-482b-810b-78337429c03f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:46.600666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601eb6e-1678-482b-810b-78337429c03f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:46.601914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601eb6e-1678-482b-810b-78337429c03f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:46.619042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 994/1964] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:23:46.619823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601eb6e-1678-482b-810b-78337429c03f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:46.621672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5601eb6e-1678-482b-810b-78337429c03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:46.635586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601eb6e-1678-482b-810b-78337429c03f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:46.641869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:46.642747 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:46.643028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:46.643314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] PATH_INFO: `/v3/projects/db072990ef7c421483b7e0b5160f6c84` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:46.644808 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db072990ef7c421483b7e0b5160f6c84)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:46.646724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:46.698973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-de12c97b-9e0b-4ee5-9ea7-e5e626f6ee4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22bc057e908b4203b3bd4f36da4a571f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.708918 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:46.714976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-de12c97b-9e0b-4ee5-9ea7-e5e626f6ee4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22bc057e908b4203b3bd4f36da4a571f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.715883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-de12c97b-9e0b-4ee5-9ea7-e5e626f6ee4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22bc057e908b4203b3bd4f36da4a571f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.782131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db072990ef7c421483b7e0b5160f6c84', 'request_id': 'req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.792924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-de12c97b-9e0b-4ee5-9ea7-e5e626f6ee4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22bc057e908b4203b3bd4f36da4a571f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.793859 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-de12c97b-9e0b-4ee5-9ea7-e5e626f6ee4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22bc057e908b4203b3bd4f36da4a571f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.807372 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 971/1965] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:46 2022] DELETE /identity/v3/users/22bc057e908b4203b3bd4f36da4a571f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:46.808191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12c97b-9e0b-4ee5-9ea7-e5e626f6ee4e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:46.809605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-de12c97b-9e0b-4ee5-9ea7-e5e626f6ee4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:46.875750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12c97b-9e0b-4ee5-9ea7-e5e626f6ee4e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:46.880935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c042e20-1bac-4c20-9542-32f5790f4166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:46.882331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c042e20-1bac-4c20-9542-32f5790f4166 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:46.882331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c042e20-1bac-4c20-9542-32f5790f4166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:46.882752 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c042e20-1bac-4c20-9542-32f5790f4166 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:46.884130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c042e20-1bac-4c20-9542-32f5790f4166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:46.886128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c042e20-1bac-4c20-9542-32f5790f4166 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:46.901745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db072990ef7c421483b7e0b5160f6c84', 'request_id': 'req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.908537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:46.909764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db072990ef7c421483b7e0b5160f6c84', 'request_id': 'req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.921629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] The token cache is being invalidate because project db072990ef7c421483b7e0b5160f6c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:46.921925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.922599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:46.924453 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 995/1966] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:46 2022] DELETE /identity/v3/projects/db072990ef7c421483b7e0b5160f6c84 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:46.928231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:46.928231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:46.982309 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871fc00-ccdf-4ddf-a6d0-fd5e5b24d932 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:46.989987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 972/1967] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:46 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:46.991444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df0f8a-ddd8-49be-a1b1-86ec094d7fd8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:46.991740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df0f8a-ddd8-49be-a1b1-86ec094d7fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:46.992119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df0f8a-ddd8-49be-a1b1-86ec094d7fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:47.010449 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-10df0f8a-ddd8-49be-a1b1-86ec094d7fd8 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:47.011730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-10df0f8a-ddd8-49be-a1b1-86ec094d7fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:47.031744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251aa69-f0a8-4cfd-b6f5-2e3aa7a9bc59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:47.033799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251aa69-f0a8-4cfd-b6f5-2e3aa7a9bc59 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:47.034089 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251aa69-f0a8-4cfd-b6f5-2e3aa7a9bc59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:47.034366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251aa69-f0a8-4cfd-b6f5-2e3aa7a9bc59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:47.036289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4251aa69-f0a8-4cfd-b6f5-2e3aa7a9bc59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:47.074653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 973/1968] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:47.075524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df0f8a-ddd8-49be-a1b1-86ec094d7fd8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:47.076958 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-10df0f8a-ddd8-49be-a1b1-86ec094d7fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:47.088697 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df0f8a-ddd8-49be-a1b1-86ec094d7fd8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:47.093524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b80e2b-de67-422f-a01d-91812ed65bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:47.094396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80e2b-de67-422f-a01d-91812ed65bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:47.094679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80e2b-de67-422f-a01d-91812ed65bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:47.094954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80e2b-de67-422f-a01d-91812ed65bc8 admin admin] PATH_INFO: `/v3/users/c4393377bfaa4f919e79bf70ab4b5f12` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:47.096269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b80e2b-de67-422f-a01d-91812ed65bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4393377bfaa4f919e79bf70ab4b5f12)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:47.098200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b80e2b-de67-422f-a01d-91812ed65bc8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:47.099212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251aa69-f0a8-4cfd-b6f5-2e3aa7a9bc59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:47.100759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251aa69-f0a8-4cfd-b6f5-2e3aa7a9bc59 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:47.110633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 996/1969] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:47.111510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251aa69-f0a8-4cfd-b6f5-2e3aa7a9bc59 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:47.112920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4251aa69-f0a8-4cfd-b6f5-2e3aa7a9bc59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:47.121862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:47.126981 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251aa69-f0a8-4cfd-b6f5-2e3aa7a9bc59 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:47.131943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4df209-5de9-47a6-9c7d-d922d7aaf59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:47.132655 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df209-5de9-47a6-9c7d-d922d7aaf59d admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:47.132940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df209-5de9-47a6-9c7d-d922d7aaf59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:47.133248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df209-5de9-47a6-9c7d-d922d7aaf59d admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:47.133949 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4df209-5de9-47a6-9c7d-d922d7aaf59d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:47.135956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4df209-5de9-47a6-9c7d-d922d7aaf59d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:47.211397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 997/1970] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:47 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:47.212822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4df209-5de9-47a6-9c7d-d922d7aaf59d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:47.213977 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7e4df209-5de9-47a6-9c7d-d922d7aaf59d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:47.270864 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4df209-5de9-47a6-9c7d-d922d7aaf59d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:47.275006 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569495e6-9dd7-430b-8cf6-9117f897d63a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:47.275661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569495e6-9dd7-430b-8cf6-9117f897d63a service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:47.275947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569495e6-9dd7-430b-8cf6-9117f897d63a service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:47.276257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569495e6-9dd7-430b-8cf6-9117f897d63a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:47.288138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569495e6-9dd7-430b-8cf6-9117f897d63a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:47.288138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569495e6-9dd7-430b-8cf6-9117f897d63a service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:47.294047 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-53b80e2b-de67-422f-a01d-91812ed65bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4393377bfaa4f919e79bf70ab4b5f12'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:47.297254 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 998/1971] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:47.298052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569495e6-9dd7-430b-8cf6-9117f897d63a service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:47.308989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569495e6-9dd7-430b-8cf6-9117f897d63a service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:47.314981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-53b80e2b-de67-422f-a01d-91812ed65bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4393377bfaa4f919e79bf70ab4b5f12'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:47.316194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-53b80e2b-de67-422f-a01d-91812ed65bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4393377bfaa4f919e79bf70ab4b5f12'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:47.317239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250b565-b499-42bb-84a7-68dc671916e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:47.318050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250b565-b499-42bb-84a7-68dc671916e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:47.318624 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250b565-b499-42bb-84a7-68dc671916e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:47.318896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250b565-b499-42bb-84a7-68dc671916e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:47.319662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250b565-b499-42bb-84a7-68dc671916e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:47.321666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250b565-b499-42bb-84a7-68dc671916e4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:47.335033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 999/1972] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:47.338794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250b565-b499-42bb-84a7-68dc671916e4 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:47.340596 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5250b565-b499-42bb-84a7-68dc671916e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:47.355508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250b565-b499-42bb-84a7-68dc671916e4 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:47.362936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f155982-b5ed-4117-90ca-c9c09ce59586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:47.363623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f155982-b5ed-4117-90ca-c9c09ce59586 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:47.363914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f155982-b5ed-4117-90ca-c9c09ce59586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:47.365649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f155982-b5ed-4117-90ca-c9c09ce59586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:47.365649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f155982-b5ed-4117-90ca-c9c09ce59586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:47.366615 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f155982-b5ed-4117-90ca-c9c09ce59586 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:47.378958 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1000/1973] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:23:47.382818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f155982-b5ed-4117-90ca-c9c09ce59586 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:47.393730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f155982-b5ed-4117-90ca-c9c09ce59586 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:47.400023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688e161-09ef-47f7-814c-cf3a36224db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:47.400934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688e161-09ef-47f7-814c-cf3a36224db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:47.401217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688e161-09ef-47f7-814c-cf3a36224db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:47.401498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688e161-09ef-47f7-814c-cf3a36224db8 admin admin] PATH_INFO: `/v3/projects/17af478b064a4f9c852e620667b6423f/users/10ef5a2b7df847efa69c222a431f7eeb/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:47.410793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-53b80e2b-de67-422f-a01d-91812ed65bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4393377bfaa4f919e79bf70ab4b5f12'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:47.411455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-53b80e2b-de67-422f-a01d-91812ed65bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4393377bfaa4f919e79bf70ab4b5f12'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:47.418386 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688e161-09ef-47f7-814c-cf3a36224db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17af478b064a4f9c852e620667b6423f, user_id=10ef5a2b7df847efa69c222a431f7eeb, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:47.421461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688e161-09ef-47f7-814c-cf3a36224db8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:47.432046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 974/1974] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:47 2022] DELETE /identity/v3/users/c4393377bfaa4f919e79bf70ab4b5f12 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:47.541062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1001/1975] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:47 2022] PUT /identity/v3/projects/17af478b064a4f9c852e620667b6423f/users/10ef5a2b7df847efa69c222a431f7eeb/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:47.551598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143df73-a2b3-4fe7-8623-5876a0d54b57 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:47.551598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143df73-a2b3-4fe7-8623-5876a0d54b57 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:47.552168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143df73-a2b3-4fe7-8623-5876a0d54b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:47.592856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e143df73-a2b3-4fe7-8623-5876a0d54b57 None None] MFA Rules not processed for user `10ef5a2b7df847efa69c222a431f7eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:47.594327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e143df73-a2b3-4fe7-8623-5876a0d54b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:47.651632 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:47.665524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 975/1976] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:47.669785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688e161-09ef-47f7-814c-cf3a36224db8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:47.798715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688e161-09ef-47f7-814c-cf3a36224db8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:47.804305 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db01a-8814-4d48-850e-26c791cae9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:47.805670 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db01a-8814-4d48-850e-26c791cae9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:47.806073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db01a-8814-4d48-850e-26c791cae9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:47.806454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db01a-8814-4d48-850e-26c791cae9a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:47.807253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422db01a-8814-4d48-850e-26c791cae9a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:47.809438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422db01a-8814-4d48-850e-26c791cae9a3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:47.896478 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143df73-a2b3-4fe7-8623-5876a0d54b57 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:47.898098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e143df73-a2b3-4fe7-8623-5876a0d54b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:47.941172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143df73-a2b3-4fe7-8623-5876a0d54b57 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:47.947458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:47.949577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:47.949577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:47.949577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] PATH_INFO: `/v3/projects/321d23c5acb94cc894eeded10430135b` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:47.950720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=321d23c5acb94cc894eeded10430135b)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:47.952911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:47.986104 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1002/1977] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:47 2022] POST /identity/v3/projects => generated 383 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:47.990344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db01a-8814-4d48-850e-26c791cae9a3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:48.077128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db01a-8814-4d48-850e-26c791cae9a3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:48.082787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60986192-e0e1-4949-9eda-e5fe10dbf05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:48.083572 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60986192-e0e1-4949-9eda-e5fe10dbf05b admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:48.083926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60986192-e0e1-4949-9eda-e5fe10dbf05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:48.084305 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60986192-e0e1-4949-9eda-e5fe10dbf05b admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:48.085092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60986192-e0e1-4949-9eda-e5fe10dbf05b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:48.087668 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60986192-e0e1-4949-9eda-e5fe10dbf05b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:48.094694 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '321d23c5acb94cc894eeded10430135b', 'request_id': 'req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.103450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:48.176156 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '321d23c5acb94cc894eeded10430135b', 'request_id': 'req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.185143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1003/1978] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:47 2022] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:23:48.185301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '321d23c5acb94cc894eeded10430135b', 'request_id': 'req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.185392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60986192-e0e1-4949-9eda-e5fe10dbf05b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:48.185392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-60986192-e0e1-4949-9eda-e5fe10dbf05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:48.195213 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] The token cache is being invalidate because project 321d23c5acb94cc894eeded10430135b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:48.195515 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.196217 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.196458 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60986192-e0e1-4949-9eda-e5fe10dbf05b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:48.198021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 976/1979] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:47 2022] DELETE /identity/v3/projects/321d23c5acb94cc894eeded10430135b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:48.201618 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:48.203076 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:48.254290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:48.255164 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:48.255445 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:48.255719 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] PATH_INFO: `/v3/projects/5f6176fe8b75455e8243a10b3e67a90c` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:48.256964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f6176fe8b75455e8243a10b3e67a90c)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:48.259404 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:48.269331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a952cd-f5fa-4f98-9ac3-1d4443b36d03 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:48.275652 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b413b-22f1-40b8-8f21-f9f67d88892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:48.276373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b413b-22f1-40b8-8f21-f9f67d88892f admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:48.276663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b413b-22f1-40b8-8f21-f9f67d88892f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:48.276939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b413b-22f1-40b8-8f21-f9f67d88892f admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:48.277676 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b413b-22f1-40b8-8f21-f9f67d88892f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:48.279289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b413b-22f1-40b8-8f21-f9f67d88892f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:48.289712 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 977/1980] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:48.290745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b413b-22f1-40b8-8f21-f9f67d88892f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:48.292467 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c09b413b-22f1-40b8-8f21-f9f67d88892f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:48.304613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b413b-22f1-40b8-8f21-f9f67d88892f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:48.309323 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612e9a8-b937-40b5-aa13-6f01ee1a9057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:48.310163 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612e9a8-b937-40b5-aa13-6f01ee1a9057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:48.310448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612e9a8-b937-40b5-aa13-6f01ee1a9057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:48.310726 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612e9a8-b937-40b5-aa13-6f01ee1a9057 admin admin] PATH_INFO: `/v3/users/0a0f27e3612f4e26a7ffae55203fa321` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:48.311965 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612e9a8-b937-40b5-aa13-6f01ee1a9057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0f27e3612f4e26a7ffae55203fa321)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:48.313893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612e9a8-b937-40b5-aa13-6f01ee1a9057 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:48.381126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f6176fe8b75455e8243a10b3e67a90c', 'request_id': 'req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.387717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:48.438654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f6176fe8b75455e8243a10b3e67a90c', 'request_id': 'req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.444512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f6176fe8b75455e8243a10b3e67a90c', 'request_id': 'req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.456801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] The token cache is being invalidate because project 5f6176fe8b75455e8243a10b3e67a90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:48.457093 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.458078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.459416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1004/1981] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:48 2022] DELETE /identity/v3/projects/5f6176fe8b75455e8243a10b3e67a90c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:48.460466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:48.467582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:48.483957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4612e9a8-b937-40b5-aa13-6f01ee1a9057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0f27e3612f4e26a7ffae55203fa321'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.496421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4612e9a8-b937-40b5-aa13-6f01ee1a9057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0f27e3612f4e26a7ffae55203fa321'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.497167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4612e9a8-b937-40b5-aa13-6f01ee1a9057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0f27e3612f4e26a7ffae55203fa321'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.525738 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd83c70-e50e-4ee9-9f2a-81f79099a2ca admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:48.530386 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdd0cd-db6d-4ccb-b494-cf6ea3a75eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:48.531432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdd0cd-db6d-4ccb-b494-cf6ea3a75eff admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:48.531714 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdd0cd-db6d-4ccb-b494-cf6ea3a75eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:48.531987 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdd0cd-db6d-4ccb-b494-cf6ea3a75eff admin admin] PATH_INFO: `/v3/projects/4902d46d9ca2461796903646941f6609/users/c56811f3eee1441aa256332ffa7a70f3/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:48.547056 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdd0cd-db6d-4ccb-b494-cf6ea3a75eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4902d46d9ca2461796903646941f6609, user_id=c56811f3eee1441aa256332ffa7a70f3, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:48.549743 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdd0cd-db6d-4ccb-b494-cf6ea3a75eff admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:48.576177 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4612e9a8-b937-40b5-aa13-6f01ee1a9057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0f27e3612f4e26a7ffae55203fa321'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.576816 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4612e9a8-b937-40b5-aa13-6f01ee1a9057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0f27e3612f4e26a7ffae55203fa321'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:48.590377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 978/1982] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:48 2022] DELETE /identity/v3/users/0a0f27e3612f4e26a7ffae55203fa321 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:48.591624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd708af-eea3-4d04-a0bc-b84d6fd94a4d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:48.591908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd708af-eea3-4d04-a0bc-b84d6fd94a4d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:48.592217 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd708af-eea3-4d04-a0bc-b84d6fd94a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:48.612659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6bd708af-eea3-4d04-a0bc-b84d6fd94a4d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:48.614598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6bd708af-eea3-4d04-a0bc-b84d6fd94a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:48.679224 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 979/1983] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:48.680212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1005/1984] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:48 2022] PUT /identity/v3/projects/4902d46d9ca2461796903646941f6609/users/c56811f3eee1441aa256332ffa7a70f3/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:48.684235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd708af-eea3-4d04-a0bc-b84d6fd94a4d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:48.685817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6bd708af-eea3-4d04-a0bc-b84d6fd94a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:48.687507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7894df-5a7c-4614-8867-bf7f23b6ac49 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:48.687825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7894df-5a7c-4614-8867-bf7f23b6ac49 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:48.688150 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7894df-5a7c-4614-8867-bf7f23b6ac49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:48.700562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd708af-eea3-4d04-a0bc-b84d6fd94a4d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:48.707830 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-de7894df-5a7c-4614-8867-bf7f23b6ac49 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:48.712775 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-de7894df-5a7c-4614-8867-bf7f23b6ac49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:48.757719 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2d23d-fa49-4489-9651-be5163e948af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:48.758975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2d23d-fa49-4489-9651-be5163e948af admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:48.759264 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2d23d-fa49-4489-9651-be5163e948af admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:48.759585 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2d23d-fa49-4489-9651-be5163e948af admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:48.760295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2d23d-fa49-4489-9651-be5163e948af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:48.761901 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2d23d-fa49-4489-9651-be5163e948af admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:48.772883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1006/1985] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:48.774296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7894df-5a7c-4614-8867-bf7f23b6ac49 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:48.775602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 980/1986] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:23:48.776497 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2d23d-fa49-4489-9651-be5163e948af admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:48.785756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7894df-5a7c-4614-8867-bf7f23b6ac49 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:48.786490 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2d23d-fa49-4489-9651-be5163e948af admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:48.791015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95604be-65a5-4759-91b7-e74d0e8e0336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:48.791510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412193e1-af64-4b85-b4c7-117866b39c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:48.792160 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95604be-65a5-4759-91b7-e74d0e8e0336 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:48.796766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412193e1-af64-4b85-b4c7-117866b39c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:48.796873 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95604be-65a5-4759-91b7-e74d0e8e0336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:48.796951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412193e1-af64-4b85-b4c7-117866b39c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:48.797024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95604be-65a5-4759-91b7-e74d0e8e0336 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:48.797144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412193e1-af64-4b85-b4c7-117866b39c82 admin admin] PATH_INFO: `/v3/projects/4902d46d9ca2461796903646941f6609/users/c56811f3eee1441aa256332ffa7a70f3/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:48.797247 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95604be-65a5-4759-91b7-e74d0e8e0336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:48.797247 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95604be-65a5-4759-91b7-e74d0e8e0336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:48.797377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412193e1-af64-4b85-b4c7-117866b39c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4902d46d9ca2461796903646941f6609, user_id=c56811f3eee1441aa256332ffa7a70f3, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:48.797499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95604be-65a5-4759-91b7-e74d0e8e0336 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:48.798128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412193e1-af64-4b85-b4c7-117866b39c82 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:48.816480 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1007/1987] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:23:48.819973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 981/1988] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:48 2022] PUT /identity/v3/projects/4902d46d9ca2461796903646941f6609/users/c56811f3eee1441aa256332ffa7a70f3/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:48.824300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95604be-65a5-4759-91b7-e74d0e8e0336 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:48.830831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc113d2-d7f2-4f7b-9d72-948117b2aa5b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:48.831123 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc113d2-d7f2-4f7b-9d72-948117b2aa5b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:48.831517 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc113d2-d7f2-4f7b-9d72-948117b2aa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:48.844197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95604be-65a5-4759-91b7-e74d0e8e0336 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:48.864531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ecc113d2-d7f2-4f7b-9d72-948117b2aa5b None None] MFA Rules not processed for user `c56811f3eee1441aa256332ffa7a70f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:48.866422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ecc113d2-d7f2-4f7b-9d72-948117b2aa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:48.912087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba0cdd-f237-4de7-b056-359b66f776c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:48.913129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba0cdd-f237-4de7-b056-359b66f776c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:48.913418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba0cdd-f237-4de7-b056-359b66f776c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:48.913705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba0cdd-f237-4de7-b056-359b66f776c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:48.914994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba0cdd-f237-4de7-b056-359b66f776c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:48.917299 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba0cdd-f237-4de7-b056-359b66f776c9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:48.970160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 982/1989] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:23:48.983033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc113d2-d7f2-4f7b-9d72-948117b2aa5b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:48.984495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ecc113d2-d7f2-4f7b-9d72-948117b2aa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:49.038056 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1008/1990] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:48 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:23:49.042488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba0cdd-f237-4de7-b056-359b66f776c9 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:49.045623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc113d2-d7f2-4f7b-9d72-948117b2aa5b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:49.124690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3405f98-b27c-425e-8993-c55f86ebcb09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:49.125368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3405f98-b27c-425e-8993-c55f86ebcb09 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:49.125636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3405f98-b27c-425e-8993-c55f86ebcb09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:49.125907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3405f98-b27c-425e-8993-c55f86ebcb09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:49.149409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:49.153594 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba0cdd-f237-4de7-b056-359b66f776c9 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:49.158781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca0515-f430-4447-9e57-03a0f66f7af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:49.159547 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca0515-f430-4447-9e57-03a0f66f7af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:49.159961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca0515-f430-4447-9e57-03a0f66f7af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:49.160354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca0515-f430-4447-9e57-03a0f66f7af9 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:49.161451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca0515-f430-4447-9e57-03a0f66f7af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:49.163555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca0515-f430-4447-9e57-03a0f66f7af9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:49.179604 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:49.203139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3405f98-b27c-425e-8993-c55f86ebcb09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:49.204697 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3405f98-b27c-425e-8993-c55f86ebcb09 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:49.215368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 983/1991] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:23:49.216225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3405f98-b27c-425e-8993-c55f86ebcb09 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:49.217619 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c3405f98-b27c-425e-8993-c55f86ebcb09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:49.231837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3405f98-b27c-425e-8993-c55f86ebcb09 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:49.237396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:49.238274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:49.238557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:49.238837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] PATH_INFO: `/v3/projects/6ccd0cf9828f4249bc8ece6dc41fd795` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:49.240064 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ccd0cf9828f4249bc8ece6dc41fd795)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:49.242035 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:49.259276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1009/1992] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:49 2022] POST /identity/v3/users => generated 282 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:49.261899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca0515-f430-4447-9e57-03a0f66f7af9 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:49.291458 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca0515-f430-4447-9e57-03a0f66f7af9 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:49.303459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da660560-4358-49fa-b00e-f3086627f44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:49.304329 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da660560-4358-49fa-b00e-f3086627f44c admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:49.305479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da660560-4358-49fa-b00e-f3086627f44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:49.305479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da660560-4358-49fa-b00e-f3086627f44c admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:49.306185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da660560-4358-49fa-b00e-f3086627f44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:49.307806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da660560-4358-49fa-b00e-f3086627f44c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:49.320997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1010/1993] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:23:49.329209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da660560-4358-49fa-b00e-f3086627f44c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:49.339661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da660560-4358-49fa-b00e-f3086627f44c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:49.358591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691ad0a-747e-44b0-bde7-245a281d7910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:49.359174 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691ad0a-747e-44b0-bde7-245a281d7910 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:49.359460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691ad0a-747e-44b0-bde7-245a281d7910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:49.359737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691ad0a-747e-44b0-bde7-245a281d7910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:49.360505 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691ad0a-747e-44b0-bde7-245a281d7910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:49.362155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691ad0a-747e-44b0-bde7-245a281d7910 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:49.366634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ccd0cf9828f4249bc8ece6dc41fd795', 'request_id': 'req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:49.388227 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1011/1994] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:23:49.389095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691ad0a-747e-44b0-bde7-245a281d7910 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:49.399289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691ad0a-747e-44b0-bde7-245a281d7910 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:49.455353 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da67181-78fa-4b8e-8281-abc84cc50e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:49.456286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67181-78fa-4b8e-8281-abc84cc50e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:49.456602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67181-78fa-4b8e-8281-abc84cc50e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:49.456881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67181-78fa-4b8e-8281-abc84cc50e3f admin admin] PATH_INFO: `/v3/projects/862f35a65c7a410dbe3325551d663496/users/c2374b96d6f4495399a3fc6e4522e786/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:49.471032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da67181-78fa-4b8e-8281-abc84cc50e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=862f35a65c7a410dbe3325551d663496, user_id=c2374b96d6f4495399a3fc6e4522e786, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:49.473906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da67181-78fa-4b8e-8281-abc84cc50e3f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:49.478847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ccd0cf9828f4249bc8ece6dc41fd795', 'request_id': 'req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:49.485253 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ccd0cf9828f4249bc8ece6dc41fd795', 'request_id': 'req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:49.497403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] The token cache is being invalidate because project 6ccd0cf9828f4249bc8ece6dc41fd795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:49.497808 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:49.498592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:49.500494 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 984/1995] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:49 2022] DELETE /identity/v3/projects/6ccd0cf9828f4249bc8ece6dc41fd795 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:49.501168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:49.503708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:49.541287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1012/1996] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:49 2022] PUT /identity/v3/projects/862f35a65c7a410dbe3325551d663496/users/c2374b96d6f4495399a3fc6e4522e786/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:49.542720 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e6a93-dcae-461a-8a53-ef7f729fec52 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:49.543087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e6a93-dcae-461a-8a53-ef7f729fec52 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:49.543279 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e6a93-dcae-461a-8a53-ef7f729fec52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:49.567343 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4e4e6a93-dcae-461a-8a53-ef7f729fec52 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:49.568591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4e4e6a93-dcae-461a-8a53-ef7f729fec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:49.571907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e829e0-89bc-4ecd-aff6-72c931d4d07e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:49.620687 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bf8b4-859d-41aa-99a4-32cd5dd4c0aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:49.621385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bf8b4-859d-41aa-99a4-32cd5dd4c0aa service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:49.621672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bf8b4-859d-41aa-99a4-32cd5dd4c0aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:49.621951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bf8b4-859d-41aa-99a4-32cd5dd4c0aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:49.623877 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e64bf8b4-859d-41aa-99a4-32cd5dd4c0aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:49.630506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1013/1997] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:49.631583 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa9877-ea01-41ff-862d-342783235973 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:49.631937 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa9877-ea01-41ff-862d-342783235973 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:49.632181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa9877-ea01-41ff-862d-342783235973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:49.665432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a5fa9877-ea01-41ff-862d-342783235973 None None] MFA Rules not processed for user `c2374b96d6f4495399a3fc6e4522e786`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:49.666731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a5fa9877-ea01-41ff-862d-342783235973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:49.689627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bf8b4-859d-41aa-99a4-32cd5dd4c0aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:49.691070 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bf8b4-859d-41aa-99a4-32cd5dd4c0aa service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:49.702473 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 985/1998] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:49.704220 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d20a2-3b89-407f-be11-fa620669e32e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:49.704824 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d20a2-3b89-407f-be11-fa620669e32e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:49.705110 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d20a2-3b89-407f-be11-fa620669e32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:49.723552 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-223d20a2-3b89-407f-be11-fa620669e32e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:49.725152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-223d20a2-3b89-407f-be11-fa620669e32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:49.740126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 986/1999] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:49.741200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d20a2-3b89-407f-be11-fa620669e32e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:49.745700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1014/2000] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:49.746704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa9877-ea01-41ff-862d-342783235973 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:49.748092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a5fa9877-ea01-41ff-862d-342783235973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:49.751385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d20a2-3b89-407f-be11-fa620669e32e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:49.757072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5562a8-91bf-4ef5-ad76-afd84bf7f7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:49.764533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5562a8-91bf-4ef5-ad76-afd84bf7f7ac admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:49.764533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5562a8-91bf-4ef5-ad76-afd84bf7f7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:49.764533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5562a8-91bf-4ef5-ad76-afd84bf7f7ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:49.764533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5562a8-91bf-4ef5-ad76-afd84bf7f7ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:49.764533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5562a8-91bf-4ef5-ad76-afd84bf7f7ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:49.764533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5562a8-91bf-4ef5-ad76-afd84bf7f7ac admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:49.765033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa9877-ea01-41ff-862d-342783235973 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:49.772483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0e80d-9ffb-4ea7-b663-7ff86ba0de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:49.773189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0e80d-9ffb-4ea7-b663-7ff86ba0de90 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:49.773505 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0e80d-9ffb-4ea7-b663-7ff86ba0de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:49.773783 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0e80d-9ffb-4ea7-b663-7ff86ba0de90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:49.774477 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0e80d-9ffb-4ea7-b663-7ff86ba0de90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:49.775195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 987/2001] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:23:49.776654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0e80d-9ffb-4ea7-b663-7ff86ba0de90 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:49.779637 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5562a8-91bf-4ef5-ad76-afd84bf7f7ac admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:49.794705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:49.815161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5562a8-91bf-4ef5-ad76-afd84bf7f7ac admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:49.815161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd51eb-c43b-4f4a-8af5-658e96c4fb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:49.815161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd51eb-c43b-4f4a-8af5-658e96c4fb7f admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:49.815161 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd51eb-c43b-4f4a-8af5-658e96c4fb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:49.815436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd51eb-c43b-4f4a-8af5-658e96c4fb7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:49.815436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd51eb-c43b-4f4a-8af5-658e96c4fb7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:49.815436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd51eb-c43b-4f4a-8af5-658e96c4fb7f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:49.917848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1015/2002] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:49 2022] POST /identity/v3/projects => generated 363 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:23:49.921546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0e80d-9ffb-4ea7-b663-7ff86ba0de90 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:49.927270 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 988/2003] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:49 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:23:49.940421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd51eb-c43b-4f4a-8af5-658e96c4fb7f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:49.996259 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:50.013047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0e80d-9ffb-4ea7-b663-7ff86ba0de90 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:50.017711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9118a-48dd-4daa-baf5-87de3d33d6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:50.018389 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9118a-48dd-4daa-baf5-87de3d33d6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.018675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9118a-48dd-4daa-baf5-87de3d33d6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.018948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9118a-48dd-4daa-baf5-87de3d33d6e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.019638 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9118a-48dd-4daa-baf5-87de3d33d6e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:50.020083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd51eb-c43b-4f4a-8af5-658e96c4fb7f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:50.021586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9118a-48dd-4daa-baf5-87de3d33d6e4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:50.025286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c76a02-6a5f-44dd-bfa1-85f9a950e6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:50.025960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c76a02-6a5f-44dd-bfa1-85f9a950e6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.026279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c76a02-6a5f-44dd-bfa1-85f9a950e6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.026544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c76a02-6a5f-44dd-bfa1-85f9a950e6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.029941 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c76a02-6a5f-44dd-bfa1-85f9a950e6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:50.029941 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c76a02-6a5f-44dd-bfa1-85f9a950e6d0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:50.108222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1016/2004] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:49 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:50.111480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 989/2005] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:49 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:23:50.111804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9118a-48dd-4daa-baf5-87de3d33d6e4 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:50.115312 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c76a02-6a5f-44dd-bfa1-85f9a950e6d0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:50.122672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9118a-48dd-4daa-baf5-87de3d33d6e4 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:50.128169 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d8cb3-27b9-4099-9609-f04a8c706263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:50.128440 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c76a02-6a5f-44dd-bfa1-85f9a950e6d0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:50.128934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d8cb3-27b9-4099-9609-f04a8c706263 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.129260 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d8cb3-27b9-4099-9609-f04a8c706263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.129543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d8cb3-27b9-4099-9609-f04a8c706263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.130281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d8cb3-27b9-4099-9609-f04a8c706263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:50.131950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d8cb3-27b9-4099-9609-f04a8c706263 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:50.136530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb3a38-f191-49fd-b997-3b4d7f5f763c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:50.137379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb3a38-f191-49fd-b997-3b4d7f5f763c admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.137725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb3a38-f191-49fd-b997-3b4d7f5f763c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.138152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb3a38-f191-49fd-b997-3b4d7f5f763c admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.139246 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb3a38-f191-49fd-b997-3b4d7f5f763c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:50.141059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb3a38-f191-49fd-b997-3b4d7f5f763c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:50.143599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1017/2006] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:50.147852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d8cb3-27b9-4099-9609-f04a8c706263 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:50.159727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 990/2007] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:23:50.159904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d8cb3-27b9-4099-9609-f04a8c706263 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:50.160924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb3a38-f191-49fd-b997-3b4d7f5f763c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:50.165296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b012db5-80fc-4df3-bfa9-96b834d57914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:50.166842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b012db5-80fc-4df3-bfa9-96b834d57914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.167197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b012db5-80fc-4df3-bfa9-96b834d57914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.167548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b012db5-80fc-4df3-bfa9-96b834d57914 admin admin] PATH_INFO: `/v3/projects/cb4776b38f0947c294ec6b815eb64aef/users/517cfa87fa6d48ff9f98d63a476a4f99/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.171409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb3a38-f191-49fd-b997-3b4d7f5f763c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:50.176398 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bcadd-3bf5-477b-8bc4-32e9c84ecdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:50.177060 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bcadd-3bf5-477b-8bc4-32e9c84ecdcf admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.178480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bcadd-3bf5-477b-8bc4-32e9c84ecdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.178480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bcadd-3bf5-477b-8bc4-32e9c84ecdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.178480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bcadd-3bf5-477b-8bc4-32e9c84ecdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:50.180514 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bcadd-3bf5-477b-8bc4-32e9c84ecdcf admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:50.185107 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b012db5-80fc-4df3-bfa9-96b834d57914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4776b38f0947c294ec6b815eb64aef, user_id=517cfa87fa6d48ff9f98d63a476a4f99, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:50.187746 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b012db5-80fc-4df3-bfa9-96b834d57914 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:50.191416 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 991/2008] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:23:50.196238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bcadd-3bf5-477b-8bc4-32e9c84ecdcf admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:50.205676 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bcadd-3bf5-477b-8bc4-32e9c84ecdcf admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:50.210225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65863b-143a-4447-922b-523eb65c3da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:50.211151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65863b-143a-4447-922b-523eb65c3da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.211432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65863b-143a-4447-922b-523eb65c3da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.211702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65863b-143a-4447-922b-523eb65c3da5 admin admin] PATH_INFO: `/v3/projects/fcc69c14552d42e89bc415e8d3c5895e/users/5d49fc8388be41ef99370f4ba862e096/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.227023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65863b-143a-4447-922b-523eb65c3da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc69c14552d42e89bc415e8d3c5895e, user_id=5d49fc8388be41ef99370f4ba862e096, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:50.229796 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65863b-143a-4447-922b-523eb65c3da5 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:50.258649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1018/2009] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:50 2022] PUT /identity/v3/projects/cb4776b38f0947c294ec6b815eb64aef/users/517cfa87fa6d48ff9f98d63a476a4f99/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:50.262718 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b012db5-80fc-4df3-bfa9-96b834d57914 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:50.279767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:50.322106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 992/2010] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:50 2022] PUT /identity/v3/projects/fcc69c14552d42e89bc415e8d3c5895e/users/5d49fc8388be41ef99370f4ba862e096/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:50.322724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65863b-143a-4447-922b-523eb65c3da5 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:50.330684 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ae65863b-143a-4447-922b-523eb65c3da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:50.345857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b012db5-80fc-4df3-bfa9-96b834d57914 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:50.444791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba280402-4c20-4631-bcb3-5bd391b30819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:50.446318 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280402-4c20-4631-bcb3-5bd391b30819 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.446768 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280402-4c20-4631-bcb3-5bd391b30819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.447199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280402-4c20-4631-bcb3-5bd391b30819 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.448146 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba280402-4c20-4631-bcb3-5bd391b30819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:50.450191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba280402-4c20-4631-bcb3-5bd391b30819 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:50.459508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:50.460536 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65863b-143a-4447-922b-523eb65c3da5 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:50.465318 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1019/2011] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:23:50.466535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f3c7-2948-45fb-907f-a04d0467bb7c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.466829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f3c7-2948-45fb-907f-a04d0467bb7c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.467112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f3c7-2948-45fb-907f-a04d0467bb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.474413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef2e8f-710e-4cd8-b80f-abf629b93dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:50.475325 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef2e8f-710e-4cd8-b80f-abf629b93dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.475612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef2e8f-710e-4cd8-b80f-abf629b93dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.475893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef2e8f-710e-4cd8-b80f-abf629b93dc8 admin admin] PATH_INFO: `/v3/users/10ef5a2b7df847efa69c222a431f7eeb` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.478065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef2e8f-710e-4cd8-b80f-abf629b93dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ef5a2b7df847efa69c222a431f7eeb)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:50.480198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef2e8f-710e-4cd8-b80f-abf629b93dc8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:50.522485 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1157f3c7-2948-45fb-907f-a04d0467bb7c None None] MFA Rules not processed for user `5d49fc8388be41ef99370f4ba862e096`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:50.523883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1157f3c7-2948-45fb-907f-a04d0467bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:50.610297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1020/2012] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:50.610297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157f3c7-2948-45fb-907f-a04d0467bb7c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:50.620118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157f3c7-2948-45fb-907f-a04d0467bb7c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:50.644362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4ea8f-e092-4be2-b9c8-61bfa778b6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:50.644362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ea8f-e092-4be2-b9c8-61bfa778b6ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.644362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ea8f-e092-4be2-b9c8-61bfa778b6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.644362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ea8f-e092-4be2-b9c8-61bfa778b6ac admin admin] PATH_INFO: `/v3/projects/cb4776b38f0947c294ec6b815eb64aef/users/517cfa87fa6d48ff9f98d63a476a4f99/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.647494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4ea8f-e092-4be2-b9c8-61bfa778b6ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4776b38f0947c294ec6b815eb64aef, user_id=517cfa87fa6d48ff9f98d63a476a4f99, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:50.651048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4ea8f-e092-4be2-b9c8-61bfa778b6ac admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:50.665419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1021/2013] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:50 2022] PUT /identity/v3/projects/cb4776b38f0947c294ec6b815eb64aef/users/517cfa87fa6d48ff9f98d63a476a4f99/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:50.666513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4ea8f-e092-4be2-b9c8-61bfa778b6ac admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:50.713269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a1ef2e8f-710e-4cd8-b80f-abf629b93dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ef5a2b7df847efa69c222a431f7eeb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:50.730221 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a1ef2e8f-710e-4cd8-b80f-abf629b93dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ef5a2b7df847efa69c222a431f7eeb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:50.731845 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:50.733003 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a1ef2e8f-710e-4cd8-b80f-abf629b93dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ef5a2b7df847efa69c222a431f7eeb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:50.742639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4ea8f-e092-4be2-b9c8-61bfa778b6ac admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:50.748098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db882abc-50f9-433b-9680-22d374796339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:50.749001 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db882abc-50f9-433b-9680-22d374796339 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.749294 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db882abc-50f9-433b-9680-22d374796339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.749604 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db882abc-50f9-433b-9680-22d374796339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.750340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db882abc-50f9-433b-9680-22d374796339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:50.752416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db882abc-50f9-433b-9680-22d374796339 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:50.822372 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a1ef2e8f-710e-4cd8-b80f-abf629b93dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ef5a2b7df847efa69c222a431f7eeb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:50.823234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a1ef2e8f-710e-4cd8-b80f-abf629b93dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ef5a2b7df847efa69c222a431f7eeb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:50.836664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1022/2014] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:50 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:50.838256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe7431-1116-4b84-a4b4-3666310c462a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.838394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 993/2015] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:50 2022] DELETE /identity/v3/users/10ef5a2b7df847efa69c222a431f7eeb => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:50.839114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe7431-1116-4b84-a4b4-3666310c462a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.839406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe7431-1116-4b84-a4b4-3666310c462a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.840436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef2e8f-710e-4cd8-b80f-abf629b93dc8 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:50.842512 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a1ef2e8f-710e-4cd8-b80f-abf629b93dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:50.870682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-20fe7431-1116-4b84-a4b4-3666310c462a None None] MFA Rules not processed for user `517cfa87fa6d48ff9f98d63a476a4f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:50.872278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-20fe7431-1116-4b84-a4b4-3666310c462a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:50.879554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:50.924177 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef2e8f-710e-4cd8-b80f-abf629b93dc8 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:50.930041 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f90306-026b-4606-9a78-80135cd1a7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:50.930797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f90306-026b-4606-9a78-80135cd1a7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.931084 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f90306-026b-4606-9a78-80135cd1a7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.931549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f90306-026b-4606-9a78-80135cd1a7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.932088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f90306-026b-4606-9a78-80135cd1a7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:50.934318 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f90306-026b-4606-9a78-80135cd1a7b0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:50.954603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1023/2016] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:50.956050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf452e0d-78e9-4b1c-8d1e-77104c8db28a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:50.956347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf452e0d-78e9-4b1c-8d1e-77104c8db28a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:50.956685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf452e0d-78e9-4b1c-8d1e-77104c8db28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:50.977044 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-cf452e0d-78e9-4b1c-8d1e-77104c8db28a None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:50.978260 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cf452e0d-78e9-4b1c-8d1e-77104c8db28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:50.989208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1024/2017] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:50.989208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf452e0d-78e9-4b1c-8d1e-77104c8db28a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:50.989208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cf452e0d-78e9-4b1c-8d1e-77104c8db28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:51.029188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:51.037647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 994/2018] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:50 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:51.038163 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f90306-026b-4606-9a78-80135cd1a7b0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:51.039957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-57f90306-026b-4606-9a78-80135cd1a7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:51.050457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf452e0d-78e9-4b1c-8d1e-77104c8db28a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:51.055724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd2e7e-865a-43ad-b445-9682aa35b41b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:51.056431 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd2e7e-865a-43ad-b445-9682aa35b41b service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:51.056716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd2e7e-865a-43ad-b445-9682aa35b41b service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:51.057458 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd2e7e-865a-43ad-b445-9682aa35b41b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:51.068290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd2e7e-865a-43ad-b445-9682aa35b41b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:51.069734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd2e7e-865a-43ad-b445-9682aa35b41b service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:51.080208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1025/2019] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:50 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:51.080852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd2e7e-865a-43ad-b445-9682aa35b41b service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:51.091127 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd2e7e-865a-43ad-b445-9682aa35b41b service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:51.096616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a83b6-f5ef-4010-92e6-ed09be5d7da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:51.097275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a83b6-f5ef-4010-92e6-ed09be5d7da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:51.097718 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a83b6-f5ef-4010-92e6-ed09be5d7da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:51.098003 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a83b6-f5ef-4010-92e6-ed09be5d7da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:51.098731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a83b6-f5ef-4010-92e6-ed09be5d7da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:51.100867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a83b6-f5ef-4010-92e6-ed09be5d7da4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:51.109822 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f90306-026b-4606-9a78-80135cd1a7b0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:51.116409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1026/2020] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:51.116526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9ca9c-7291-4b98-85ca-fd725167a9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:51.116526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9ca9c-7291-4b98-85ca-fd725167a9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:51.116526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9ca9c-7291-4b98-85ca-fd725167a9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:51.116526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9ca9c-7291-4b98-85ca-fd725167a9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:51.117886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a83b6-f5ef-4010-92e6-ed09be5d7da4 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:51.125396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9ca9c-7291-4b98-85ca-fd725167a9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:51.126845 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9ca9c-7291-4b98-85ca-fd725167a9d4 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:51.127196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a83b6-f5ef-4010-92e6-ed09be5d7da4 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:51.132101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e25e59-7a55-4b99-abee-68c1febc8dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:51.133575 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e25e59-7a55-4b99-abee-68c1febc8dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:51.133892 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e25e59-7a55-4b99-abee-68c1febc8dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:51.134336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e25e59-7a55-4b99-abee-68c1febc8dcc admin admin] PATH_INFO: `/v3/projects/6515b0424abe4646bac91fdd6150a7d2/users/be1d9afc8f4845809ca08be5be81dd67/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:51.140869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 995/2021] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:51.150451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e25e59-7a55-4b99-abee-68c1febc8dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6515b0424abe4646bac91fdd6150a7d2, user_id=be1d9afc8f4845809ca08be5be81dd67, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:51.153840 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e25e59-7a55-4b99-abee-68c1febc8dcc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:51.222402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:51.232102 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1027/2022] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:51 2022] PUT /identity/v3/projects/6515b0424abe4646bac91fdd6150a7d2/users/be1d9afc8f4845809ca08be5be81dd67/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:51.240760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9ca9c-7291-4b98-85ca-fd725167a9d4 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:51.274028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9ca9c-7291-4b98-85ca-fd725167a9d4 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:51.358901 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf819d4-dd99-4caf-aba2-a892cbc6a914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:51.359595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf819d4-dd99-4caf-aba2-a892cbc6a914 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:51.359878 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf819d4-dd99-4caf-aba2-a892cbc6a914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:51.360184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf819d4-dd99-4caf-aba2-a892cbc6a914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:51.361083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf819d4-dd99-4caf-aba2-a892cbc6a914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:51.361441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e25e59-7a55-4b99-abee-68c1febc8dcc admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:51.362727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf819d4-dd99-4caf-aba2-a892cbc6a914 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:51.375163 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 996/2023] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:51.379105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf819d4-dd99-4caf-aba2-a892cbc6a914 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:51.412981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf819d4-dd99-4caf-aba2-a892cbc6a914 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:51.419743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c98b8-4ff8-4a4b-9987-1efb610f6f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:51.420757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c98b8-4ff8-4a4b-9987-1efb610f6f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:51.421099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c98b8-4ff8-4a4b-9987-1efb610f6f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:51.421466 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c98b8-4ff8-4a4b-9987-1efb610f6f4c admin admin] PATH_INFO: `/v3/projects/6515b0424abe4646bac91fdd6150a7d2/users/be1d9afc8f4845809ca08be5be81dd67/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:51.424447 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c98b8-4ff8-4a4b-9987-1efb610f6f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6515b0424abe4646bac91fdd6150a7d2, user_id=be1d9afc8f4845809ca08be5be81dd67, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:51.427783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c98b8-4ff8-4a4b-9987-1efb610f6f4c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:51.447448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 997/2024] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:51 2022] PUT /identity/v3/projects/6515b0424abe4646bac91fdd6150a7d2/users/be1d9afc8f4845809ca08be5be81dd67/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:51.451461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e25e59-7a55-4b99-abee-68c1febc8dcc admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:51.457941 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d227c74-1fdc-44ef-87e2-bfc67850d8ff None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:51.458549 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d227c74-1fdc-44ef-87e2-bfc67850d8ff None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:51.458884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d227c74-1fdc-44ef-87e2-bfc67850d8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:51.486823 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:51.489687 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8d227c74-1fdc-44ef-87e2-bfc67850d8ff None None] MFA Rules not processed for user `be1d9afc8f4845809ca08be5be81dd67`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:51.491232 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8d227c74-1fdc-44ef-87e2-bfc67850d8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:51.526700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19692d79-e5fa-4c8d-b405-a547138517e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:51.527407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692d79-e5fa-4c8d-b405-a547138517e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:51.527654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692d79-e5fa-4c8d-b405-a547138517e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:51.527929 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692d79-e5fa-4c8d-b405-a547138517e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:51.530158 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-19692d79-e5fa-4c8d-b405-a547138517e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:51.570901 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 998/2025] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:51.576069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:51.606302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19692d79-e5fa-4c8d-b405-a547138517e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:51.607792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19692d79-e5fa-4c8d-b405-a547138517e5 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:51.616767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1028/2026] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:51 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:23:51.693458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d227c74-1fdc-44ef-87e2-bfc67850d8ff None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:51.695050 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8d227c74-1fdc-44ef-87e2-bfc67850d8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:51.704424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19692d79-e5fa-4c8d-b405-a547138517e5 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:51.708357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-19692d79-e5fa-4c8d-b405-a547138517e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:51.725590 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19692d79-e5fa-4c8d-b405-a547138517e5 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:51.731479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dbcba-924f-41ee-b851-4d6ac6fb9b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:51.732360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dbcba-924f-41ee-b851-4d6ac6fb9b7a service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:51.732662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dbcba-924f-41ee-b851-4d6ac6fb9b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:51.733046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dbcba-924f-41ee-b851-4d6ac6fb9b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:51.745856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dbcba-924f-41ee-b851-4d6ac6fb9b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:51.747580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dbcba-924f-41ee-b851-4d6ac6fb9b7a service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:51.772890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1029/2027] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:51.810319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d227c74-1fdc-44ef-87e2-bfc67850d8ff None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:51.815854 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:51.816810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:51.817156 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:51.817437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] PATH_INFO: `/v3/projects/17af478b064a4f9c852e620667b6423f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:51.819320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=17af478b064a4f9c852e620667b6423f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:51.823645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:52.037731 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17af478b064a4f9c852e620667b6423f', 'request_id': 'req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.102107 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17af478b064a4f9c852e620667b6423f', 'request_id': 'req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.109076 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17af478b064a4f9c852e620667b6423f', 'request_id': 'req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.123267 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] The token cache is being invalidate because project 17af478b064a4f9c852e620667b6423f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:52.123695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.124390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.126034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 999/2028] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:51 2022] DELETE /identity/v3/projects/17af478b064a4f9c852e620667b6423f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:52.129934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dbcba-924f-41ee-b851-4d6ac6fb9b7a service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:52.141148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dbcba-924f-41ee-b851-4d6ac6fb9b7a service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:52.203174 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e32e6-06e1-47de-a45f-7fa12ebd9c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:52.204088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e32e6-06e1-47de-a45f-7fa12ebd9c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:52.204370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e32e6-06e1-47de-a45f-7fa12ebd9c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:52.204642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e32e6-06e1-47de-a45f-7fa12ebd9c54 admin admin] PATH_INFO: `/v3/users/c56811f3eee1441aa256332ffa7a70f3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:52.205829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e32e6-06e1-47de-a45f-7fa12ebd9c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56811f3eee1441aa256332ffa7a70f3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:52.207914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e32e6-06e1-47de-a45f-7fa12ebd9c54 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:52.295782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:52.401275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f14e32e6-06e1-47de-a45f-7fa12ebd9c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56811f3eee1441aa256332ffa7a70f3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.412879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f14e32e6-06e1-47de-a45f-7fa12ebd9c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56811f3eee1441aa256332ffa7a70f3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.490646 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f14e32e6-06e1-47de-a45f-7fa12ebd9c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56811f3eee1441aa256332ffa7a70f3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.491265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f14e32e6-06e1-47de-a45f-7fa12ebd9c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56811f3eee1441aa256332ffa7a70f3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.498919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f14e32e6-06e1-47de-a45f-7fa12ebd9c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56811f3eee1441aa256332ffa7a70f3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.504984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1030/2029] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:52 2022] DELETE /identity/v3/users/c56811f3eee1441aa256332ffa7a70f3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:52.510704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:52.512131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:52.526051 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8c50a-e798-4b05-8ac1-06dd34be79ef admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:52.582000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:52.605622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23679b-f5cf-481e-bb04-597c85de7c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:52.606515 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23679b-f5cf-481e-bb04-597c85de7c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:52.606798 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23679b-f5cf-481e-bb04-597c85de7c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:52.607074 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23679b-f5cf-481e-bb04-597c85de7c1c admin admin] PATH_INFO: `/v3/users/5d49fc8388be41ef99370f4ba862e096` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:52.608304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23679b-f5cf-481e-bb04-597c85de7c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d49fc8388be41ef99370f4ba862e096)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:52.610333 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23679b-f5cf-481e-bb04-597c85de7c1c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:52.681804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e32e6-06e1-47de-a45f-7fa12ebd9c54 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:52.683637 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f14e32e6-06e1-47de-a45f-7fa12ebd9c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:52.711250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e32e6-06e1-47de-a45f-7fa12ebd9c54 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:52.718719 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360f5d7-4817-43b6-882c-6ae8efff5d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:52.719616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360f5d7-4817-43b6-882c-6ae8efff5d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:52.719896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360f5d7-4817-43b6-882c-6ae8efff5d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:52.722999 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360f5d7-4817-43b6-882c-6ae8efff5d19 admin admin] PATH_INFO: `/v3/users/ac2f28bd87c44f67bdbdd1bc26aed81a` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:52.725416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360f5d7-4817-43b6-882c-6ae8efff5d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2f28bd87c44f67bdbdd1bc26aed81a)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:52.727786 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360f5d7-4817-43b6-882c-6ae8efff5d19 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:52.843640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-bb23679b-f5cf-481e-bb04-597c85de7c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d49fc8388be41ef99370f4ba862e096'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.859429 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-bb23679b-f5cf-481e-bb04-597c85de7c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d49fc8388be41ef99370f4ba862e096'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.860201 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-bb23679b-f5cf-481e-bb04-597c85de7c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d49fc8388be41ef99370f4ba862e096'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.871391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:52.977233 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-bb23679b-f5cf-481e-bb04-597c85de7c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d49fc8388be41ef99370f4ba862e096'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.977987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-bb23679b-f5cf-481e-bb04-597c85de7c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d49fc8388be41ef99370f4ba862e096'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.993310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b360f5d7-4817-43b6-882c-6ae8efff5d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2f28bd87c44f67bdbdd1bc26aed81a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:52.996473 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1000/2030] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:52 2022] DELETE /identity/v3/users/5d49fc8388be41ef99370f4ba862e096 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:52.997350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23679b-f5cf-481e-bb04-597c85de7c1c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:52.998768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bb23679b-f5cf-481e-bb04-597c85de7c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:53.009014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b360f5d7-4817-43b6-882c-6ae8efff5d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2f28bd87c44f67bdbdd1bc26aed81a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:53.075607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23679b-f5cf-481e-bb04-597c85de7c1c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:53.080544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:53.081444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:53.081733 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:53.082015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] PATH_INFO: `/v3/projects/4902d46d9ca2461796903646941f6609` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:53.083385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4902d46d9ca2461796903646941f6609)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:53.085436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:53.086103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b360f5d7-4817-43b6-882c-6ae8efff5d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2f28bd87c44f67bdbdd1bc26aed81a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:53.086809 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b360f5d7-4817-43b6-882c-6ae8efff5d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2f28bd87c44f67bdbdd1bc26aed81a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:53.094345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b360f5d7-4817-43b6-882c-6ae8efff5d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2f28bd87c44f67bdbdd1bc26aed81a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:53.100677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1031/2031] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:52 2022] DELETE /identity/v3/users/ac2f28bd87c44f67bdbdd1bc26aed81a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:53.102970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3c914-0cc5-4d1b-94aa-54ad39848dcc None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:53.103449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3c914-0cc5-4d1b-94aa-54ad39848dcc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:53.103726 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3c914-0cc5-4d1b-94aa-54ad39848dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:53.123380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-47f3c914-0cc5-4d1b-94aa-54ad39848dcc None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:53.124624 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-47f3c914-0cc5-4d1b-94aa-54ad39848dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:53.192843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1032/2032] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:53.196532 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59302700-616f-4784-89f4-114d296cd80e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:53.196828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59302700-616f-4784-89f4-114d296cd80e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:53.197229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59302700-616f-4784-89f4-114d296cd80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:53.216075 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-59302700-616f-4784-89f4-114d296cd80e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:53.219075 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-59302700-616f-4784-89f4-114d296cd80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:53.219762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4902d46d9ca2461796903646941f6609', 'request_id': 'req-68f8eef6-556e-4fab-8df7-dee2752bcd44'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:53.295866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1033/2033] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:53.295866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59302700-616f-4784-89f4-114d296cd80e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:53.295866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-59302700-616f-4784-89f4-114d296cd80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:53.314610 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4902d46d9ca2461796903646941f6609', 'request_id': 'req-68f8eef6-556e-4fab-8df7-dee2752bcd44'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:53.322898 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4902d46d9ca2461796903646941f6609', 'request_id': 'req-68f8eef6-556e-4fab-8df7-dee2752bcd44'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:53.336550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] The token cache is being invalidate because project 4902d46d9ca2461796903646941f6609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:53.336846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:53.337854 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:53.339315 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1001/2034] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:52 2022] DELETE /identity/v3/projects/4902d46d9ca2461796903646941f6609 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:53.340137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:53.341460 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:53.366600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59302700-616f-4784-89f4-114d296cd80e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:53.377349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e333be1-47a4-487a-8113-230034fc0896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:53.378023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e333be1-47a4-487a-8113-230034fc0896 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:53.378312 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e333be1-47a4-487a-8113-230034fc0896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:53.378586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e333be1-47a4-487a-8113-230034fc0896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:53.380936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3e333be1-47a4-487a-8113-230034fc0896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:53.394903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e333be1-47a4-487a-8113-230034fc0896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:53.396668 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e333be1-47a4-487a-8113-230034fc0896 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:53.402614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8eef6-556e-4fab-8df7-dee2752bcd44 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:53.407427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682908f7-f075-4fd2-a9c2-997439c1e3df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:53.407427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682908f7-f075-4fd2-a9c2-997439c1e3df service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:53.407629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1034/2035] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:53.408115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682908f7-f075-4fd2-a9c2-997439c1e3df service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:53.408115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682908f7-f075-4fd2-a9c2-997439c1e3df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:53.409216 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-682908f7-f075-4fd2-a9c2-997439c1e3df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:53.418046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a9827-c6a3-4adb-8073-0d7148c0eb3d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:53.418636 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a9827-c6a3-4adb-8073-0d7148c0eb3d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:53.419123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a9827-c6a3-4adb-8073-0d7148c0eb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:53.422683 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682908f7-f075-4fd2-a9c2-997439c1e3df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:53.424169 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682908f7-f075-4fd2-a9c2-997439c1e3df service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:53.435691 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1002/2036] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:53.450395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-423a9827-c6a3-4adb-8073-0d7148c0eb3d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:53.452964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:53.454017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-423a9827-c6a3-4adb-8073-0d7148c0eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:53.465649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1035/2037] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:53.473801 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cf585-9c02-4778-9cbf-6edaf61041c6 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:53.474095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cf585-9c02-4778-9cbf-6edaf61041c6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:53.474401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cf585-9c02-4778-9cbf-6edaf61041c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:53.498975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-948cf585-9c02-4778-9cbf-6edaf61041c6 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:53.501395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-948cf585-9c02-4778-9cbf-6edaf61041c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:53.513134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1003/2038] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:53.517668 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a9827-c6a3-4adb-8073-0d7148c0eb3d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:53.541919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a9827-c6a3-4adb-8073-0d7148c0eb3d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:53.547560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b3cb7-8e0e-4429-9a17-1a9e76e5b82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:53.548582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b3cb7-8e0e-4429-9a17-1a9e76e5b82a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:53.548975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b3cb7-8e0e-4429-9a17-1a9e76e5b82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:53.549350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b3cb7-8e0e-4429-9a17-1a9e76e5b82a admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:53.550732 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b3cb7-8e0e-4429-9a17-1a9e76e5b82a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:53.551050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b3cb7-8e0e-4429-9a17-1a9e76e5b82a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:53.552836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b3cb7-8e0e-4429-9a17-1a9e76e5b82a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:53.568940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1036/2039] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:23:53.579118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cf585-9c02-4778-9cbf-6edaf61041c6 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:53.589863 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cf585-9c02-4778-9cbf-6edaf61041c6 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:53.594789 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3d228-f591-4153-bfef-daabbc5648d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:53.596035 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3d228-f591-4153-bfef-daabbc5648d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:53.596035 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3d228-f591-4153-bfef-daabbc5648d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:53.596319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3d228-f591-4153-bfef-daabbc5648d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:53.596820 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3d228-f591-4153-bfef-daabbc5648d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:53.598819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3d228-f591-4153-bfef-daabbc5648d2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:53.991238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1004/2040] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:53 2022] POST /identity/v3/projects => generated 375 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:53.994638 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b3cb7-8e0e-4429-9a17-1a9e76e5b82a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:54.012157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b3cb7-8e0e-4429-9a17-1a9e76e5b82a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:54.209047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd804ed9-14f7-4fe5-9428-419652a8602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:54.209047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd804ed9-14f7-4fe5-9428-419652a8602b admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:54.209047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd804ed9-14f7-4fe5-9428-419652a8602b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:54.209047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd804ed9-14f7-4fe5-9428-419652a8602b admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:54.211796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd804ed9-14f7-4fe5-9428-419652a8602b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:54.211796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd804ed9-14f7-4fe5-9428-419652a8602b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:54.557828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1037/2041] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:53 2022] POST /identity/v3/users => generated 288 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:54.560770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3d228-f591-4153-bfef-daabbc5648d2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:54.571847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3d228-f591-4153-bfef-daabbc5648d2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:54.586539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7771c1-1787-487c-ad85-03f0956adb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:54.586675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd804ed9-14f7-4fe5-9428-419652a8602b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:54.586780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7771c1-1787-487c-ad85-03f0956adb13 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:54.586780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7771c1-1787-487c-ad85-03f0956adb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:54.586780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7771c1-1787-487c-ad85-03f0956adb13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:54.586780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7771c1-1787-487c-ad85-03f0956adb13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:54.587496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-dd804ed9-14f7-4fe5-9428-419652a8602b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:54.588596 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7771c1-1787-487c-ad85-03f0956adb13 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:54.615587 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd804ed9-14f7-4fe5-9428-419652a8602b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:54.622665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:54.623541 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1005/2042] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:54.624178 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:54.624669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7771c1-1787-487c-ad85-03f0956adb13 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:54.624870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:54.625314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] PATH_INFO: `/v3/projects/fcc69c14552d42e89bc415e8d3c5895e` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:54.627192 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc69c14552d42e89bc415e8d3c5895e)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:54.627379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6e7771c1-1787-487c-ad85-03f0956adb13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:54.631223 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:54.642416 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7771c1-1787-487c-ad85-03f0956adb13 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:54.655777 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:54.656949 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:54.657241 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:54.657520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] PATH_INFO: `/v3/projects/eb20eb1cee1f410487b573ce7b6282fb` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:54.659054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb20eb1cee1f410487b573ce7b6282fb)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:54.661170 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:54.785062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb20eb1cee1f410487b573ce7b6282fb', 'request_id': 'req-f3913e26-5704-4eec-9537-53b71f29b891'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:54.797685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc69c14552d42e89bc415e8d3c5895e', 'request_id': 'req-51dc45b0-ad48-4eff-8129-eb037b1d212e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:54.907067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb20eb1cee1f410487b573ce7b6282fb', 'request_id': 'req-f3913e26-5704-4eec-9537-53b71f29b891'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:54.913113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb20eb1cee1f410487b573ce7b6282fb', 'request_id': 'req-f3913e26-5704-4eec-9537-53b71f29b891'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:54.925122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] The token cache is being invalidate because project eb20eb1cee1f410487b573ce7b6282fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:54.925757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:54.926088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:54.927655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1006/2043] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:54 2022] DELETE /identity/v3/projects/eb20eb1cee1f410487b573ce7b6282fb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:54.928540 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:54.930400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:54.975704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc69c14552d42e89bc415e8d3c5895e', 'request_id': 'req-51dc45b0-ad48-4eff-8129-eb037b1d212e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:54.982527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc69c14552d42e89bc415e8d3c5895e', 'request_id': 'req-51dc45b0-ad48-4eff-8129-eb037b1d212e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:54.994597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] The token cache is being invalidate because project fcc69c14552d42e89bc415e8d3c5895e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:54.994898 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:54.995577 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:54.995692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3913e26-5704-4eec-9537-53b71f29b891 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:54.997223 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1038/2044] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:54 2022] DELETE /identity/v3/projects/fcc69c14552d42e89bc415e8d3c5895e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:54.998104 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:54.999404 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:55.025674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:55.064297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc45b0-ad48-4eff-8129-eb037b1d212e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:55.067219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5fb98-7281-41a5-84b5-71da7f9b21ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:55.067900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5fb98-7281-41a5-84b5-71da7f9b21ed admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:55.068214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5fb98-7281-41a5-84b5-71da7f9b21ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:55.068493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5fb98-7281-41a5-84b5-71da7f9b21ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:55.069455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e7376-f18b-4c77-afe7-95a4d0dc9191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:55.069574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5fb98-7281-41a5-84b5-71da7f9b21ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:55.070157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e7376-f18b-4c77-afe7-95a4d0dc9191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:55.070443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e7376-f18b-4c77-afe7-95a4d0dc9191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:55.070723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e7376-f18b-4c77-afe7-95a4d0dc9191 admin admin] PATH_INFO: `/v3/users/a451d939cd93494e98c31997a68790fa` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:55.071174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5fb98-7281-41a5-84b5-71da7f9b21ed admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:55.071933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e7376-f18b-4c77-afe7-95a4d0dc9191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a451d939cd93494e98c31997a68790fa)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:55.073896 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e7376-f18b-4c77-afe7-95a4d0dc9191 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:55.081537 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1007/2045] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:55.082270 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5fb98-7281-41a5-84b5-71da7f9b21ed admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:55.085946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b2b5fb98-7281-41a5-84b5-71da7f9b21ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:55.097980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5fb98-7281-41a5-84b5-71da7f9b21ed admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:55.103500 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa289f-bf1d-46b8-860a-b845a2955b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:55.104403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa289f-bf1d-46b8-860a-b845a2955b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:55.104683 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa289f-bf1d-46b8-860a-b845a2955b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:55.104954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa289f-bf1d-46b8-860a-b845a2955b70 admin admin] PATH_INFO: `/v3/users/be1d9afc8f4845809ca08be5be81dd67` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:55.106142 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa289f-bf1d-46b8-860a-b845a2955b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1d9afc8f4845809ca08be5be81dd67)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:55.108110 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa289f-bf1d-46b8-860a-b845a2955b70 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:55.158539 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:55.217947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d84e7376-f18b-4c77-afe7-95a4d0dc9191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a451d939cd93494e98c31997a68790fa'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:55.230656 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d84e7376-f18b-4c77-afe7-95a4d0dc9191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a451d939cd93494e98c31997a68790fa'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:55.268567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-43fa289f-bf1d-46b8-860a-b845a2955b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1d9afc8f4845809ca08be5be81dd67'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:55.280926 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-43fa289f-bf1d-46b8-860a-b845a2955b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1d9afc8f4845809ca08be5be81dd67'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:55.281614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-43fa289f-bf1d-46b8-860a-b845a2955b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1d9afc8f4845809ca08be5be81dd67'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:55.323185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d84e7376-f18b-4c77-afe7-95a4d0dc9191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a451d939cd93494e98c31997a68790fa'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:55.323776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d84e7376-f18b-4c77-afe7-95a4d0dc9191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a451d939cd93494e98c31997a68790fa'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:55.332898 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d84e7376-f18b-4c77-afe7-95a4d0dc9191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a451d939cd93494e98c31997a68790fa'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:55.338827 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1039/2046] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:54 2022] DELETE /identity/v3/users/a451d939cd93494e98c31997a68790fa => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:55.339646 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e7376-f18b-4c77-afe7-95a4d0dc9191 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:55.341008 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d84e7376-f18b-4c77-afe7-95a4d0dc9191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:55.398946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-43fa289f-bf1d-46b8-860a-b845a2955b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1d9afc8f4845809ca08be5be81dd67'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:55.400779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-43fa289f-bf1d-46b8-860a-b845a2955b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1d9afc8f4845809ca08be5be81dd67'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:55.421547 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e7376-f18b-4c77-afe7-95a4d0dc9191 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:55.422034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1008/2047] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:55 2022] DELETE /identity/v3/users/be1d9afc8f4845809ca08be5be81dd67 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:55.495586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e3804-4898-4f1a-a3b6-9a20c0ee86c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:55.496528 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e3804-4898-4f1a-a3b6-9a20c0ee86c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:55.496811 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e3804-4898-4f1a-a3b6-9a20c0ee86c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:55.497087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e3804-4898-4f1a-a3b6-9a20c0ee86c8 admin admin] PATH_INFO: `/v3/projects/6bfbbcf73ddf4f729947ed2a8f0ea421/users/2fd09590244c48da923d89139399c113/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:55.512710 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e3804-4898-4f1a-a3b6-9a20c0ee86c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfbbcf73ddf4f729947ed2a8f0ea421, user_id=2fd09590244c48da923d89139399c113, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:55.515494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e3804-4898-4f1a-a3b6-9a20c0ee86c8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:55.609222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1040/2048] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:55 2022] PUT /identity/v3/projects/6bfbbcf73ddf4f729947ed2a8f0ea421/users/2fd09590244c48da923d89139399c113/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:55.618972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920b80a-dc5b-454a-bb63-d0a8d0389007 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:55.619821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920b80a-dc5b-454a-bb63-d0a8d0389007 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:55.620131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920b80a-dc5b-454a-bb63-d0a8d0389007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:55.649316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1920b80a-dc5b-454a-bb63-d0a8d0389007 None None] MFA Rules not processed for user `2fd09590244c48da923d89139399c113`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:55.650546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1920b80a-dc5b-454a-bb63-d0a8d0389007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:55.734839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1009/2049] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:55.740064 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e3804-4898-4f1a-a3b6-9a20c0ee86c8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:55.822091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e3804-4898-4f1a-a3b6-9a20c0ee86c8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:55.826002 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ad91b-cbd4-45be-bd73-689af1fc292b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:55.826725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ad91b-cbd4-45be-bd73-689af1fc292b admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:55.827034 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ad91b-cbd4-45be-bd73-689af1fc292b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:55.827342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ad91b-cbd4-45be-bd73-689af1fc292b admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:55.828182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ad91b-cbd4-45be-bd73-689af1fc292b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:55.830573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ad91b-cbd4-45be-bd73-689af1fc292b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:55.903442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920b80a-dc5b-454a-bb63-d0a8d0389007 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:55.904904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1920b80a-dc5b-454a-bb63-d0a8d0389007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:55.932755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920b80a-dc5b-454a-bb63-d0a8d0389007 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:55.942620 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:55.944521 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:55.944843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:55.945216 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] PATH_INFO: `/v3/projects/95fd16b7dfa24e6ab9ced34f63007f63` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:55.948424 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=95fd16b7dfa24e6ab9ced34f63007f63)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:55.950637 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:55.956178 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1041/2050] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:55 2022] POST /identity/v3/projects => generated 373 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:55.960385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ad91b-cbd4-45be-bd73-689af1fc292b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:55.962724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-279ad91b-cbd4-45be-bd73-689af1fc292b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:56.043357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ad91b-cbd4-45be-bd73-689af1fc292b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:56.051642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227d961-a640-4dab-b34b-38454c37c250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:56.051642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227d961-a640-4dab-b34b-38454c37c250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:56.051642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227d961-a640-4dab-b34b-38454c37c250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:56.051642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227d961-a640-4dab-b34b-38454c37c250 admin admin] PATH_INFO: `/v3/projects/6515b0424abe4646bac91fdd6150a7d2` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:56.052076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227d961-a640-4dab-b34b-38454c37c250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6515b0424abe4646bac91fdd6150a7d2)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:56.053074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227d961-a640-4dab-b34b-38454c37c250 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:56.086136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:56.095342 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95fd16b7dfa24e6ab9ced34f63007f63', 'request_id': 'req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:56.178651 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95fd16b7dfa24e6ab9ced34f63007f63', 'request_id': 'req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:56.188484 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95fd16b7dfa24e6ab9ced34f63007f63', 'request_id': 'req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:56.203103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1227d961-a640-4dab-b34b-38454c37c250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6515b0424abe4646bac91fdd6150a7d2', 'request_id': 'req-1227d961-a640-4dab-b34b-38454c37c250'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:56.206546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] The token cache is being invalidate because project 95fd16b7dfa24e6ab9ced34f63007f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:56.206849 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:56.208660 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:56.213159 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1010/2051] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:55 2022] DELETE /identity/v3/projects/95fd16b7dfa24e6ab9ced34f63007f63 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:56.216264 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:56.234841 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:56.268335 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1227d961-a640-4dab-b34b-38454c37c250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6515b0424abe4646bac91fdd6150a7d2', 'request_id': 'req-1227d961-a640-4dab-b34b-38454c37c250'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:56.280914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1227d961-a640-4dab-b34b-38454c37c250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6515b0424abe4646bac91fdd6150a7d2', 'request_id': 'req-1227d961-a640-4dab-b34b-38454c37c250'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:56.295707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e5d31-7cb1-46e8-a5f4-e9a47edf1e2f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:56.298918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1227d961-a640-4dab-b34b-38454c37c250 admin admin] The token cache is being invalidate because project 6515b0424abe4646bac91fdd6150a7d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:23:56.299247 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1227d961-a640-4dab-b34b-38454c37c250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:56.303019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:56.305098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1227d961-a640-4dab-b34b-38454c37c250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:56.307693 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1042/2052] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:55 2022] DELETE /identity/v3/projects/6515b0424abe4646bac91fdd6150a7d2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:23:56.309239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef0e99-c09e-4734-8f23-7bb217d0bf89 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:56.309885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef0e99-c09e-4734-8f23-7bb217d0bf89 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:56.309885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef0e99-c09e-4734-8f23-7bb217d0bf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:56.333861 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-89ef0e99-c09e-4734-8f23-7bb217d0bf89 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:56.335132 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-89ef0e99-c09e-4734-8f23-7bb217d0bf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:56.363059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a202bd-544e-451b-b55c-5ac1f08c1cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:56.363747 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a202bd-544e-451b-b55c-5ac1f08c1cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:56.364065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a202bd-544e-451b-b55c-5ac1f08c1cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:56.364358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a202bd-544e-451b-b55c-5ac1f08c1cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:56.365061 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a202bd-544e-451b-b55c-5ac1f08c1cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:56.367570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a202bd-544e-451b-b55c-5ac1f08c1cc4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:56.402448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1043/2053] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:56.408835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be13d9-3311-4c23-b2e9-effcdc599747 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:56.408835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be13d9-3311-4c23-b2e9-effcdc599747 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:56.409108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be13d9-3311-4c23-b2e9-effcdc599747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:56.427344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-49be13d9-3311-4c23-b2e9-effcdc599747 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:56.428589 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-49be13d9-3311-4c23-b2e9-effcdc599747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:56.437285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1044/2054] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:56.438621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f990a-913b-4a1c-a972-caa11c0f4312 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:56.438949 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f990a-913b-4a1c-a972-caa11c0f4312 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:56.439234 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f990a-913b-4a1c-a972-caa11c0f4312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:56.462318 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-737f990a-913b-4a1c-a972-caa11c0f4312 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:56.463529 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-737f990a-913b-4a1c-a972-caa11c0f4312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:56.471550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1045/2055] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:56.472997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8c41d-334b-42cd-a1ba-1db1416c0a56 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:56.473288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8c41d-334b-42cd-a1ba-1db1416c0a56 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:56.473567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8c41d-334b-42cd-a1ba-1db1416c0a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:56.485276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1011/2056] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:56 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:56.488689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a202bd-544e-451b-b55c-5ac1f08c1cc4 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:56.495344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a9f8c41d-334b-42cd-a1ba-1db1416c0a56 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:56.496584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a9f8c41d-334b-42cd-a1ba-1db1416c0a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:56.497891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a202bd-544e-451b-b55c-5ac1f08c1cc4 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:56.502976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba4a46-8300-47f5-9e07-cd7efb9dba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:56.503775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba4a46-8300-47f5-9e07-cd7efb9dba77 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:56.504102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba4a46-8300-47f5-9e07-cd7efb9dba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:56.504392 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba4a46-8300-47f5-9e07-cd7efb9dba77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:56.505015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1046/2057] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:56.506132 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8c41d-334b-42cd-a1ba-1db1416c0a56 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:56.509724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a9f8c41d-334b-42cd-a1ba-1db1416c0a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:56.510853 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba4a46-8300-47f5-9e07-cd7efb9dba77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:56.511215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba4a46-8300-47f5-9e07-cd7efb9dba77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:56.518655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba4a46-8300-47f5-9e07-cd7efb9dba77 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:56.523306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8c41d-334b-42cd-a1ba-1db1416c0a56 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:56.530834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1012/2058] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:23:56.530834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba4a46-8300-47f5-9e07-cd7efb9dba77 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:56.533795 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda86504-3341-493b-8705-8ed2e6c24361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:56.534490 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda86504-3341-493b-8705-8ed2e6c24361 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:56.534767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda86504-3341-493b-8705-8ed2e6c24361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:56.535043 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda86504-3341-493b-8705-8ed2e6c24361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:56.535777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda86504-3341-493b-8705-8ed2e6c24361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:56.537553 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda86504-3341-493b-8705-8ed2e6c24361 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:56.548810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba4a46-8300-47f5-9e07-cd7efb9dba77 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:56.550933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1047/2059] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:56.551846 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda86504-3341-493b-8705-8ed2e6c24361 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:56.555690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e4659-ea10-403b-afbc-565fcd0d62cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:56.556984 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e4659-ea10-403b-afbc-565fcd0d62cd admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:56.557276 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e4659-ea10-403b-afbc-565fcd0d62cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:56.557560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e4659-ea10-403b-afbc-565fcd0d62cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:56.559428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e4659-ea10-403b-afbc-565fcd0d62cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:23:56.559749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e4659-ea10-403b-afbc-565fcd0d62cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:56.563257 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e4659-ea10-403b-afbc-565fcd0d62cd admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:56.567415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda86504-3341-493b-8705-8ed2e6c24361 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:56.573893 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e10633-2a61-4988-870d-3002d711880b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:56.574914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e10633-2a61-4988-870d-3002d711880b admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:56.575505 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e10633-2a61-4988-870d-3002d711880b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:56.575851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e10633-2a61-4988-870d-3002d711880b admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:56.576633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e10633-2a61-4988-870d-3002d711880b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:56.578667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e10633-2a61-4988-870d-3002d711880b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:56.588050 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1013/2060] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:23:56.590849 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e4659-ea10-403b-afbc-565fcd0d62cd admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:56.603917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e4659-ea10-403b-afbc-565fcd0d62cd admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:56.609220 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1acbd-f4ab-4975-b735-7eccc3806e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:56.610305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1acbd-f4ab-4975-b735-7eccc3806e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:56.610771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1acbd-f4ab-4975-b735-7eccc3806e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:56.611130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1acbd-f4ab-4975-b735-7eccc3806e66 admin admin] PATH_INFO: `/v3/projects/8863a1926faf41d6a1118e596ba7b6fc/users/c98e697f473d492e8ddff6ed53df4e83/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:56.628395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1acbd-f4ab-4975-b735-7eccc3806e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8863a1926faf41d6a1118e596ba7b6fc, user_id=c98e697f473d492e8ddff6ed53df4e83, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:56.631482 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1acbd-f4ab-4975-b735-7eccc3806e66 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:56.674274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1048/2061] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:56 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:56.674274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e10633-2a61-4988-870d-3002d711880b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:56.716408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1014/2062] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:56 2022] PUT /identity/v3/projects/8863a1926faf41d6a1118e596ba7b6fc/users/c98e697f473d492e8ddff6ed53df4e83/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:56.717477 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1acbd-f4ab-4975-b735-7eccc3806e66 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:56.766128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e10633-2a61-4988-870d-3002d711880b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:56.820359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1acbd-f4ab-4975-b735-7eccc3806e66 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:56.825726 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9a215-26b3-4a5f-a2fa-6e8c8ec04084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:56.826482 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9a215-26b3-4a5f-a2fa-6e8c8ec04084 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:56.826966 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9a215-26b3-4a5f-a2fa-6e8c8ec04084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:56.827236 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9a215-26b3-4a5f-a2fa-6e8c8ec04084 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:56.828093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9a215-26b3-4a5f-a2fa-6e8c8ec04084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:56.830168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9a215-26b3-4a5f-a2fa-6e8c8ec04084 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:56.841930 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2951d52-7469-4e8c-82ea-e944fc937d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:56.842786 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2951d52-7469-4e8c-82ea-e944fc937d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:56.843072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2951d52-7469-4e8c-82ea-e944fc937d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:56.843690 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2951d52-7469-4e8c-82ea-e944fc937d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:56.844533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2951d52-7469-4e8c-82ea-e944fc937d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:56.846815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2951d52-7469-4e8c-82ea-e944fc937d02 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:56.879777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:56.902718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1015/2063] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:56 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:56.902718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9a215-26b3-4a5f-a2fa-6e8c8ec04084 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:56.917445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9a215-26b3-4a5f-a2fa-6e8c8ec04084 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:56.922790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1049/2064] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:23:56 2022] POST /identity/v3/projects => generated 361 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:56.924360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2951d52-7469-4e8c-82ea-e944fc937d02 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:56.971720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:56.993895 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb576f98-376c-4b7b-9eed-78b3fafc08a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:56.995092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb576f98-376c-4b7b-9eed-78b3fafc08a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:56.995459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb576f98-376c-4b7b-9eed-78b3fafc08a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:56.995812 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb576f98-376c-4b7b-9eed-78b3fafc08a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:56.997058 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb576f98-376c-4b7b-9eed-78b3fafc08a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:56.998847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb576f98-376c-4b7b-9eed-78b3fafc08a1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:57.003789 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2951d52-7469-4e8c-82ea-e944fc937d02 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:57.010569 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdb485-6df4-4f8d-8b10-599c7b23dc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:57.014423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1016/2065] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:57.014586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdb485-6df4-4f8d-8b10-599c7b23dc26 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:57.014586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdb485-6df4-4f8d-8b10-599c7b23dc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:57.014586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdb485-6df4-4f8d-8b10-599c7b23dc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:57.014901 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb576f98-376c-4b7b-9eed-78b3fafc08a1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:57.014992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdb485-6df4-4f8d-8b10-599c7b23dc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:57.014992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdb485-6df4-4f8d-8b10-599c7b23dc26 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:57.025137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb576f98-376c-4b7b-9eed-78b3fafc08a1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:57.028524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1050/2066] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:57.029269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdb485-6df4-4f8d-8b10-599c7b23dc26 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:57.032134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92995f3-a52f-431a-941f-368bbf4bf7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:57.032514 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92995f3-a52f-431a-941f-368bbf4bf7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:57.032841 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92995f3-a52f-431a-941f-368bbf4bf7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:57.033070 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92995f3-a52f-431a-941f-368bbf4bf7c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:57.033760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92995f3-a52f-431a-941f-368bbf4bf7c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:57.036207 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92995f3-a52f-431a-941f-368bbf4bf7c0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:57.039318 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdb485-6df4-4f8d-8b10-599c7b23dc26 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:57.044167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98618a-ee01-46cd-bfab-54c2633080f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:57.045057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98618a-ee01-46cd-bfab-54c2633080f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:57.045335 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98618a-ee01-46cd-bfab-54c2633080f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:57.051940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98618a-ee01-46cd-bfab-54c2633080f9 admin admin] PATH_INFO: `/v3/projects/8863a1926faf41d6a1118e596ba7b6fc/users/c98e697f473d492e8ddff6ed53df4e83/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:57.051940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98618a-ee01-46cd-bfab-54c2633080f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8863a1926faf41d6a1118e596ba7b6fc, user_id=c98e697f473d492e8ddff6ed53df4e83, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:57.051940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98618a-ee01-46cd-bfab-54c2633080f9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:57.062995 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1051/2067] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:57 2022] PUT /identity/v3/projects/8863a1926faf41d6a1118e596ba7b6fc/users/c98e697f473d492e8ddff6ed53df4e83/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:57.063818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98618a-ee01-46cd-bfab-54c2633080f9 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:57.125111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98618a-ee01-46cd-bfab-54c2633080f9 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:57.131813 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf49e3-6cb5-436d-876d-810ca744ad88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:57.133653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf49e3-6cb5-436d-876d-810ca744ad88 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:57.134188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf49e3-6cb5-436d-876d-810ca744ad88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:57.134622 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf49e3-6cb5-436d-876d-810ca744ad88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:57.135559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf49e3-6cb5-436d-876d-810ca744ad88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:57.138246 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf49e3-6cb5-436d-876d-810ca744ad88 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:57.140415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1017/2068] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:23:57 2022] POST /identity/v3/users => generated 281 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:23:57.142126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de1117-3b35-4a62-a7c8-8667ccf310b1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:57.142526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de1117-3b35-4a62-a7c8-8667ccf310b1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:57.143233 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de1117-3b35-4a62-a7c8-8667ccf310b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:57.152553 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1052/2069] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:57.156975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf49e3-6cb5-436d-876d-810ca744ad88 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:57.171329 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf49e3-6cb5-436d-876d-810ca744ad88 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:57.174189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953d5e0-8fb1-4c0e-9491-7ccec2d65b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:57.174881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d5e0-8fb1-4c0e-9491-7ccec2d65b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:57.175168 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d5e0-8fb1-4c0e-9491-7ccec2d65b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:57.175445 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d5e0-8fb1-4c0e-9491-7ccec2d65b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:57.176360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953d5e0-8fb1-4c0e-9491-7ccec2d65b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:57.177990 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953d5e0-8fb1-4c0e-9491-7ccec2d65b6c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:57.182727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-20de1117-3b35-4a62-a7c8-8667ccf310b1 None None] MFA Rules not processed for user `c98e697f473d492e8ddff6ed53df4e83`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:57.184184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-20de1117-3b35-4a62-a7c8-8667ccf310b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:57.193269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1053/2070] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:57.194181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953d5e0-8fb1-4c0e-9491-7ccec2d65b6c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:57.206188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953d5e0-8fb1-4c0e-9491-7ccec2d65b6c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:57.218905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac165bb-4cc3-480a-ad66-9b8cc0b6d3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:57.219832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac165bb-4cc3-480a-ad66-9b8cc0b6d3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:57.220219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac165bb-4cc3-480a-ad66-9b8cc0b6d3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:57.220508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac165bb-4cc3-480a-ad66-9b8cc0b6d3bc admin admin] PATH_INFO: `/v3/projects/d642a5a5ef664e30b4caa13b0018005a/users/795df37b88f6482aa5a0a05c25f316e8/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:57.247325 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac165bb-4cc3-480a-ad66-9b8cc0b6d3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d642a5a5ef664e30b4caa13b0018005a, user_id=795df37b88f6482aa5a0a05c25f316e8, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:57.254663 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac165bb-4cc3-480a-ad66-9b8cc0b6d3bc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:57.279527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1018/2071] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:57.285800 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de1117-3b35-4a62-a7c8-8667ccf310b1 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:57.292286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de1117-3b35-4a62-a7c8-8667ccf310b1 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:57.297167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9409d-da05-4bfe-8214-463a70308671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:57.297848 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9409d-da05-4bfe-8214-463a70308671 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:57.298133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9409d-da05-4bfe-8214-463a70308671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:57.298410 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9409d-da05-4bfe-8214-463a70308671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:57.299195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9409d-da05-4bfe-8214-463a70308671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:57.300961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9409d-da05-4bfe-8214-463a70308671 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:57.314273 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1019/2072] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:23:57.315317 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9409d-da05-4bfe-8214-463a70308671 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:57.317066 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9cf9409d-da05-4bfe-8214-463a70308671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:57.340554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1054/2073] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:57 2022] PUT /identity/v3/projects/d642a5a5ef664e30b4caa13b0018005a/users/795df37b88f6482aa5a0a05c25f316e8/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:57.345720 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac165bb-4cc3-480a-ad66-9b8cc0b6d3bc admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:57.391376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9409d-da05-4bfe-8214-463a70308671 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:57.416697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac165bb-4cc3-480a-ad66-9b8cc0b6d3bc admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:57.418721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:57.432798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d10d9-2636-4bb6-9efd-fd080d18fb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:57.432798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d10d9-2636-4bb6-9efd-fd080d18fb3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:57.432798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d10d9-2636-4bb6-9efd-fd080d18fb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:57.432798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d10d9-2636-4bb6-9efd-fd080d18fb3b admin admin] PATH_INFO: `/v3/projects/5374cb008e7a4592a7315e9d36bf5374/users/fbac277da7b247f6a538a39842506198/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:57.442026 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d10d9-2636-4bb6-9efd-fd080d18fb3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5374cb008e7a4592a7315e9d36bf5374, user_id=fbac277da7b247f6a538a39842506198, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:57.445466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d10d9-2636-4bb6-9efd-fd080d18fb3b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:57.446681 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943df8a9-8128-4435-a4b1-12f528b7da46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:57.447338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943df8a9-8128-4435-a4b1-12f528b7da46 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:57.447619 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943df8a9-8128-4435-a4b1-12f528b7da46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:57.448209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943df8a9-8128-4435-a4b1-12f528b7da46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:57.452631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-943df8a9-8128-4435-a4b1-12f528b7da46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:57.502167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:57.513226 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943df8a9-8128-4435-a4b1-12f528b7da46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:57.514701 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943df8a9-8128-4435-a4b1-12f528b7da46 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:57.524480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1020/2074] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:57.525730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a266ba-6b5c-4ff8-813c-4badeac2dda1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:57.526019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a266ba-6b5c-4ff8-813c-4badeac2dda1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:57.526454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a266ba-6b5c-4ff8-813c-4badeac2dda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:57.538554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1055/2075] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:23:57 2022] PUT /identity/v3/projects/5374cb008e7a4592a7315e9d36bf5374/users/fbac277da7b247f6a538a39842506198/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:57.549398 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da058c-2849-4399-a4e1-1b1623ec8411 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:57.550101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da058c-2849-4399-a4e1-1b1623ec8411 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:57.550597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da058c-2849-4399-a4e1-1b1623ec8411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:57.560275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-50a266ba-6b5c-4ff8-813c-4badeac2dda1 None None] MFA Rules not processed for user `795df37b88f6482aa5a0a05c25f316e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:57.561494 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-50a266ba-6b5c-4ff8-813c-4badeac2dda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:57.589007 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-95da058c-2849-4399-a4e1-1b1623ec8411 None None] MFA Rules not processed for user `fbac277da7b247f6a538a39842506198`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:57.590641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-95da058c-2849-4399-a4e1-1b1623ec8411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:57.650961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1021/2076] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:57.663405 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a266ba-6b5c-4ff8-813c-4badeac2dda1 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:57.665320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-50a266ba-6b5c-4ff8-813c-4badeac2dda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:57.679928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1056/2077] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:23:57.741990 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a266ba-6b5c-4ff8-813c-4badeac2dda1 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:57.746063 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566af96-3f20-4cab-9896-39d6ea0396e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:57.747214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566af96-3f20-4cab-9896-39d6ea0396e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:57.747214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566af96-3f20-4cab-9896-39d6ea0396e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:57.747485 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566af96-3f20-4cab-9896-39d6ea0396e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:57.756459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566af96-3f20-4cab-9896-39d6ea0396e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:57.758310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566af96-3f20-4cab-9896-39d6ea0396e3 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:57.769834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1022/2078] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:23:57.822205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:58.045630 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:58.511607 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da058c-2849-4399-a4e1-1b1623ec8411 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:58.522294 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da058c-2849-4399-a4e1-1b1623ec8411 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:58.526632 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee57f62-0e46-41b1-b1af-b539eb08fefd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:58.527296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee57f62-0e46-41b1-b1af-b539eb08fefd service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:58.528936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee57f62-0e46-41b1-b1af-b539eb08fefd service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:58.528936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee57f62-0e46-41b1-b1af-b539eb08fefd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:58.537882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee57f62-0e46-41b1-b1af-b539eb08fefd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:58.540459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee57f62-0e46-41b1-b1af-b539eb08fefd service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:58.550558 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1057/2079] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:58.564720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566af96-3f20-4cab-9896-39d6ea0396e3 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:58.646190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566af96-3f20-4cab-9896-39d6ea0396e3 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:58.651872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae85d98-e604-4d5c-9250-1cf972d4d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:58.653023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae85d98-e604-4d5c-9250-1cf972d4d9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:58.653437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae85d98-e604-4d5c-9250-1cf972d4d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:58.653810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae85d98-e604-4d5c-9250-1cf972d4d9ca admin admin] PATH_INFO: `/v3/users/fbac277da7b247f6a538a39842506198` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:58.655568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae85d98-e604-4d5c-9250-1cf972d4d9ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbac277da7b247f6a538a39842506198)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:58.657912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae85d98-e604-4d5c-9250-1cf972d4d9ca admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:58.760630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:58.811511 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:58.878153 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1ae85d98-e604-4d5c-9250-1cf972d4d9ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbac277da7b247f6a538a39842506198'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:58.892656 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1ae85d98-e604-4d5c-9250-1cf972d4d9ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbac277da7b247f6a538a39842506198'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:58.893563 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1ae85d98-e604-4d5c-9250-1cf972d4d9ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbac277da7b247f6a538a39842506198'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:58.963736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1ae85d98-e604-4d5c-9250-1cf972d4d9ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbac277da7b247f6a538a39842506198'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:58.964413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1ae85d98-e604-4d5c-9250-1cf972d4d9ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbac277da7b247f6a538a39842506198'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:23:58.978797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1023/2080] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:23:58 2022] DELETE /identity/v3/users/fbac277da7b247f6a538a39842506198 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:23:58.983281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cecc7c-47c3-4e83-a8af-e908f884c691 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:58.983571 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cecc7c-47c3-4e83-a8af-e908f884c691 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:58.983849 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cecc7c-47c3-4e83-a8af-e908f884c691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:59.006483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-00cecc7c-47c3-4e83-a8af-e908f884c691 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:59.007710 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-00cecc7c-47c3-4e83-a8af-e908f884c691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:59.077628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1058/2081] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:59.087881 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae85d98-e604-4d5c-9250-1cf972d4d9ca admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:59.089340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1ae85d98-e604-4d5c-9250-1cf972d4d9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:59.156502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae85d98-e604-4d5c-9250-1cf972d4d9ca admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:59.160118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dca3ae-9f27-4f28-8755-3a1c336d01dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:59.160260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca3ae-9f27-4f28-8755-3a1c336d01dd service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:59.160641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca3ae-9f27-4f28-8755-3a1c336d01dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:59.160986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca3ae-9f27-4f28-8755-3a1c336d01dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:59.172884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dca3ae-9f27-4f28-8755-3a1c336d01dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:59.174563 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dca3ae-9f27-4f28-8755-3a1c336d01dd service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:59.186574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1024/2082] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:59.737733 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:59.858433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cecc7c-47c3-4e83-a8af-e908f884c691 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:59.860863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-00cecc7c-47c3-4e83-a8af-e908f884c691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:59.886198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cecc7c-47c3-4e83-a8af-e908f884c691 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:59.893507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b22d7a-0bf7-4412-8add-e19b1f2b2294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:59.894498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b22d7a-0bf7-4412-8add-e19b1f2b2294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:59.898902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b22d7a-0bf7-4412-8add-e19b1f2b2294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:59.898902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b22d7a-0bf7-4412-8add-e19b1f2b2294 admin admin] PATH_INFO: `/v3/projects/5374cb008e7a4592a7315e9d36bf5374` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:59.898902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b22d7a-0bf7-4412-8add-e19b1f2b2294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5374cb008e7a4592a7315e9d36bf5374)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:59.898902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b22d7a-0bf7-4412-8add-e19b1f2b2294 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:59.941820 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:00.066288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-29b22d7a-0bf7-4412-8add-e19b1f2b2294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5374cb008e7a4592a7315e9d36bf5374', 'request_id': 'req-29b22d7a-0bf7-4412-8add-e19b1f2b2294'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:00.138178 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-29b22d7a-0bf7-4412-8add-e19b1f2b2294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5374cb008e7a4592a7315e9d36bf5374', 'request_id': 'req-29b22d7a-0bf7-4412-8add-e19b1f2b2294'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:00.145125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-29b22d7a-0bf7-4412-8add-e19b1f2b2294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5374cb008e7a4592a7315e9d36bf5374', 'request_id': 'req-29b22d7a-0bf7-4412-8add-e19b1f2b2294'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:00.159512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-29b22d7a-0bf7-4412-8add-e19b1f2b2294 admin admin] The token cache is being invalidate because project 5374cb008e7a4592a7315e9d36bf5374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:00.160044 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-29b22d7a-0bf7-4412-8add-e19b1f2b2294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:00.164809 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-29b22d7a-0bf7-4412-8add-e19b1f2b2294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:00.166451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1059/2083] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:23:59 2022] DELETE /identity/v3/projects/5374cb008e7a4592a7315e9d36bf5374 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:00.171658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581124b-03df-4a2b-89e0-338ef17d336c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:00.172202 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581124b-03df-4a2b-89e0-338ef17d336c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:00.172635 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581124b-03df-4a2b-89e0-338ef17d336c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:00.191417 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b581124b-03df-4a2b-89e0-338ef17d336c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:00.192675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b581124b-03df-4a2b-89e0-338ef17d336c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:00.266009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1025/2084] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:00.277128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1011495-7f65-4951-8891-79ed10ed1498 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:00.277790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1011495-7f65-4951-8891-79ed10ed1498 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:00.278376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1011495-7f65-4951-8891-79ed10ed1498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:00.298467 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f1011495-7f65-4951-8891-79ed10ed1498 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:00.299692 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f1011495-7f65-4951-8891-79ed10ed1498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:00.309441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1060/2085] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:00.316611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb35b6-55ed-4b34-bf3f-0674023aea3d None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:00.316611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb35b6-55ed-4b34-bf3f-0674023aea3d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:00.316611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb35b6-55ed-4b34-bf3f-0674023aea3d None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:00.316910 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1011495-7f65-4951-8891-79ed10ed1498 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:00.317010 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1026/2086] 10.222.0.74 () {54 vars in 921 bytes} [Thu Jul 14 10:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:24:00.324852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1011495-7f65-4951-8891-79ed10ed1498 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:00.325774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c467e1-5dee-4009-8a22-531bfa0f4990 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:00.326164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c467e1-5dee-4009-8a22-531bfa0f4990 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:00.326687 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c467e1-5dee-4009-8a22-531bfa0f4990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:00.331133 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2ff74-6b73-46d9-ba11-28abe1f43fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:00.331955 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2ff74-6b73-46d9-ba11-28abe1f43fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:00.332287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2ff74-6b73-46d9-ba11-28abe1f43fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:00.332634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2ff74-6b73-46d9-ba11-28abe1f43fb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:00.333741 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2ff74-6b73-46d9-ba11-28abe1f43fb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:24:00.334013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2ff74-6b73-46d9-ba11-28abe1f43fb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:00.335828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2ff74-6b73-46d9-ba11-28abe1f43fb3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:00.346188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e0c467e1-5dee-4009-8a22-531bfa0f4990 None None] MFA Rules not processed for user `2784d36c16d343cc961a22d956ee30f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:00.347505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e0c467e1-5dee-4009-8a22-531bfa0f4990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:00.349923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1061/2087] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:24:00.355284 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2ff74-6b73-46d9-ba11-28abe1f43fb3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:00.365111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2ff74-6b73-46d9-ba11-28abe1f43fb3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:00.370605 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa925f-fe3d-4f66-b0f2-c083ad7da085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:00.374037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa925f-fe3d-4f66-b0f2-c083ad7da085 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:00.374037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa925f-fe3d-4f66-b0f2-c083ad7da085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:00.374037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa925f-fe3d-4f66-b0f2-c083ad7da085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:00.374037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa925f-fe3d-4f66-b0f2-c083ad7da085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:00.374990 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa925f-fe3d-4f66-b0f2-c083ad7da085 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:00.420148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1027/2088] 10.222.0.74 () {58 vars in 1018 bytes} [Thu Jul 14 10:24:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:24:00.432180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c467e1-5dee-4009-8a22-531bfa0f4990 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:00.432180 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e0c467e1-5dee-4009-8a22-531bfa0f4990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:00.445565 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c467e1-5dee-4009-8a22-531bfa0f4990 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:00.450919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211e711-a503-46b8-9fb3-27c61fc77878 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784d36c16d343cc961a22d956ee30f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:00.451570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211e711-a503-46b8-9fb3-27c61fc77878 service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:00.451861 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211e711-a503-46b8-9fb3-27c61fc77878 service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:00.452179 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211e711-a503-46b8-9fb3-27c61fc77878 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:00.462612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211e711-a503-46b8-9fb3-27c61fc77878 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:00.465769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211e711-a503-46b8-9fb3-27c61fc77878 service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:00.474738 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1028/2089] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:24:00.505126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211e711-a503-46b8-9fb3-27c61fc77878 service placement] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:00.507663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7211e711-a503-46b8-9fb3-27c61fc77878 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:00.524961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211e711-a503-46b8-9fb3-27c61fc77878 service placement] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:00.530496 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25b435-42cc-46b4-91b3-c89a1caa2026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:00.531406 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25b435-42cc-46b4-91b3-c89a1caa2026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:00.531692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25b435-42cc-46b4-91b3-c89a1caa2026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:00.538415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25b435-42cc-46b4-91b3-c89a1caa2026 admin admin] PATH_INFO: `/v3/users/84d2de5b7eb34c0893fa8f37d1341b64` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:00.538415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25b435-42cc-46b4-91b3-c89a1caa2026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d2de5b7eb34c0893fa8f37d1341b64)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:00.538620 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1062/2090] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:24:00 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:24:00.538711 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25b435-42cc-46b4-91b3-c89a1caa2026 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:00.539260 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa925f-fe3d-4f66-b0f2-c083ad7da085 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:00.612022 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa925f-fe3d-4f66-b0f2-c083ad7da085 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:00.617537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe36b4-601a-40f2-afc2-13fc56f08dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:00.618222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe36b4-601a-40f2-afc2-13fc56f08dbf admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:00.618510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe36b4-601a-40f2-afc2-13fc56f08dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:00.618784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe36b4-601a-40f2-afc2-13fc56f08dbf admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:00.619474 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe36b4-601a-40f2-afc2-13fc56f08dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:00.621541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe36b4-601a-40f2-afc2-13fc56f08dbf admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:00.701935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1063/2091] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:24:00 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:24:00.711815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe36b4-601a-40f2-afc2-13fc56f08dbf admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:00.728675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe36b4-601a-40f2-afc2-13fc56f08dbf admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:00.731501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8d25b435-42cc-46b4-91b3-c89a1caa2026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d2de5b7eb34c0893fa8f37d1341b64'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:00.734820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc21bc-2300-4135-8eb2-46506bf27a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:00.735482 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc21bc-2300-4135-8eb2-46506bf27a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:00.735769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc21bc-2300-4135-8eb2-46506bf27a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:00.736078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc21bc-2300-4135-8eb2-46506bf27a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:00.736820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc21bc-2300-4135-8eb2-46506bf27a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:00.738492 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc21bc-2300-4135-8eb2-46506bf27a30 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:00.745777 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8d25b435-42cc-46b4-91b3-c89a1caa2026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d2de5b7eb34c0893fa8f37d1341b64'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:00.746721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8d25b435-42cc-46b4-91b3-c89a1caa2026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d2de5b7eb34c0893fa8f37d1341b64'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:00.750253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1064/2092] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:00.754416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc21bc-2300-4135-8eb2-46506bf27a30 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:00.756231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4cdc21bc-2300-4135-8eb2-46506bf27a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:00.769626 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc21bc-2300-4135-8eb2-46506bf27a30 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:00.774822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d103fb0-3ac4-4e96-ae24-7685783d0118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:00.775508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d103fb0-3ac4-4e96-ae24-7685783d0118 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:00.775810 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d103fb0-3ac4-4e96-ae24-7685783d0118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:00.776125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d103fb0-3ac4-4e96-ae24-7685783d0118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:00.776848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d103fb0-3ac4-4e96-ae24-7685783d0118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:00.778449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d103fb0-3ac4-4e96-ae24-7685783d0118 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:00.790602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1065/2093] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:24:00.794778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d103fb0-3ac4-4e96-ae24-7685783d0118 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:00.804533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d103fb0-3ac4-4e96-ae24-7685783d0118 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:00.809201 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44f23b-a0d1-4802-b6fa-78dab99fe651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:00.810048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44f23b-a0d1-4802-b6fa-78dab99fe651 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:00.811308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44f23b-a0d1-4802-b6fa-78dab99fe651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:00.811308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44f23b-a0d1-4802-b6fa-78dab99fe651 admin admin] PATH_INFO: `/v3/projects/f24d0f1c0a514b019ca37e26640198c6/users/a34be2c2eb1e41538323f55d79416cb9/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:00.825796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44f23b-a0d1-4802-b6fa-78dab99fe651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f24d0f1c0a514b019ca37e26640198c6, user_id=a34be2c2eb1e41538323f55d79416cb9, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:00.828468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44f23b-a0d1-4802-b6fa-78dab99fe651 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:00.832523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8d25b435-42cc-46b4-91b3-c89a1caa2026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d2de5b7eb34c0893fa8f37d1341b64'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:00.838426 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8d25b435-42cc-46b4-91b3-c89a1caa2026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d2de5b7eb34c0893fa8f37d1341b64'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:00.847118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1029/2094] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:24:00 2022] DELETE /identity/v3/users/84d2de5b7eb34c0893fa8f37d1341b64 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:00.885213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1066/2095] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:24:00 2022] PUT /identity/v3/projects/f24d0f1c0a514b019ca37e26640198c6/users/a34be2c2eb1e41538323f55d79416cb9/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:00.905355 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060f2d-ba4b-4ca7-8b18-d109fe8b3718 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:00.907461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060f2d-ba4b-4ca7-8b18-d109fe8b3718 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:00.907830 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060f2d-ba4b-4ca7-8b18-d109fe8b3718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:00.948564 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1d060f2d-ba4b-4ca7-8b18-d109fe8b3718 None None] MFA Rules not processed for user `a34be2c2eb1e41538323f55d79416cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:00.950041 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1d060f2d-ba4b-4ca7-8b18-d109fe8b3718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:01.016996 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1030/2096] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:01.028512 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44f23b-a0d1-4802-b6fa-78dab99fe651 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:01.030812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5f44f23b-a0d1-4802-b6fa-78dab99fe651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:01.092665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44f23b-a0d1-4802-b6fa-78dab99fe651 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:01.096661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24d1a1-96e6-4f93-9f03-16ee66a0e35d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:01.097321 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24d1a1-96e6-4f93-9f03-16ee66a0e35d service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:01.097611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24d1a1-96e6-4f93-9f03-16ee66a0e35d service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:01.097899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24d1a1-96e6-4f93-9f03-16ee66a0e35d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:01.107472 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24d1a1-96e6-4f93-9f03-16ee66a0e35d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:01.108935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24d1a1-96e6-4f93-9f03-16ee66a0e35d service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:01.121349 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d060f2d-ba4b-4ca7-8b18-d109fe8b3718 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:01.122001 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1067/2097] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:01.123418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1d060f2d-ba4b-4ca7-8b18-d109fe8b3718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:01.203902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d060f2d-ba4b-4ca7-8b18-d109fe8b3718 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:01.208915 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7039a-e769-4b1e-8faa-402217daa452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:01.210132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7039a-e769-4b1e-8faa-402217daa452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:01.210132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7039a-e769-4b1e-8faa-402217daa452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:01.210354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7039a-e769-4b1e-8faa-402217daa452 admin admin] PATH_INFO: `/v3/projects/ebd2096f6b69426c86fd19d39bc89288` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:01.211860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7039a-e769-4b1e-8faa-402217daa452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd2096f6b69426c86fd19d39bc89288)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:01.213348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:01.214108 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7039a-e769-4b1e-8faa-402217daa452 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:01.346793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b8e7039a-e769-4b1e-8faa-402217daa452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd2096f6b69426c86fd19d39bc89288', 'request_id': 'req-b8e7039a-e769-4b1e-8faa-402217daa452'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:01.357827 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:01.443669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b8e7039a-e769-4b1e-8faa-402217daa452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd2096f6b69426c86fd19d39bc89288', 'request_id': 'req-b8e7039a-e769-4b1e-8faa-402217daa452'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:01.451373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b8e7039a-e769-4b1e-8faa-402217daa452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd2096f6b69426c86fd19d39bc89288', 'request_id': 'req-b8e7039a-e769-4b1e-8faa-402217daa452'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:01.463000 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b8e7039a-e769-4b1e-8faa-402217daa452 admin admin] The token cache is being invalidate because project ebd2096f6b69426c86fd19d39bc89288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:01.463302 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b8e7039a-e769-4b1e-8faa-402217daa452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:01.463986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b8e7039a-e769-4b1e-8faa-402217daa452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:01.465614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1031/2098] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:24:01 2022] DELETE /identity/v3/projects/ebd2096f6b69426c86fd19d39bc89288 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:01.470813 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de5ba-b2aa-4847-bc51-7ba1524d36fc None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:01.471108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de5ba-b2aa-4847-bc51-7ba1524d36fc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:01.471388 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de5ba-b2aa-4847-bc51-7ba1524d36fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:01.490785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-360de5ba-b2aa-4847-bc51-7ba1524d36fc None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:01.492745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-360de5ba-b2aa-4847-bc51-7ba1524d36fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:01.563664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1068/2099] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:01.572908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e8fee-aa7a-47df-8f26-b8a94fb3645b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:01.573209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e8fee-aa7a-47df-8f26-b8a94fb3645b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:01.573473 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e8fee-aa7a-47df-8f26-b8a94fb3645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:01.601784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-fb8e8fee-aa7a-47df-8f26-b8a94fb3645b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:01.601784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-fb8e8fee-aa7a-47df-8f26-b8a94fb3645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:01.612468 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1032/2100] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:01.617299 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360de5ba-b2aa-4847-bc51-7ba1524d36fc None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:01.634580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360de5ba-b2aa-4847-bc51-7ba1524d36fc None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:01.639763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510500-fcad-436f-8be3-02267df8b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:01.640490 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510500-fcad-436f-8be3-02267df8b0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:01.640840 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510500-fcad-436f-8be3-02267df8b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:01.641181 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510500-fcad-436f-8be3-02267df8b0fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:01.642036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f510500-fcad-436f-8be3-02267df8b0fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:24:01.642427 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f510500-fcad-436f-8be3-02267df8b0fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:01.644235 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f510500-fcad-436f-8be3-02267df8b0fa admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:01.657081 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1069/2101] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:24:01.662825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e8fee-aa7a-47df-8f26-b8a94fb3645b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:01.675926 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e8fee-aa7a-47df-8f26-b8a94fb3645b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:01.681724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e98ea-7c6e-4ef0-8199-0c03895b44ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:01.687042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e98ea-7c6e-4ef0-8199-0c03895b44ca admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:01.687042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e98ea-7c6e-4ef0-8199-0c03895b44ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:01.687042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e98ea-7c6e-4ef0-8199-0c03895b44ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:01.687042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e98ea-7c6e-4ef0-8199-0c03895b44ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:01.687042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e98ea-7c6e-4ef0-8199-0c03895b44ca admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:01.811221 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1033/2102] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:24:01 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:24:01.812041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510500-fcad-436f-8be3-02267df8b0fa admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:01.823049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510500-fcad-436f-8be3-02267df8b0fa admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:01.891317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a69fe3-c120-462f-be76-0e1aee19bc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:01.892050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a69fe3-c120-462f-be76-0e1aee19bc99 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:01.892469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a69fe3-c120-462f-be76-0e1aee19bc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:01.892754 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a69fe3-c120-462f-be76-0e1aee19bc99 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:01.893533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a69fe3-c120-462f-be76-0e1aee19bc99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:01.895460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a69fe3-c120-462f-be76-0e1aee19bc99 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:02.001194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e98ea-7c6e-4ef0-8199-0c03895b44ca admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:02.003232 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9e7e98ea-7c6e-4ef0-8199-0c03895b44ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:02.026581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1070/2103] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:24:01 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:24:02.026581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a69fe3-c120-462f-be76-0e1aee19bc99 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:02.032025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e98ea-7c6e-4ef0-8199-0c03895b44ca admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:02.048327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49769b92-7d90-4678-90be-fb4e0e46ee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:02.048738 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a69fe3-c120-462f-be76-0e1aee19bc99 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:02.048829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49769b92-7d90-4678-90be-fb4e0e46ee85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:02.048829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49769b92-7d90-4678-90be-fb4e0e46ee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:02.048829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49769b92-7d90-4678-90be-fb4e0e46ee85 admin admin] PATH_INFO: `/v3/users/2fd09590244c48da923d89139399c113` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:02.048829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49769b92-7d90-4678-90be-fb4e0e46ee85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd09590244c48da923d89139399c113)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:02.049114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec1527-b723-4bf2-81b8-f6f13c06c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:02.049199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49769b92-7d90-4678-90be-fb4e0e46ee85 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:02.049272 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec1527-b723-4bf2-81b8-f6f13c06c036 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:02.049272 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec1527-b723-4bf2-81b8-f6f13c06c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:02.049272 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec1527-b723-4bf2-81b8-f6f13c06c036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:02.049272 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec1527-b723-4bf2-81b8-f6f13c06c036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:02.049272 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec1527-b723-4bf2-81b8-f6f13c06c036 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:02.063224 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1071/2104] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:02.067385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec1527-b723-4bf2-81b8-f6f13c06c036 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:02.081027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec1527-b723-4bf2-81b8-f6f13c06c036 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:02.092247 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df973e7-a7f7-42a0-95c5-95f6e92d646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:02.093008 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df973e7-a7f7-42a0-95c5-95f6e92d646e admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:02.093532 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df973e7-a7f7-42a0-95c5-95f6e92d646e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:02.093532 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df973e7-a7f7-42a0-95c5-95f6e92d646e admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:02.094275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df973e7-a7f7-42a0-95c5-95f6e92d646e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:02.095900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df973e7-a7f7-42a0-95c5-95f6e92d646e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:02.109824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1072/2105] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:02.113684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df973e7-a7f7-42a0-95c5-95f6e92d646e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:02.124297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df973e7-a7f7-42a0-95c5-95f6e92d646e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:02.129014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4cc8e-f72f-4467-a216-06f3a681834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:02.132336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4cc8e-f72f-4467-a216-06f3a681834f admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:02.132336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4cc8e-f72f-4467-a216-06f3a681834f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:02.132336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4cc8e-f72f-4467-a216-06f3a681834f admin admin] PATH_INFO: `/v3/projects/8c94fadce7d54958a58c5a0f31ee7341/users/3af2be9c1e9a4f0c8f4bdaa04769756c/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:02.145873 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4cc8e-f72f-4467-a216-06f3a681834f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c94fadce7d54958a58c5a0f31ee7341, user_id=3af2be9c1e9a4f0c8f4bdaa04769756c, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:02.149229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4cc8e-f72f-4467-a216-06f3a681834f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:02.266825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1073/2106] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:24:02 2022] PUT /identity/v3/projects/8c94fadce7d54958a58c5a0f31ee7341/users/3af2be9c1e9a4f0c8f4bdaa04769756c/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:02.271778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f9096-cbc5-4285-8deb-10b6c4a35454 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:02.272104 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f9096-cbc5-4285-8deb-10b6c4a35454 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:02.272384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f9096-cbc5-4285-8deb-10b6c4a35454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:02.285851 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:02.288923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f97f9096-cbc5-4285-8deb-10b6c4a35454 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:02.290115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f97f9096-cbc5-4285-8deb-10b6c4a35454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:02.298712 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-49769b92-7d90-4678-90be-fb4e0e46ee85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd09590244c48da923d89139399c113'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:02.311248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-49769b92-7d90-4678-90be-fb4e0e46ee85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd09590244c48da923d89139399c113'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:02.312037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-49769b92-7d90-4678-90be-fb4e0e46ee85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd09590244c48da923d89139399c113'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:02.349529 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1074/2107] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:24:02.359327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f9096-cbc5-4285-8deb-10b6c4a35454 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:02.360782 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f97f9096-cbc5-4285-8deb-10b6c4a35454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:02.397618 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-49769b92-7d90-4678-90be-fb4e0e46ee85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd09590244c48da923d89139399c113'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:02.398307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-49769b92-7d90-4678-90be-fb4e0e46ee85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd09590244c48da923d89139399c113'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:02.411135 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1034/2108] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:24:01 2022] DELETE /identity/v3/users/2fd09590244c48da923d89139399c113 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:02.415526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e49d-0515-44b9-8324-33047175e5e0 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:02.415829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e49d-0515-44b9-8324-33047175e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:02.416151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e49d-0515-44b9-8324-33047175e5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:02.418366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f9096-cbc5-4285-8deb-10b6c4a35454 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:02.434644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6d02e49d-0515-44b9-8324-33047175e5e0 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:02.435846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6d02e49d-0515-44b9-8324-33047175e5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:02.470077 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d3ab2-056c-4bcd-8bac-4ef336958450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:02.470741 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d3ab2-056c-4bcd-8bac-4ef336958450 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:02.471035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d3ab2-056c-4bcd-8bac-4ef336958450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:02.471301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d3ab2-056c-4bcd-8bac-4ef336958450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:02.498275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1035/2109] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:24:02.508605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02e49d-0515-44b9-8324-33047175e5e0 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:02.517777 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02e49d-0515-44b9-8324-33047175e5e0 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:02.521499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4e0fd-405a-43ca-8261-6b367d09bf39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:02.522134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e0fd-405a-43ca-8261-6b367d09bf39 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:02.522419 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e0fd-405a-43ca-8261-6b367d09bf39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:02.522700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e0fd-405a-43ca-8261-6b367d09bf39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:02.530954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:02.532093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4e0fd-405a-43ca-8261-6b367d09bf39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:02.533524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4e0fd-405a-43ca-8261-6b367d09bf39 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:02.538306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d3ab2-056c-4bcd-8bac-4ef336958450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:02.539803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d3ab2-056c-4bcd-8bac-4ef336958450 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:02.543903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1036/2110] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:24:02.549756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1075/2111] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:24:02.776233 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:03.072904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:03.233404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4e0fd-405a-43ca-8261-6b367d09bf39 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:03.235041 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-07d4e0fd-405a-43ca-8261-6b367d09bf39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:03.255721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4e0fd-405a-43ca-8261-6b367d09bf39 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:03.262318 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:03.263189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:03.263474 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:03.263746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] PATH_INFO: `/v3/projects/6bfbbcf73ddf4f729947ed2a8f0ea421` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:03.265200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfbbcf73ddf4f729947ed2a8f0ea421)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:03.267435 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:03.390284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfbbcf73ddf4f729947ed2a8f0ea421', 'request_id': 'req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.437777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:03.442972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfbbcf73ddf4f729947ed2a8f0ea421', 'request_id': 'req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.449647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfbbcf73ddf4f729947ed2a8f0ea421', 'request_id': 'req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.463273 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] The token cache is being invalidate because project 6bfbbcf73ddf4f729947ed2a8f0ea421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:03.463605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.464297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.466029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1037/2112] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:24:03 2022] DELETE /identity/v3/projects/6bfbbcf73ddf4f729947ed2a8f0ea421 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:03.470094 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d3ab2-056c-4bcd-8bac-4ef336958450 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:03.480259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d3ab2-056c-4bcd-8bac-4ef336958450 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:03.508970 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:03.510424 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:03.546131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a38c1-b412-4c61-a5a9-738a3e855d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:03.547290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a38c1-b412-4c61-a5a9-738a3e855d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:03.547601 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a38c1-b412-4c61-a5a9-738a3e855d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:03.548293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a38c1-b412-4c61-a5a9-738a3e855d67 admin admin] PATH_INFO: `/v3/users/c98e697f473d492e8ddff6ed53df4e83` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:03.549834 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a38c1-b412-4c61-a5a9-738a3e855d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98e697f473d492e8ddff6ed53df4e83)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:03.551777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a38c1-b412-4c61-a5a9-738a3e855d67 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:03.587790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d3392-7ee9-4bf0-8da2-f0ea97cf45eb admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:03.592798 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056d0f5-2bb3-46c5-9604-281a785f79ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:03.593681 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056d0f5-2bb3-46c5-9604-281a785f79ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:03.593968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056d0f5-2bb3-46c5-9604-281a785f79ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:03.594251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056d0f5-2bb3-46c5-9604-281a785f79ac admin admin] PATH_INFO: `/v3/users/795df37b88f6482aa5a0a05c25f316e8` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:03.595474 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056d0f5-2bb3-46c5-9604-281a785f79ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=795df37b88f6482aa5a0a05c25f316e8)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:03.597616 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056d0f5-2bb3-46c5-9604-281a785f79ac admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:03.765871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c7a38c1-b412-4c61-a5a9-738a3e855d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98e697f473d492e8ddff6ed53df4e83'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.768445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1056d0f5-2bb3-46c5-9604-281a785f79ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '795df37b88f6482aa5a0a05c25f316e8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.778633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c7a38c1-b412-4c61-a5a9-738a3e855d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98e697f473d492e8ddff6ed53df4e83'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.780740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1056d0f5-2bb3-46c5-9604-281a785f79ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '795df37b88f6482aa5a0a05c25f316e8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.781484 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1056d0f5-2bb3-46c5-9604-281a785f79ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '795df37b88f6482aa5a0a05c25f316e8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.855295 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c7a38c1-b412-4c61-a5a9-738a3e855d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98e697f473d492e8ddff6ed53df4e83'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.855988 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c7a38c1-b412-4c61-a5a9-738a3e855d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98e697f473d492e8ddff6ed53df4e83'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.863483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c7a38c1-b412-4c61-a5a9-738a3e855d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98e697f473d492e8ddff6ed53df4e83'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.869842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1076/2113] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:24:03 2022] DELETE /identity/v3/users/c98e697f473d492e8ddff6ed53df4e83 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:03.912159 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1056d0f5-2bb3-46c5-9604-281a785f79ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '795df37b88f6482aa5a0a05c25f316e8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.913462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1056d0f5-2bb3-46c5-9604-281a785f79ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '795df37b88f6482aa5a0a05c25f316e8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:03.927296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1038/2114] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:24:03 2022] DELETE /identity/v3/users/795df37b88f6482aa5a0a05c25f316e8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:03.932606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f9168-3617-49d0-9dc8-11131ab53ac7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:03.936554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f9168-3617-49d0-9dc8-11131ab53ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:03.936554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f9168-3617-49d0-9dc8-11131ab53ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:03.953146 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-598f9168-3617-49d0-9dc8-11131ab53ac7 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:03.954750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-598f9168-3617-49d0-9dc8-11131ab53ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:03.983119 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:04.022690 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1077/2115] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:04.029332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056d0f5-2bb3-46c5-9604-281a785f79ac admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:04.030951 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1056d0f5-2bb3-46c5-9604-281a785f79ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:04.041744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:04.119663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056d0f5-2bb3-46c5-9604-281a785f79ac admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:04.123706 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c0d05-6610-4ada-be5f-364bfe34cc72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:04.125935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c0d05-6610-4ada-be5f-364bfe34cc72 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:04.125935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c0d05-6610-4ada-be5f-364bfe34cc72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:04.125935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c0d05-6610-4ada-be5f-364bfe34cc72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:04.143192 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c0d05-6610-4ada-be5f-364bfe34cc72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:04.145015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c0d05-6610-4ada-be5f-364bfe34cc72 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:04.155902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1039/2116] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:04.443133 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f9168-3617-49d0-9dc8-11131ab53ac7 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:04.445234 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-598f9168-3617-49d0-9dc8-11131ab53ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:04.466801 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c0d05-6610-4ada-be5f-364bfe34cc72 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:04.468740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-fc0c0d05-6610-4ada-be5f-364bfe34cc72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:04.469177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f9168-3617-49d0-9dc8-11131ab53ac7 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:04.484634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a114385-b401-4696-b036-d4770ae5bc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:04.485811 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114385-b401-4696-b036-d4770ae5bc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:04.486286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114385-b401-4696-b036-d4770ae5bc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:04.486748 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114385-b401-4696-b036-d4770ae5bc29 admin admin] PATH_INFO: `/v3/users/c2374b96d6f4495399a3fc6e4522e786` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:04.489131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a114385-b401-4696-b036-d4770ae5bc29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2374b96d6f4495399a3fc6e4522e786)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:04.491875 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a114385-b401-4696-b036-d4770ae5bc29 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:04.503645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c0d05-6610-4ada-be5f-364bfe34cc72 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:04.514323 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6ec45-7921-401b-a7cc-2c1ee46e9922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:04.515306 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6ec45-7921-401b-a7cc-2c1ee46e9922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:04.515614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6ec45-7921-401b-a7cc-2c1ee46e9922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:04.517694 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6ec45-7921-401b-a7cc-2c1ee46e9922 admin admin] PATH_INFO: `/v3/users/a34be2c2eb1e41538323f55d79416cb9` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:04.520891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6ec45-7921-401b-a7cc-2c1ee46e9922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34be2c2eb1e41538323f55d79416cb9)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:04.523850 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6ec45-7921-401b-a7cc-2c1ee46e9922 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:04.592395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:04.744730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0ac6ec45-7921-401b-a7cc-2c1ee46e9922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34be2c2eb1e41538323f55d79416cb9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:04.757516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a114385-b401-4696-b036-d4770ae5bc29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2374b96d6f4495399a3fc6e4522e786'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:04.766793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0ac6ec45-7921-401b-a7cc-2c1ee46e9922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34be2c2eb1e41538323f55d79416cb9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:04.768225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0ac6ec45-7921-401b-a7cc-2c1ee46e9922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34be2c2eb1e41538323f55d79416cb9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:04.774282 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a114385-b401-4696-b036-d4770ae5bc29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2374b96d6f4495399a3fc6e4522e786'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:04.884096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0ac6ec45-7921-401b-a7cc-2c1ee46e9922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34be2c2eb1e41538323f55d79416cb9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:04.884899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0ac6ec45-7921-401b-a7cc-2c1ee46e9922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34be2c2eb1e41538323f55d79416cb9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:04.903661 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1040/2117] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:24:04 2022] DELETE /identity/v3/users/a34be2c2eb1e41538323f55d79416cb9 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:04.904909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6ec45-7921-401b-a7cc-2c1ee46e9922 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:04.906349 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0ac6ec45-7921-401b-a7cc-2c1ee46e9922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:04.980609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a114385-b401-4696-b036-d4770ae5bc29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2374b96d6f4495399a3fc6e4522e786'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:04.981467 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a114385-b401-4696-b036-d4770ae5bc29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2374b96d6f4495399a3fc6e4522e786'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:04.997553 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a114385-b401-4696-b036-d4770ae5bc29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2374b96d6f4495399a3fc6e4522e786'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:05.005726 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1078/2118] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:24:04 2022] DELETE /identity/v3/users/c2374b96d6f4495399a3fc6e4522e786 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:05.007573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a114385-b401-4696-b036-d4770ae5bc29 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:05.021747 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6ec45-7921-401b-a7cc-2c1ee46e9922 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:05.024749 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4a114385-b401-4696-b036-d4770ae5bc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:05.106670 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397b3f1-4419-4055-aae1-7a435e9e71ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:05.107674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397b3f1-4419-4055-aae1-7a435e9e71ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:05.108082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397b3f1-4419-4055-aae1-7a435e9e71ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:05.108556 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397b3f1-4419-4055-aae1-7a435e9e71ba admin admin] PATH_INFO: `/v3/projects/8863a1926faf41d6a1118e596ba7b6fc` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:05.110060 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397b3f1-4419-4055-aae1-7a435e9e71ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8863a1926faf41d6a1118e596ba7b6fc)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:05.112151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397b3f1-4419-4055-aae1-7a435e9e71ba admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:05.122591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a114385-b401-4696-b036-d4770ae5bc29 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:05.130046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:05.132528 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464898-4545-4372-bcfa-caa69e4fe369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:05.133529 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464898-4545-4372-bcfa-caa69e4fe369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:05.133887 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464898-4545-4372-bcfa-caa69e4fe369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:05.134237 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464898-4545-4372-bcfa-caa69e4fe369 admin admin] PATH_INFO: `/v3/projects/d642a5a5ef664e30b4caa13b0018005a` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:05.136099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e464898-4545-4372-bcfa-caa69e4fe369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d642a5a5ef664e30b4caa13b0018005a)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:05.141310 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e464898-4545-4372-bcfa-caa69e4fe369 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:05.217280 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9397b3f1-4419-4055-aae1-7a435e9e71ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8863a1926faf41d6a1118e596ba7b6fc', 'request_id': 'req-9397b3f1-4419-4055-aae1-7a435e9e71ba'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:05.240690 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4e464898-4545-4372-bcfa-caa69e4fe369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd642a5a5ef664e30b4caa13b0018005a', 'request_id': 'req-4e464898-4545-4372-bcfa-caa69e4fe369'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:05.306428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9397b3f1-4419-4055-aae1-7a435e9e71ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8863a1926faf41d6a1118e596ba7b6fc', 'request_id': 'req-9397b3f1-4419-4055-aae1-7a435e9e71ba'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:05.312868 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9397b3f1-4419-4055-aae1-7a435e9e71ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8863a1926faf41d6a1118e596ba7b6fc', 'request_id': 'req-9397b3f1-4419-4055-aae1-7a435e9e71ba'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:05.326559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9397b3f1-4419-4055-aae1-7a435e9e71ba admin admin] The token cache is being invalidate because project 8863a1926faf41d6a1118e596ba7b6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:05.326947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9397b3f1-4419-4055-aae1-7a435e9e71ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:05.327631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9397b3f1-4419-4055-aae1-7a435e9e71ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:05.329240 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1041/2119] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:24:04 2022] DELETE /identity/v3/projects/8863a1926faf41d6a1118e596ba7b6fc => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:05.330475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c937e-df68-4967-951b-1fecf6b47da3 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:05.330762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c937e-df68-4967-951b-1fecf6b47da3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:05.331037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c937e-df68-4967-951b-1fecf6b47da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:05.348557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a15c937e-df68-4967-951b-1fecf6b47da3 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:05.350054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a15c937e-df68-4967-951b-1fecf6b47da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:05.363111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4e464898-4545-4372-bcfa-caa69e4fe369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd642a5a5ef664e30b4caa13b0018005a', 'request_id': 'req-4e464898-4545-4372-bcfa-caa69e4fe369'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:05.375033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4e464898-4545-4372-bcfa-caa69e4fe369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd642a5a5ef664e30b4caa13b0018005a', 'request_id': 'req-4e464898-4545-4372-bcfa-caa69e4fe369'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:05.392926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4e464898-4545-4372-bcfa-caa69e4fe369 admin admin] The token cache is being invalidate because project d642a5a5ef664e30b4caa13b0018005a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:05.393549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4e464898-4545-4372-bcfa-caa69e4fe369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:05.394309 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4e464898-4545-4372-bcfa-caa69e4fe369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:05.395952 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1079/2120] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:24:05 2022] DELETE /identity/v3/projects/d642a5a5ef664e30b4caa13b0018005a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:05.397453 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d81eb-bb6d-4f69-a4ee-708ab1dfbcbc None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:05.397843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d81eb-bb6d-4f69-a4ee-708ab1dfbcbc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:05.398217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d81eb-bb6d-4f69-a4ee-708ab1dfbcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:05.416440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-733d81eb-bb6d-4f69-a4ee-708ab1dfbcbc None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:05.421716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-733d81eb-bb6d-4f69-a4ee-708ab1dfbcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:05.426191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1042/2121] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:05.427214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf1cc4-3758-44af-809b-2ef5f897e71a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:05.427510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf1cc4-3758-44af-809b-2ef5f897e71a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:05.427792 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf1cc4-3758-44af-809b-2ef5f897e71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:05.432041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1080/2122] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:05.432041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd782e86-640d-4c74-9850-7e76c6675f1c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:05.432041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd782e86-640d-4c74-9850-7e76c6675f1c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:05.432041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd782e86-640d-4c74-9850-7e76c6675f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:05.452440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-cd782e86-640d-4c74-9850-7e76c6675f1c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:05.453774 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cd782e86-640d-4c74-9850-7e76c6675f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:05.455481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f1cf1cc4-3758-44af-809b-2ef5f897e71a None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:05.456989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f1cf1cc4-3758-44af-809b-2ef5f897e71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:05.468499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1081/2123] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:05.469556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd782e86-640d-4c74-9850-7e76c6675f1c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:05.471046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cd782e86-640d-4c74-9850-7e76c6675f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:05.474171 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1043/2124] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:05.476543 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf1cc4-3758-44af-809b-2ef5f897e71a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:05.478362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f1cf1cc4-3758-44af-809b-2ef5f897e71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:05.517878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:05.544375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd782e86-640d-4c74-9850-7e76c6675f1c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:05.548738 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf1cc4-3758-44af-809b-2ef5f897e71a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:05.548976 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7ad35-a333-4b33-8319-48e69ca86a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:05.549589 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7ad35-a333-4b33-8319-48e69ca86a9d service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:05.549871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7ad35-a333-4b33-8319-48e69ca86a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:05.550156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7ad35-a333-4b33-8319-48e69ca86a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:05.553694 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41774e-4fc1-4d6c-9176-a413f453c8b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:05.554675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41774e-4fc1-4d6c-9176-a413f453c8b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:05.554969 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41774e-4fc1-4d6c-9176-a413f453c8b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:05.555250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41774e-4fc1-4d6c-9176-a413f453c8b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:05.561357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7ad35-a333-4b33-8319-48e69ca86a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:05.563220 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7ad35-a333-4b33-8319-48e69ca86a9d service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:05.568615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41774e-4fc1-4d6c-9176-a413f453c8b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:05.570976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41774e-4fc1-4d6c-9176-a413f453c8b6 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:05.576308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1082/2125] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:05.578661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fa418-45d2-4c6b-98e4-c4cbf1161b1f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:05.578975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fa418-45d2-4c6b-98e4-c4cbf1161b1f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:05.579226 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fa418-45d2-4c6b-98e4-c4cbf1161b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:05.585345 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1044/2126] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:05.586742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e760c-28e0-452a-8c5b-419319b28da5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:05.593393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e760c-28e0-452a-8c5b-419319b28da5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:05.593393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e760c-28e0-452a-8c5b-419319b28da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:05.603818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-375fa418-45d2-4c6b-98e4-c4cbf1161b1f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:05.605714 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-375fa418-45d2-4c6b-98e4-c4cbf1161b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:05.610965 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1d4e760c-28e0-452a-8c5b-419319b28da5 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:05.612553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1d4e760c-28e0-452a-8c5b-419319b28da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:05.615743 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1083/2127] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:05.619939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fa418-45d2-4c6b-98e4-c4cbf1161b1f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:05.636614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1045/2128] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:05.642043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e760c-28e0-452a-8c5b-419319b28da5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:05.642215 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fa418-45d2-4c6b-98e4-c4cbf1161b1f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:05.647881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc0c26-2c31-48d1-8bb9-4e638a4e0d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:05.648641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc0c26-2c31-48d1-8bb9-4e638a4e0d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:05.650672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc0c26-2c31-48d1-8bb9-4e638a4e0d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:05.650672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc0c26-2c31-48d1-8bb9-4e638a4e0d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:05.650672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc0c26-2c31-48d1-8bb9-4e638a4e0d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:24:05.650672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc0c26-2c31-48d1-8bb9-4e638a4e0d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:05.652948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc0c26-2c31-48d1-8bb9-4e638a4e0d9a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:05.656566 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e760c-28e0-452a-8c5b-419319b28da5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:05.665191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b63721-02ae-4424-8747-1f7f93dd8733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:05.666106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b63721-02ae-4424-8747-1f7f93dd8733 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:05.666469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b63721-02ae-4424-8747-1f7f93dd8733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:05.666818 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b63721-02ae-4424-8747-1f7f93dd8733 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:05.667643 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b63721-02ae-4424-8747-1f7f93dd8733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:24:05.668073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b63721-02ae-4424-8747-1f7f93dd8733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:05.670648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b63721-02ae-4424-8747-1f7f93dd8733 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:05.671149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1084/2129] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:24:05.675257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc0c26-2c31-48d1-8bb9-4e638a4e0d9a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:05.688923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc0c26-2c31-48d1-8bb9-4e638a4e0d9a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:05.695974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1046/2130] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:24:05.696172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5552677-921c-436c-b120-e6dd8530b573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:05.696172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5552677-921c-436c-b120-e6dd8530b573 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:05.696172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5552677-921c-436c-b120-e6dd8530b573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:05.696418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5552677-921c-436c-b120-e6dd8530b573 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:05.697029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5552677-921c-436c-b120-e6dd8530b573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:05.698200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b63721-02ae-4424-8747-1f7f93dd8733 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:05.699265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5552677-921c-436c-b120-e6dd8530b573 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:05.721012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b63721-02ae-4424-8747-1f7f93dd8733 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:05.738029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb48250-7105-42fe-a978-2429d1360ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:05.741123 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb48250-7105-42fe-a978-2429d1360ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:05.743591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb48250-7105-42fe-a978-2429d1360ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:05.744733 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb48250-7105-42fe-a978-2429d1360ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:05.746125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb48250-7105-42fe-a978-2429d1360ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:05.762044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb48250-7105-42fe-a978-2429d1360ea5 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:05.812209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1085/2131] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:24:05 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:24:05.815449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5552677-921c-436c-b120-e6dd8530b573 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:05.833170 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:05.872060 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1047/2132] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:24:05 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:24:05.874295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb48250-7105-42fe-a978-2429d1360ea5 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:05.942330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5552677-921c-436c-b120-e6dd8530b573 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:06.000292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb48250-7105-42fe-a978-2429d1360ea5 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:06.005640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:06.005817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625d461-f128-4333-a8c6-947fe0392cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:06.006387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625d461-f128-4333-a8c6-947fe0392cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:06.006782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625d461-f128-4333-a8c6-947fe0392cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:06.007063 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625d461-f128-4333-a8c6-947fe0392cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:06.007821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625d461-f128-4333-a8c6-947fe0392cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:06.009866 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625d461-f128-4333-a8c6-947fe0392cf0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:06.011799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb78b96-5757-45e0-9b44-72bfde617ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:06.012614 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb78b96-5757-45e0-9b44-72bfde617ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:06.013140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb78b96-5757-45e0-9b44-72bfde617ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:06.013417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb78b96-5757-45e0-9b44-72bfde617ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:06.014103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb78b96-5757-45e0-9b44-72bfde617ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:06.016019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb78b96-5757-45e0-9b44-72bfde617ad1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:06.098364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1048/2133] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:24:05 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:24:06.103393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625d461-f128-4333-a8c6-947fe0392cf0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:06.116576 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625d461-f128-4333-a8c6-947fe0392cf0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:06.124290 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcbeae-c9ab-4553-9f31-268a07ad2a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:06.127336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1086/2134] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:24:05 2022] POST /identity/v3/users => generated 287 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:24:06.127448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcbeae-c9ab-4553-9f31-268a07ad2a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:06.127448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcbeae-c9ab-4553-9f31-268a07ad2a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:06.127448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcbeae-c9ab-4553-9f31-268a07ad2a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:06.127448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcbeae-c9ab-4553-9f31-268a07ad2a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:06.128355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb78b96-5757-45e0-9b44-72bfde617ad1 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:06.129846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcbeae-c9ab-4553-9f31-268a07ad2a7f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:06.142655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1049/2135] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:24:06.146295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcbeae-c9ab-4553-9f31-268a07ad2a7f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:06.153282 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb78b96-5757-45e0-9b44-72bfde617ad1 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:06.163932 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511b19d-3f04-4213-b647-f068e4d6c259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:06.164641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511b19d-3f04-4213-b647-f068e4d6c259 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:06.164922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511b19d-3f04-4213-b647-f068e4d6c259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:06.165089 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcbeae-c9ab-4553-9f31-268a07ad2a7f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:06.165214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511b19d-3f04-4213-b647-f068e4d6c259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:06.165930 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511b19d-3f04-4213-b647-f068e4d6c259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:06.169425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511b19d-3f04-4213-b647-f068e4d6c259 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:06.171792 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a10ca8-846b-4968-b54c-8d26eec159d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:06.172782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a10ca8-846b-4968-b54c-8d26eec159d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:06.173506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a10ca8-846b-4968-b54c-8d26eec159d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:06.173858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a10ca8-846b-4968-b54c-8d26eec159d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:06.174957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a10ca8-846b-4968-b54c-8d26eec159d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:06.176828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a10ca8-846b-4968-b54c-8d26eec159d2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:06.194397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1050/2136] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:24:06.196165 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a10ca8-846b-4968-b54c-8d26eec159d2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:06.207343 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1087/2137] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:06.208548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511b19d-3f04-4213-b647-f068e4d6c259 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:06.222086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511b19d-3f04-4213-b647-f068e4d6c259 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:06.227336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a10ca8-846b-4968-b54c-8d26eec159d2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:06.238265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dcb2f-6d09-43a4-918c-d6e31765222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:06.239199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dcb2f-6d09-43a4-918c-d6e31765222f admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:06.239484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dcb2f-6d09-43a4-918c-d6e31765222f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:06.239764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dcb2f-6d09-43a4-918c-d6e31765222f admin admin] PATH_INFO: `/v3/projects/de18cfd818bf4f4f83c41cb474e87afc/users/257606bdf38c4a9787c2625723501e71/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:06.243817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88817836-3c7c-455c-909e-65e43349ed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:06.244547 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88817836-3c7c-455c-909e-65e43349ed99 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:06.244984 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88817836-3c7c-455c-909e-65e43349ed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:06.245264 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88817836-3c7c-455c-909e-65e43349ed99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:06.246006 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88817836-3c7c-455c-909e-65e43349ed99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:06.247636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88817836-3c7c-455c-909e-65e43349ed99 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:06.271565 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1051/2138] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:24:06.272882 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88817836-3c7c-455c-909e-65e43349ed99 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:06.276942 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905dcb2f-6d09-43a4-918c-d6e31765222f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de18cfd818bf4f4f83c41cb474e87afc, user_id=257606bdf38c4a9787c2625723501e71, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:06.280401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905dcb2f-6d09-43a4-918c-d6e31765222f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:06.288612 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88817836-3c7c-455c-909e-65e43349ed99 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:06.294855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563051b2-4489-4563-b186-ca4c9dfa5267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:06.295854 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563051b2-4489-4563-b186-ca4c9dfa5267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:06.296299 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563051b2-4489-4563-b186-ca4c9dfa5267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:06.301289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563051b2-4489-4563-b186-ca4c9dfa5267 admin admin] PATH_INFO: `/v3/projects/59ed5bc7ca1c4d7795fc40241e264a52/users/42686ca331b14f548fb013dccf68bcc6/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:06.315467 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563051b2-4489-4563-b186-ca4c9dfa5267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ed5bc7ca1c4d7795fc40241e264a52, user_id=42686ca331b14f548fb013dccf68bcc6, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:06.318196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563051b2-4489-4563-b186-ca4c9dfa5267 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:06.403620 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:06.408096 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1088/2139] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:24:06 2022] PUT /identity/v3/projects/de18cfd818bf4f4f83c41cb474e87afc/users/257606bdf38c4a9787c2625723501e71/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:06.410050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29f61-6f09-4b95-8120-244e55b5be4d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:06.410050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29f61-6f09-4b95-8120-244e55b5be4d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:06.410358 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29f61-6f09-4b95-8120-244e55b5be4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:06.427330 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1052/2140] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:24:06 2022] PUT /identity/v3/projects/59ed5bc7ca1c4d7795fc40241e264a52/users/42686ca331b14f548fb013dccf68bcc6/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:06.434103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5b1a2-02e2-4bde-80e5-c129199ac958 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:06.434389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5b1a2-02e2-4bde-80e5-c129199ac958 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:06.434667 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5b1a2-02e2-4bde-80e5-c129199ac958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:06.443574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1fc29f61-6f09-4b95-8120-244e55b5be4d None None] MFA Rules not processed for user `257606bdf38c4a9787c2625723501e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:06.444600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1fc29f61-6f09-4b95-8120-244e55b5be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:06.464513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:06.477156 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4dd5b1a2-02e2-4bde-80e5-c129199ac958 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:06.479087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4dd5b1a2-02e2-4bde-80e5-c129199ac958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:06.526708 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1089/2141] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:06.535180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc29f61-6f09-4b95-8120-244e55b5be4d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:06.538989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1fc29f61-6f09-4b95-8120-244e55b5be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:06.633686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1053/2142] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:06.646046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5b1a2-02e2-4bde-80e5-c129199ac958 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:06.689440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc29f61-6f09-4b95-8120-244e55b5be4d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:06.695467 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533f2db-e171-421f-b1e6-4ff0c2382f17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:06.696315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533f2db-e171-421f-b1e6-4ff0c2382f17 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:06.696684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533f2db-e171-421f-b1e6-4ff0c2382f17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:06.696959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533f2db-e171-421f-b1e6-4ff0c2382f17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:06.709635 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533f2db-e171-421f-b1e6-4ff0c2382f17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:06.711222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533f2db-e171-421f-b1e6-4ff0c2382f17 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:06.726700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1090/2143] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:06.732111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5b1a2-02e2-4bde-80e5-c129199ac958 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:06.736969 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec232c06-44e8-4d8f-90c8-8e3aded5eb8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:06.737957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec232c06-44e8-4d8f-90c8-8e3aded5eb8f service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:06.738398 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec232c06-44e8-4d8f-90c8-8e3aded5eb8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:06.738913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec232c06-44e8-4d8f-90c8-8e3aded5eb8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:06.750151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec232c06-44e8-4d8f-90c8-8e3aded5eb8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:06.751869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec232c06-44e8-4d8f-90c8-8e3aded5eb8f service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:06.758935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533f2db-e171-421f-b1e6-4ff0c2382f17 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:06.764999 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1054/2144] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:06.776554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533f2db-e171-421f-b1e6-4ff0c2382f17 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:06.782220 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f611f19-2a52-4a13-b01c-46a64fe7e149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:06.782787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f611f19-2a52-4a13-b01c-46a64fe7e149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:06.783068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f611f19-2a52-4a13-b01c-46a64fe7e149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:06.783342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f611f19-2a52-4a13-b01c-46a64fe7e149 admin admin] PATH_INFO: `/v3/users/257606bdf38c4a9787c2625723501e71` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:06.784686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f611f19-2a52-4a13-b01c-46a64fe7e149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=257606bdf38c4a9787c2625723501e71)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:06.786941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f611f19-2a52-4a13-b01c-46a64fe7e149 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:06.839440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:06.886107 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec232c06-44e8-4d8f-90c8-8e3aded5eb8f service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:06.887652 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ec232c06-44e8-4d8f-90c8-8e3aded5eb8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:06.907393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec232c06-44e8-4d8f-90c8-8e3aded5eb8f service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:06.913469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decf03c-74af-404b-9fe5-ee9a7c93407a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:06.914348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decf03c-74af-404b-9fe5-ee9a7c93407a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:06.914631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decf03c-74af-404b-9fe5-ee9a7c93407a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:06.914909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decf03c-74af-404b-9fe5-ee9a7c93407a admin admin] PATH_INFO: `/v3/projects/f24d0f1c0a514b019ca37e26640198c6` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:06.917141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decf03c-74af-404b-9fe5-ee9a7c93407a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f24d0f1c0a514b019ca37e26640198c6)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:06.919440 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decf03c-74af-404b-9fe5-ee9a7c93407a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:07.009792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7f611f19-2a52-4a13-b01c-46a64fe7e149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '257606bdf38c4a9787c2625723501e71'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.022695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:07.033739 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7f611f19-2a52-4a13-b01c-46a64fe7e149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '257606bdf38c4a9787c2625723501e71'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.097366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9decf03c-74af-404b-9fe5-ee9a7c93407a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f24d0f1c0a514b019ca37e26640198c6', 'request_id': 'req-9decf03c-74af-404b-9fe5-ee9a7c93407a'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.111891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7f611f19-2a52-4a13-b01c-46a64fe7e149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '257606bdf38c4a9787c2625723501e71'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.116828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7f611f19-2a52-4a13-b01c-46a64fe7e149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '257606bdf38c4a9787c2625723501e71'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.130435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7f611f19-2a52-4a13-b01c-46a64fe7e149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '257606bdf38c4a9787c2625723501e71'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.142956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1091/2145] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:24:06 2022] DELETE /identity/v3/users/257606bdf38c4a9787c2625723501e71 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:07.144290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f611f19-2a52-4a13-b01c-46a64fe7e149 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:07.146265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7f611f19-2a52-4a13-b01c-46a64fe7e149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:07.226927 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9decf03c-74af-404b-9fe5-ee9a7c93407a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f24d0f1c0a514b019ca37e26640198c6', 'request_id': 'req-9decf03c-74af-404b-9fe5-ee9a7c93407a'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.235727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9decf03c-74af-404b-9fe5-ee9a7c93407a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f24d0f1c0a514b019ca37e26640198c6', 'request_id': 'req-9decf03c-74af-404b-9fe5-ee9a7c93407a'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.240217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f611f19-2a52-4a13-b01c-46a64fe7e149 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:07.246141 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d3585-9f3a-4162-a063-cf90f17e7f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:07.247380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d3585-9f3a-4162-a063-cf90f17e7f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:07.247681 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d3585-9f3a-4162-a063-cf90f17e7f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:07.247970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d3585-9f3a-4162-a063-cf90f17e7f8c admin admin] PATH_INFO: `/v3/projects/862f35a65c7a410dbe3325551d663496` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:07.249481 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d3585-9f3a-4162-a063-cf90f17e7f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=862f35a65c7a410dbe3325551d663496)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:07.251447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d3585-9f3a-4162-a063-cf90f17e7f8c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:07.258605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9decf03c-74af-404b-9fe5-ee9a7c93407a admin admin] The token cache is being invalidate because project f24d0f1c0a514b019ca37e26640198c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:07.259268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9decf03c-74af-404b-9fe5-ee9a7c93407a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.260915 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9decf03c-74af-404b-9fe5-ee9a7c93407a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.266542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1055/2146] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:24:06 2022] DELETE /identity/v3/projects/f24d0f1c0a514b019ca37e26640198c6 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:07.270842 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab76ee-46bc-4e86-a2be-c129e709fd94 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:07.271378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab76ee-46bc-4e86-a2be-c129e709fd94 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:07.272563 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab76ee-46bc-4e86-a2be-c129e709fd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:07.300346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f8ab76ee-46bc-4e86-a2be-c129e709fd94 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:07.301775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f8ab76ee-46bc-4e86-a2be-c129e709fd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:07.310588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1056/2147] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:07.311886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607712f-c15c-4538-9c4c-3f4a00b7e7c4 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:07.312814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607712f-c15c-4538-9c4c-3f4a00b7e7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:07.313108 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607712f-c15c-4538-9c4c-3f4a00b7e7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:07.335010 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c607712f-c15c-4538-9c4c-3f4a00b7e7c4 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:07.336433 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c607712f-c15c-4538-9c4c-3f4a00b7e7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:07.355207 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1057/2148] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:07.358924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607712f-c15c-4538-9c4c-3f4a00b7e7c4 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:07.362442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c607712f-c15c-4538-9c4c-3f4a00b7e7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:07.371614 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-743d3585-9f3a-4162-a063-cf90f17e7f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '862f35a65c7a410dbe3325551d663496', 'request_id': 'req-743d3585-9f3a-4162-a063-cf90f17e7f8c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.437716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-743d3585-9f3a-4162-a063-cf90f17e7f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '862f35a65c7a410dbe3325551d663496', 'request_id': 'req-743d3585-9f3a-4162-a063-cf90f17e7f8c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.448133 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-743d3585-9f3a-4162-a063-cf90f17e7f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '862f35a65c7a410dbe3325551d663496', 'request_id': 'req-743d3585-9f3a-4162-a063-cf90f17e7f8c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.461489 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607712f-c15c-4538-9c4c-3f4a00b7e7c4 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:07.473573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-743d3585-9f3a-4162-a063-cf90f17e7f8c admin admin] The token cache is being invalidate because project 862f35a65c7a410dbe3325551d663496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:07.474088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-743d3585-9f3a-4162-a063-cf90f17e7f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.474860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-743d3585-9f3a-4162-a063-cf90f17e7f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.485314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1092/2149] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:24:07 2022] DELETE /identity/v3/projects/862f35a65c7a410dbe3325551d663496 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:07.487843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019accd9-b34b-415f-9a4b-c900e106d616 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:07.493073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019accd9-b34b-415f-9a4b-c900e106d616 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:07.493073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019accd9-b34b-415f-9a4b-c900e106d616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:07.527612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-019accd9-b34b-415f-9a4b-c900e106d616 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:07.529830 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-019accd9-b34b-415f-9a4b-c900e106d616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:07.555106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a964476-0e40-40b3-beb5-7eb48b4d5bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:07.556015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a964476-0e40-40b3-beb5-7eb48b4d5bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:07.556132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a964476-0e40-40b3-beb5-7eb48b4d5bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:07.557006 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a964476-0e40-40b3-beb5-7eb48b4d5bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:07.559172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5a964476-0e40-40b3-beb5-7eb48b4d5bc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:07.646117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a964476-0e40-40b3-beb5-7eb48b4d5bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:07.647893 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1093/2150] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:07.648996 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a964476-0e40-40b3-beb5-7eb48b4d5bc4 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:07.649316 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019accd9-b34b-415f-9a4b-c900e106d616 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:07.652266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-019accd9-b34b-415f-9a4b-c900e106d616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:07.668099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019accd9-b34b-415f-9a4b-c900e106d616 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:07.669831 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1058/2151] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:07.670715 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a964476-0e40-40b3-beb5-7eb48b4d5bc4 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:07.674278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d4739-693d-425a-a83a-3ce577e53606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:07.675929 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d4739-693d-425a-a83a-3ce577e53606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:07.677064 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d4739-693d-425a-a83a-3ce577e53606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:07.677568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d4739-693d-425a-a83a-3ce577e53606 admin admin] PATH_INFO: `/v3/users/517cfa87fa6d48ff9f98d63a476a4f99` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:07.679589 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d4739-693d-425a-a83a-3ce577e53606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=517cfa87fa6d48ff9f98d63a476a4f99)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:07.682053 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d4739-693d-425a-a83a-3ce577e53606 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:07.691311 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a964476-0e40-40b3-beb5-7eb48b4d5bc4 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:07.703884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fe769-d1f7-4dff-8d88-fe91f1d26715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:07.704713 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fe769-d1f7-4dff-8d88-fe91f1d26715 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:07.705009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fe769-d1f7-4dff-8d88-fe91f1d26715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:07.705294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fe769-d1f7-4dff-8d88-fe91f1d26715 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:07.710369 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fe769-d1f7-4dff-8d88-fe91f1d26715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:24:07.710369 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fe769-d1f7-4dff-8d88-fe91f1d26715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:07.711591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fe769-d1f7-4dff-8d88-fe91f1d26715 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:07.745194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1059/2152] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:24:07.749358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fe769-d1f7-4dff-8d88-fe91f1d26715 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:07.767203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fe769-d1f7-4dff-8d88-fe91f1d26715 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:07.777145 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fd1cc-4be3-4163-88fd-b4fc4d85c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:07.777908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fd1cc-4be3-4163-88fd-b4fc4d85c1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:07.778198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fd1cc-4be3-4163-88fd-b4fc4d85c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:07.778485 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fd1cc-4be3-4163-88fd-b4fc4d85c1e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:07.779188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fd1cc-4be3-4163-88fd-b4fc4d85c1e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:07.781265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fd1cc-4be3-4163-88fd-b4fc4d85c1e2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:07.886942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1060/2153] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:24:07 2022] POST /identity/v3/projects => generated 399 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:24:07.891420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fd1cc-4be3-4163-88fd-b4fc4d85c1e2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:07.927404 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b58d4739-693d-425a-a83a-3ce577e53606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517cfa87fa6d48ff9f98d63a476a4f99'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:07.953903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b58d4739-693d-425a-a83a-3ce577e53606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517cfa87fa6d48ff9f98d63a476a4f99'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:08.005318 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fd1cc-4be3-4163-88fd-b4fc4d85c1e2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:08.013559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dca376-650b-4de9-b301-5c4dd0a5c000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:08.014251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dca376-650b-4de9-b301-5c4dd0a5c000 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:08.014544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dca376-650b-4de9-b301-5c4dd0a5c000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:08.015314 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dca376-650b-4de9-b301-5c4dd0a5c000 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:08.015522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dca376-650b-4de9-b301-5c4dd0a5c000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:08.017496 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dca376-650b-4de9-b301-5c4dd0a5c000 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:08.083348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b58d4739-693d-425a-a83a-3ce577e53606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517cfa87fa6d48ff9f98d63a476a4f99'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:08.083978 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b58d4739-693d-425a-a83a-3ce577e53606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517cfa87fa6d48ff9f98d63a476a4f99'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:08.094531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b58d4739-693d-425a-a83a-3ce577e53606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517cfa87fa6d48ff9f98d63a476a4f99'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:08.110231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1094/2154] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:24:07 2022] DELETE /identity/v3/users/517cfa87fa6d48ff9f98d63a476a4f99 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:08.166413 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d4739-693d-425a-a83a-3ce577e53606 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:08.169038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b58d4739-693d-425a-a83a-3ce577e53606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:08.170507 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1061/2155] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:24:07 2022] POST /identity/v3/users => generated 300 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:24:08.257530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d4739-693d-425a-a83a-3ce577e53606 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:08.263367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e497b-20e1-4840-baaf-e333965f715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:08.264269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e497b-20e1-4840-baaf-e333965f715a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:08.264866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e497b-20e1-4840-baaf-e333965f715a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:08.265200 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e497b-20e1-4840-baaf-e333965f715a admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:08.266050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e497b-20e1-4840-baaf-e333965f715a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:08.267832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e497b-20e1-4840-baaf-e333965f715a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:08.284177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1095/2156] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:08.286050 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dca376-650b-4de9-b301-5c4dd0a5c000 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:08.297822 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dca376-650b-4de9-b301-5c4dd0a5c000 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:08.303730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9e7c7-b700-47b2-af39-0fc8c14551ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:08.304660 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9e7c7-b700-47b2-af39-0fc8c14551ed admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:08.305030 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9e7c7-b700-47b2-af39-0fc8c14551ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:08.305317 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9e7c7-b700-47b2-af39-0fc8c14551ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:08.306066 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9e7c7-b700-47b2-af39-0fc8c14551ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:08.307690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9e7c7-b700-47b2-af39-0fc8c14551ed admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:08.318413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1062/2157] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:08.323039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e497b-20e1-4840-baaf-e333965f715a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:08.337128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e497b-20e1-4840-baaf-e333965f715a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:08.345233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be920607-2bdf-4f59-a291-536664232c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:08.346154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be920607-2bdf-4f59-a291-536664232c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:08.346439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be920607-2bdf-4f59-a291-536664232c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:08.346715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be920607-2bdf-4f59-a291-536664232c29 admin admin] PATH_INFO: `/v3/projects/cd9553fd2a2047d7ace2e250b17c9c37/users/4f61ba9d12f74dd996a9eebc207d2e9c/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:08.364290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be920607-2bdf-4f59-a291-536664232c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9553fd2a2047d7ace2e250b17c9c37, user_id=4f61ba9d12f74dd996a9eebc207d2e9c, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:08.367354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9e7c7-b700-47b2-af39-0fc8c14551ed admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:08.368150 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be920607-2bdf-4f59-a291-536664232c29 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:08.369568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-76e9e7c7-b700-47b2-af39-0fc8c14551ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:08.386471 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9e7c7-b700-47b2-af39-0fc8c14551ed admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:08.392608 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:08.393541 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:08.393825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:08.394106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] PATH_INFO: `/v3/projects/de18cfd818bf4f4f83c41cb474e87afc` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:08.395819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de18cfd818bf4f4f83c41cb474e87afc)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:08.398376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:08.452710 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1096/2158] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:24:08 2022] PUT /identity/v3/projects/cd9553fd2a2047d7ace2e250b17c9c37/users/4f61ba9d12f74dd996a9eebc207d2e9c/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:08.463001 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8302d-8431-465b-abe5-e10e2317f954 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:08.463402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8302d-8431-465b-abe5-e10e2317f954 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:08.463744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8302d-8431-465b-abe5-e10e2317f954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:08.497217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-59d8302d-8431-465b-abe5-e10e2317f954 None None] MFA Rules not processed for user `4f61ba9d12f74dd996a9eebc207d2e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:08.499135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-59d8302d-8431-465b-abe5-e10e2317f954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:08.571687 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de18cfd818bf4f4f83c41cb474e87afc', 'request_id': 'req-1b873fba-5468-4468-b056-d66deb9d61a3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:08.580676 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:08.621536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1097/2159] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:08.623395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d6574-ebd8-425f-a6a4-704afc4c9743 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:08.623990 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d6574-ebd8-425f-a6a4-704afc4c9743 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:08.624443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d6574-ebd8-425f-a6a4-704afc4c9743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:08.674790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a22d6574-ebd8-425f-a6a4-704afc4c9743 None None] MFA Rules not processed for user `42686ca331b14f548fb013dccf68bcc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:08.676378 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a22d6574-ebd8-425f-a6a4-704afc4c9743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:08.722483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de18cfd818bf4f4f83c41cb474e87afc', 'request_id': 'req-1b873fba-5468-4468-b056-d66deb9d61a3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:08.730464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de18cfd818bf4f4f83c41cb474e87afc', 'request_id': 'req-1b873fba-5468-4468-b056-d66deb9d61a3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:08.753343 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] The token cache is being invalidate because project de18cfd818bf4f4f83c41cb474e87afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:08.753861 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:08.758874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:08.759378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1063/2160] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:24:08 2022] DELETE /identity/v3/projects/de18cfd818bf4f4f83c41cb474e87afc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:08.761209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:08.763087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:08.786818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1098/2161] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:08.792705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad921-00f5-4086-84c1-12b3f27c03d3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:08.792799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad921-00f5-4086-84c1-12b3f27c03d3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:08.793194 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad921-00f5-4086-84c1-12b3f27c03d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:08.820343 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8a0ad921-00f5-4086-84c1-12b3f27c03d3 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:08.822826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8a0ad921-00f5-4086-84c1-12b3f27c03d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:08.855788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873fba-5468-4468-b056-d66deb9d61a3 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:08.861328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2725f-26cd-4e74-86ac-75f047356820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:08.862586 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2725f-26cd-4e74-86ac-75f047356820 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:08.863098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2725f-26cd-4e74-86ac-75f047356820 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:08.863652 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2725f-26cd-4e74-86ac-75f047356820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:08.874961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a0d2725f-26cd-4e74-86ac-75f047356820 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:08.920520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:08.920989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1099/2162] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:08.921881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad921-00f5-4086-84c1-12b3f27c03d3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:08.941493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8a0ad921-00f5-4086-84c1-12b3f27c03d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:08.961100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad921-00f5-4086-84c1-12b3f27c03d3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:08.983199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ea092-4e1b-495a-84e0-ce7b4638ba2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:08.985427 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ea092-4e1b-495a-84e0-ce7b4638ba2f service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:08.986946 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ea092-4e1b-495a-84e0-ce7b4638ba2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:08.987246 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ea092-4e1b-495a-84e0-ce7b4638ba2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:09.011053 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ea092-4e1b-495a-84e0-ce7b4638ba2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:09.012548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ea092-4e1b-495a-84e0-ce7b4638ba2f service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:09.027230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1100/2163] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:09.027230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372daf0-fec9-4cb0-83f0-11463ccb93dc None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:09.027230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372daf0-fec9-4cb0-83f0-11463ccb93dc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:09.027230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372daf0-fec9-4cb0-83f0-11463ccb93dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:09.030050 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2725f-26cd-4e74-86ac-75f047356820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:09.035476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2725f-26cd-4e74-86ac-75f047356820 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:09.047496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4372daf0-fec9-4cb0-83f0-11463ccb93dc None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:09.048753 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4372daf0-fec9-4cb0-83f0-11463ccb93dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:09.059247 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1101/2164] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:09.062194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1064/2165] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:09.080698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372daf0-fec9-4cb0-83f0-11463ccb93dc None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:09.131797 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372daf0-fec9-4cb0-83f0-11463ccb93dc None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:09.133954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682d504-060f-44e5-960c-e89a5cf43295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:09.134821 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682d504-060f-44e5-960c-e89a5cf43295 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:09.135250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682d504-060f-44e5-960c-e89a5cf43295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:09.135669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682d504-060f-44e5-960c-e89a5cf43295 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:09.137065 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682d504-060f-44e5-960c-e89a5cf43295 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:24:09.137538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682d504-060f-44e5-960c-e89a5cf43295 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:09.141291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682d504-060f-44e5-960c-e89a5cf43295 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:09.181001 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1102/2166] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:24:09.185854 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2725f-26cd-4e74-86ac-75f047356820 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:09.204432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2725f-26cd-4e74-86ac-75f047356820 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:09.217135 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4e003-85ac-4af9-809c-0466b9e6d530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:09.217900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4e003-85ac-4af9-809c-0466b9e6d530 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:09.218192 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4e003-85ac-4af9-809c-0466b9e6d530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:09.220624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4e003-85ac-4af9-809c-0466b9e6d530 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:09.222043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4e003-85ac-4af9-809c-0466b9e6d530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:09.226645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4e003-85ac-4af9-809c-0466b9e6d530 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:09.279009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682d504-060f-44e5-960c-e89a5cf43295 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:09.281774 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7682d504-060f-44e5-960c-e89a5cf43295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:09.316451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682d504-060f-44e5-960c-e89a5cf43295 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:09.331948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:09.331948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:09.331948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:09.331948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73 admin admin] PATH_INFO: `/v3/projects/cb4776b38f0947c294ec6b815eb64aef` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:09.332506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4776b38f0947c294ec6b815eb64aef)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:09.333711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:09.367050 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1065/2167] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:24:09 2022] POST /identity/v3/projects => generated 391 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:24:09.371154 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4e003-85ac-4af9-809c-0466b9e6d530 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:09.497198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4776b38f0947c294ec6b815eb64aef', 'request_id': 'req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:09.514568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4e003-85ac-4af9-809c-0466b9e6d530 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:09.603384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4776b38f0947c294ec6b815eb64aef', 'request_id': 'req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:09.625093 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4776b38f0947c294ec6b815eb64aef', 'request_id': 'req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:09.640124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73 admin admin] The token cache is being invalidate because project cb4776b38f0947c294ec6b815eb64aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:09.640573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:09.641502 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5c96ba5a-3945-4359-8f01-d8ce5a9ade73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:09.648159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1103/2168] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:24:09 2022] DELETE /identity/v3/projects/cb4776b38f0947c294ec6b815eb64aef => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:09.650025 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb1fe6-e4e4-437d-a72a-50d63e614cd6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:09.650416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb1fe6-e4e4-437d-a72a-50d63e614cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:09.651138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb1fe6-e4e4-437d-a72a-50d63e614cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:09.663065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6114d-65a8-432f-b548-cb9ab3f04cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:09.664824 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6114d-65a8-432f-b548-cb9ab3f04cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:09.665274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6114d-65a8-432f-b548-cb9ab3f04cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:09.665710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6114d-65a8-432f-b548-cb9ab3f04cbe admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:09.667512 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6114d-65a8-432f-b548-cb9ab3f04cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:09.670753 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6114d-65a8-432f-b548-cb9ab3f04cbe admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:09.673907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-69bb1fe6-e4e4-437d-a72a-50d63e614cd6 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:09.675677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-69bb1fe6-e4e4-437d-a72a-50d63e614cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:09.686407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1104/2169] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:09.695198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e96db-79f9-4d9e-91e8-67a69c7952b8 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:09.695537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e96db-79f9-4d9e-91e8-67a69c7952b8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:09.695934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e96db-79f9-4d9e-91e8-67a69c7952b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:09.716055 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ca1e96db-79f9-4d9e-91e8-67a69c7952b8 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:09.717499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ca1e96db-79f9-4d9e-91e8-67a69c7952b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:09.745232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1105/2170] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:09.749752 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e96db-79f9-4d9e-91e8-67a69c7952b8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:09.761606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e96db-79f9-4d9e-91e8-67a69c7952b8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:09.767606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa26db-4ee2-4485-b571-eafe21bb6b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:09.768553 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa26db-4ee2-4485-b571-eafe21bb6b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:09.768941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa26db-4ee2-4485-b571-eafe21bb6b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:09.769319 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa26db-4ee2-4485-b571-eafe21bb6b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:09.770350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa26db-4ee2-4485-b571-eafe21bb6b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:24:09.770808 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa26db-4ee2-4485-b571-eafe21bb6b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:09.773503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa26db-4ee2-4485-b571-eafe21bb6b52 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:09.792662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1106/2171] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:24:09.797154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa26db-4ee2-4485-b571-eafe21bb6b52 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:09.802171 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1066/2172] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:24:09 2022] POST /identity/v3/users => generated 296 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:24:09.810351 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6114d-65a8-432f-b548-cb9ab3f04cbe admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:09.812274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f2e6114d-65a8-432f-b548-cb9ab3f04cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:09.823012 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa26db-4ee2-4485-b571-eafe21bb6b52 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:09.830683 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6114d-65a8-432f-b548-cb9ab3f04cbe admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:09.834833 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c571eac-77cb-4d12-9ca6-463e13ecbd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:09.841176 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c571eac-77cb-4d12-9ca6-463e13ecbd44 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:09.841176 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c571eac-77cb-4d12-9ca6-463e13ecbd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:09.841782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4248b-7b28-47e9-aae4-23968bc103e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:09.841782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4248b-7b28-47e9-aae4-23968bc103e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:09.841782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4248b-7b28-47e9-aae4-23968bc103e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:09.841782 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4248b-7b28-47e9-aae4-23968bc103e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:09.842148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4248b-7b28-47e9-aae4-23968bc103e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:09.842233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c571eac-77cb-4d12-9ca6-463e13ecbd44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:09.842329 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4248b-7b28-47e9-aae4-23968bc103e2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:09.842416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c571eac-77cb-4d12-9ca6-463e13ecbd44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:09.847594 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c571eac-77cb-4d12-9ca6-463e13ecbd44 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:09.860737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1067/2173] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:09.863151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4248b-7b28-47e9-aae4-23968bc103e2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:09.892915 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4248b-7b28-47e9-aae4-23968bc103e2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:09.902709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7961b-9c7c-4727-9f69-b67bc1b07f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:09.903400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7961b-9c7c-4727-9f69-b67bc1b07f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:09.903691 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7961b-9c7c-4727-9f69-b67bc1b07f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:09.903950 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7961b-9c7c-4727-9f69-b67bc1b07f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:09.904785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7961b-9c7c-4727-9f69-b67bc1b07f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:09.906386 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7961b-9c7c-4727-9f69-b67bc1b07f5b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:09.929718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1068/2174] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:09.936086 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7961b-9c7c-4727-9f69-b67bc1b07f5b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:09.960978 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7961b-9c7c-4727-9f69-b67bc1b07f5b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:09.971419 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c0365-fc12-4d49-8c33-205074247c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:09.972641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c0365-fc12-4d49-8c33-205074247c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:09.973383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c0365-fc12-4d49-8c33-205074247c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:09.974028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c0365-fc12-4d49-8c33-205074247c44 admin admin] PATH_INFO: `/v3/projects/200eada200204d3894a877c1e0204553/users/8ff699275a974745900040005682f0af/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:09.998929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c0365-fc12-4d49-8c33-205074247c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=200eada200204d3894a877c1e0204553, user_id=8ff699275a974745900040005682f0af, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:10.012693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c0365-fc12-4d49-8c33-205074247c44 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:10.024532 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1107/2175] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:24:09 2022] POST /identity/v3/projects => generated 363 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:24:10.029083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c571eac-77cb-4d12-9ca6-463e13ecbd44 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:10.154920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1069/2176] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:24:09 2022] PUT /identity/v3/projects/200eada200204d3894a877c1e0204553/users/8ff699275a974745900040005682f0af/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:10.156469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c16e8c-f5dc-4223-a350-9b2008a8c91a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:10.156772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c16e8c-f5dc-4223-a350-9b2008a8c91a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:10.157052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c16e8c-f5dc-4223-a350-9b2008a8c91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:10.211698 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f0c16e8c-f5dc-4223-a350-9b2008a8c91a None None] MFA Rules not processed for user `3af2be9c1e9a4f0c8f4bdaa04769756c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:10.212950 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f0c16e8c-f5dc-4223-a350-9b2008a8c91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:10.217850 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c571eac-77cb-4d12-9ca6-463e13ecbd44 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:10.306011 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1070/2177] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:10.307357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda5698-55ea-4462-b167-07d0ebd5b566 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:10.307650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda5698-55ea-4462-b167-07d0ebd5b566 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:10.308503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda5698-55ea-4462-b167-07d0ebd5b566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:10.310523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9499397-3f69-446d-9281-ab14361e7773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:10.311238 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9499397-3f69-446d-9281-ab14361e7773 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:10.311544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9499397-3f69-446d-9281-ab14361e7773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:10.311814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9499397-3f69-446d-9281-ab14361e7773 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:10.312525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9499397-3f69-446d-9281-ab14361e7773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:10.321002 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9499397-3f69-446d-9281-ab14361e7773 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:10.341953 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8cda5698-55ea-4462-b167-07d0ebd5b566 None None] MFA Rules not processed for user `8ff699275a974745900040005682f0af`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:10.343186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8cda5698-55ea-4462-b167-07d0ebd5b566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:10.421189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1108/2178] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:24:10 2022] POST /identity/v3/users => generated 282 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:24:10.422105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9499397-3f69-446d-9281-ab14361e7773 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:10.426510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b9499397-3f69-446d-9281-ab14361e7773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:10.442779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1071/2179] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:10.444743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda5698-55ea-4462-b167-07d0ebd5b566 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:10.465357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda5698-55ea-4462-b167-07d0ebd5b566 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:10.471771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7a694-83fd-427a-a913-789a29c27f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:10.473204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7a694-83fd-427a-a913-789a29c27f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:10.474289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7a694-83fd-427a-a913-789a29c27f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:10.474723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7a694-83fd-427a-a913-789a29c27f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:10.475902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7a694-83fd-427a-a913-789a29c27f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:10.477703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7a694-83fd-427a-a913-789a29c27f90 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:10.490059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1072/2180] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:10.491474 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7a694-83fd-427a-a913-789a29c27f90 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:10.494444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-28e7a694-83fd-427a-a913-789a29c27f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:10.529532 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9499397-3f69-446d-9281-ab14361e7773 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:10.535499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73569b1a-6543-4d9f-858a-da4f599fe620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:10.536190 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73569b1a-6543-4d9f-858a-da4f599fe620 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:10.536480 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73569b1a-6543-4d9f-858a-da4f599fe620 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:10.536764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73569b1a-6543-4d9f-858a-da4f599fe620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:10.545453 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73569b1a-6543-4d9f-858a-da4f599fe620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:10.547059 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73569b1a-6543-4d9f-858a-da4f599fe620 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:10.554909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7a694-83fd-427a-a913-789a29c27f90 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:10.557405 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1109/2181] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:10.558485 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73569b1a-6543-4d9f-858a-da4f599fe620 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:10.559075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3096282-cfdf-455a-841a-9dc2d10ee794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:10.559835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3096282-cfdf-455a-841a-9dc2d10ee794 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:10.560231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3096282-cfdf-455a-841a-9dc2d10ee794 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:10.560568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3096282-cfdf-455a-841a-9dc2d10ee794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:10.569883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73569b1a-6543-4d9f-858a-da4f599fe620 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:10.571120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3096282-cfdf-455a-841a-9dc2d10ee794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:10.572865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3096282-cfdf-455a-841a-9dc2d10ee794 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:10.574879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddf1f7-1c2f-49e3-b223-4099bf56bd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:10.575544 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddf1f7-1c2f-49e3-b223-4099bf56bd25 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:10.575827 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddf1f7-1c2f-49e3-b223-4099bf56bd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:10.576135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddf1f7-1c2f-49e3-b223-4099bf56bd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:10.576852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddf1f7-1c2f-49e3-b223-4099bf56bd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:10.578429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddf1f7-1c2f-49e3-b223-4099bf56bd25 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:10.587036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1073/2182] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:10.588951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1110/2183] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:10.593235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3096282-cfdf-455a-841a-9dc2d10ee794 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:10.605812 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3096282-cfdf-455a-841a-9dc2d10ee794 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:10.610575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba4e00-ce23-4247-b5fc-0a1bba7213dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:10.611535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba4e00-ce23-4247-b5fc-0a1bba7213dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:10.611909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba4e00-ce23-4247-b5fc-0a1bba7213dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:10.612278 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba4e00-ce23-4247-b5fc-0a1bba7213dc admin admin] PATH_INFO: `/v3/projects/36c1ed05b8bf4125900b8205c8f62715/users/04e11a6a372a4250885e8da13e3e5557/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:10.628560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba4e00-ce23-4247-b5fc-0a1bba7213dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c1ed05b8bf4125900b8205c8f62715, user_id=04e11a6a372a4250885e8da13e3e5557, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:10.631907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba4e00-ce23-4247-b5fc-0a1bba7213dc admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:10.734858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1074/2184] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:24:10 2022] PUT /identity/v3/projects/36c1ed05b8bf4125900b8205c8f62715/users/04e11a6a372a4250885e8da13e3e5557/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:10.746907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f296b1-b502-4008-9a7f-92422624aaa3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:10.747465 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f296b1-b502-4008-9a7f-92422624aaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:10.747465 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f296b1-b502-4008-9a7f-92422624aaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:10.776056 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-24f296b1-b502-4008-9a7f-92422624aaa3 None None] MFA Rules not processed for user `04e11a6a372a4250885e8da13e3e5557`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:10.777356 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-24f296b1-b502-4008-9a7f-92422624aaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:10.845841 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1111/2185] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:10 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:10.850750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba4e00-ce23-4247-b5fc-0a1bba7213dc admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:10.940957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba4e00-ce23-4247-b5fc-0a1bba7213dc admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:10.947067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a22154-6993-4831-a11d-e476fd70c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:10.947871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22154-6993-4831-a11d-e476fd70c609 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:10.948329 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22154-6993-4831-a11d-e476fd70c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:10.948744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22154-6993-4831-a11d-e476fd70c609 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:10.949873 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a22154-6993-4831-a11d-e476fd70c609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:10.951924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a22154-6993-4831-a11d-e476fd70c609 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:10.979417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:11.073432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1075/2186] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:24:10 2022] POST /identity/v3/projects => generated 365 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:24:11.077504 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f296b1-b502-4008-9a7f-92422624aaa3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:11.089191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f296b1-b502-4008-9a7f-92422624aaa3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:11.148742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593fa3c-eade-4e97-9a82-96e4cf9bc401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:11.149558 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593fa3c-eade-4e97-9a82-96e4cf9bc401 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:11.149710 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593fa3c-eade-4e97-9a82-96e4cf9bc401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:11.153440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593fa3c-eade-4e97-9a82-96e4cf9bc401 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:11.153440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593fa3c-eade-4e97-9a82-96e4cf9bc401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:11.153440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593fa3c-eade-4e97-9a82-96e4cf9bc401 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:11.241081 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1112/2187] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:24:11 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:24:11.245262 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a22154-6993-4831-a11d-e476fd70c609 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:11.261451 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a22154-6993-4831-a11d-e476fd70c609 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:11.268408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981675d-0611-47c5-8ec0-48dc138e1c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:11.269329 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981675d-0611-47c5-8ec0-48dc138e1c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:11.269824 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981675d-0611-47c5-8ec0-48dc138e1c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:11.270352 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981675d-0611-47c5-8ec0-48dc138e1c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:11.272035 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981675d-0611-47c5-8ec0-48dc138e1c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:11.273863 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981675d-0611-47c5-8ec0-48dc138e1c85 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:11.300160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1076/2188] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:11.302661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593fa3c-eade-4e97-9a82-96e4cf9bc401 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:11.322071 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593fa3c-eade-4e97-9a82-96e4cf9bc401 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:11.322071 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9dab2-4a29-462b-a9c5-85d44aafc303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:11.326225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9dab2-4a29-462b-a9c5-85d44aafc303 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:11.326225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9dab2-4a29-462b-a9c5-85d44aafc303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:11.326225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9dab2-4a29-462b-a9c5-85d44aafc303 admin admin] PATH_INFO: `/v3/projects/a9da4d34c1274e6c9a5abd59b1c21c61/users/0641249e5ce844d982f3097bcd90507e/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:11.345876 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9dab2-4a29-462b-a9c5-85d44aafc303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9da4d34c1274e6c9a5abd59b1c21c61, user_id=0641249e5ce844d982f3097bcd90507e, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:11.349001 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9dab2-4a29-462b-a9c5-85d44aafc303 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:11.409344 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:11.463483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1113/2189] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:24:11 2022] PUT /identity/v3/projects/a9da4d34c1274e6c9a5abd59b1c21c61/users/0641249e5ce844d982f3097bcd90507e/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:11.467123 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981675d-0611-47c5-8ec0-48dc138e1c85 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:11.479080 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981675d-0611-47c5-8ec0-48dc138e1c85 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:11.543215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba8306-3d1f-4152-9b3c-435d98516bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:11.543878 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba8306-3d1f-4152-9b3c-435d98516bed admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:11.544297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba8306-3d1f-4152-9b3c-435d98516bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:11.544572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba8306-3d1f-4152-9b3c-435d98516bed admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:11.545300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba8306-3d1f-4152-9b3c-435d98516bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:11.546967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba8306-3d1f-4152-9b3c-435d98516bed admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:11.567737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9dab2-4a29-462b-a9c5-85d44aafc303 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:11.568863 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1077/2190] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:11.579341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9dab2-4a29-462b-a9c5-85d44aafc303 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:11.587328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1991a07-482c-441b-a426-8e606ad8d8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:11.588243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1991a07-482c-441b-a426-8e606ad8d8ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:11.588528 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1991a07-482c-441b-a426-8e606ad8d8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:11.588804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1991a07-482c-441b-a426-8e606ad8d8ea admin admin] PATH_INFO: `/v3/projects/a9da4d34c1274e6c9a5abd59b1c21c61/users/0641249e5ce844d982f3097bcd90507e/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:11.591796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1991a07-482c-441b-a426-8e606ad8d8ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9da4d34c1274e6c9a5abd59b1c21c61, user_id=0641249e5ce844d982f3097bcd90507e, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:11.594507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1991a07-482c-441b-a426-8e606ad8d8ea admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:11.605380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1114/2191] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:24:11 2022] PUT /identity/v3/projects/a9da4d34c1274e6c9a5abd59b1c21c61/users/0641249e5ce844d982f3097bcd90507e/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:11.615725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973833b-0d27-4c52-b998-0217bfddc23a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:11.616027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973833b-0d27-4c52-b998-0217bfddc23a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:11.616309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973833b-0d27-4c52-b998-0217bfddc23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:11.643895 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3973833b-0d27-4c52-b998-0217bfddc23a None None] MFA Rules not processed for user `0641249e5ce844d982f3097bcd90507e`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:11.645197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3973833b-0d27-4c52-b998-0217bfddc23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:11.719462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1078/2192] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:11.732503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1991a07-482c-441b-a426-8e606ad8d8ea admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:11.795321 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1991a07-482c-441b-a426-8e606ad8d8ea admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:11.799274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27fba8-f0d8-4519-8759-039935c580cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:11.800161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fba8-f0d8-4519-8759-039935c580cf service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:11.804298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fba8-f0d8-4519-8759-039935c580cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:11.804298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fba8-f0d8-4519-8759-039935c580cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:11.811461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27fba8-f0d8-4519-8759-039935c580cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:11.813155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27fba8-f0d8-4519-8759-039935c580cf service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:11.824692 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1115/2193] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:12.105660 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973833b-0d27-4c52-b998-0217bfddc23a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:12.132183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973833b-0d27-4c52-b998-0217bfddc23a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:12.132183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5fdf2-fb4e-445f-8d24-fb3fd9f8c823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:12.132183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5fdf2-fb4e-445f-8d24-fb3fd9f8c823 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:12.132183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5fdf2-fb4e-445f-8d24-fb3fd9f8c823 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:12.133389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5fdf2-fb4e-445f-8d24-fb3fd9f8c823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:12.225989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5fdf2-fb4e-445f-8d24-fb3fd9f8c823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:12.227800 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5fdf2-fb4e-445f-8d24-fb3fd9f8c823 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:12.241508 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1079/2194] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:12 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:12.293953 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455a4df-2ae6-4485-b2e4-04e7f8f6be28 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:12.294272 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455a4df-2ae6-4485-b2e4-04e7f8f6be28 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:12.294697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455a4df-2ae6-4485-b2e4-04e7f8f6be28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:12.326833 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0455a4df-2ae6-4485-b2e4-04e7f8f6be28 None None] MFA Rules not processed for user `42686ca331b14f548fb013dccf68bcc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:12.327747 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0455a4df-2ae6-4485-b2e4-04e7f8f6be28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:12.422216 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1116/2195] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:12.815663 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:13.033272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:13.689822 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd8285-9fa9-466d-8cfc-bd59541ad45c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:13.690124 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd8285-9fa9-466d-8cfc-bd59541ad45c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:13.690397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd8285-9fa9-466d-8cfc-bd59541ad45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:13.709731 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-46bd8285-9fa9-466d-8cfc-bd59541ad45c None None] MFA Rules not processed for user `3af2be9c1e9a4f0c8f4bdaa04769756c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:13.710973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-46bd8285-9fa9-466d-8cfc-bd59541ad45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:13.775455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1080/2196] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:14.814094 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:15.052133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:15.843056 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:16.025765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:16.159866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455a4df-2ae6-4485-b2e4-04e7f8f6be28 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:16.164136 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:16.230565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455a4df-2ae6-4485-b2e4-04e7f8f6be28 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:16.236038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44519244-7bce-4fd0-b1da-48253d687a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:16.239647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519244-7bce-4fd0-b1da-48253d687a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:16.239647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519244-7bce-4fd0-b1da-48253d687a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:16.239647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519244-7bce-4fd0-b1da-48253d687a37 admin admin] PATH_INFO: `/v3/users/04e11a6a372a4250885e8da13e3e5557` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:16.239647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44519244-7bce-4fd0-b1da-48253d687a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e11a6a372a4250885e8da13e3e5557)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:16.240796 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44519244-7bce-4fd0-b1da-48253d687a37 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:16.401541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-44519244-7bce-4fd0-b1da-48253d687a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e11a6a372a4250885e8da13e3e5557'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:16.414336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-44519244-7bce-4fd0-b1da-48253d687a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e11a6a372a4250885e8da13e3e5557'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:16.493409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-44519244-7bce-4fd0-b1da-48253d687a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e11a6a372a4250885e8da13e3e5557'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:16.494043 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-44519244-7bce-4fd0-b1da-48253d687a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e11a6a372a4250885e8da13e3e5557'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:16.514549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-44519244-7bce-4fd0-b1da-48253d687a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e11a6a372a4250885e8da13e3e5557'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:16.514549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1117/2197] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:24:16 2022] DELETE /identity/v3/users/04e11a6a372a4250885e8da13e3e5557 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:16.514729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d33167-a8ad-423c-bf06-db942be3f07f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:16.514729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d33167-a8ad-423c-bf06-db942be3f07f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:16.514729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d33167-a8ad-423c-bf06-db942be3f07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:16.531533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-34d33167-a8ad-423c-bf06-db942be3f07f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:16.532758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-34d33167-a8ad-423c-bf06-db942be3f07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:16.589754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1081/2198] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:16.600831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44519244-7bce-4fd0-b1da-48253d687a37 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:16.602214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-44519244-7bce-4fd0-b1da-48253d687a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:16.659606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44519244-7bce-4fd0-b1da-48253d687a37 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:16.663950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c87806-e7c0-4ce2-b439-9877dd1aca11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:16.664685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c87806-e7c0-4ce2-b439-9877dd1aca11 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:16.664927 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c87806-e7c0-4ce2-b439-9877dd1aca11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:16.665207 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c87806-e7c0-4ce2-b439-9877dd1aca11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:16.674451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c87806-e7c0-4ce2-b439-9877dd1aca11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:16.675938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c87806-e7c0-4ce2-b439-9877dd1aca11 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:16.688643 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1118/2199] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:16.751462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:16.803143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:16.815721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d33167-a8ad-423c-bf06-db942be3f07f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:16.817210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-34d33167-a8ad-423c-bf06-db942be3f07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:16.832384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d33167-a8ad-423c-bf06-db942be3f07f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:16.837174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e7da6-d4da-42fb-9a2a-ac343a22c63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:16.838080 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e7da6-d4da-42fb-9a2a-ac343a22c63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:16.843251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e7da6-d4da-42fb-9a2a-ac343a22c63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:16.843251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e7da6-d4da-42fb-9a2a-ac343a22c63b admin admin] PATH_INFO: `/v3/users/4f61ba9d12f74dd996a9eebc207d2e9c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:16.843251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e7da6-d4da-42fb-9a2a-ac343a22c63b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f61ba9d12f74dd996a9eebc207d2e9c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:16.843251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e7da6-d4da-42fb-9a2a-ac343a22c63b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:17.057827 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4a5e7da6-d4da-42fb-9a2a-ac343a22c63b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f61ba9d12f74dd996a9eebc207d2e9c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:17.072937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4a5e7da6-d4da-42fb-9a2a-ac343a22c63b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f61ba9d12f74dd996a9eebc207d2e9c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:17.073668 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4a5e7da6-d4da-42fb-9a2a-ac343a22c63b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f61ba9d12f74dd996a9eebc207d2e9c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:17.150491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4a5e7da6-d4da-42fb-9a2a-ac343a22c63b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f61ba9d12f74dd996a9eebc207d2e9c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:17.151198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4a5e7da6-d4da-42fb-9a2a-ac343a22c63b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f61ba9d12f74dd996a9eebc207d2e9c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:17.164821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1082/2200] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:24:16 2022] DELETE /identity/v3/users/4f61ba9d12f74dd996a9eebc207d2e9c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:17.169357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8f176-2b31-437a-881a-eb7131455f63 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:17.169818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8f176-2b31-437a-881a-eb7131455f63 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:17.169930 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8f176-2b31-437a-881a-eb7131455f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:17.189182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-32e8f176-2b31-437a-881a-eb7131455f63 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:17.190471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-32e8f176-2b31-437a-881a-eb7131455f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:17.248522 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1119/2201] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:24:17.259079 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e7da6-d4da-42fb-9a2a-ac343a22c63b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:17.260600 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4a5e7da6-d4da-42fb-9a2a-ac343a22c63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:17.294851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8f176-2b31-437a-881a-eb7131455f63 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:17.297078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-32e8f176-2b31-437a-881a-eb7131455f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:17.311943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8f176-2b31-437a-881a-eb7131455f63 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:17.317077 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:17.319388 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:17.320284 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:17.320624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e7da6-d4da-42fb-9a2a-ac343a22c63b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:17.320777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] PATH_INFO: `/v3/projects/36c1ed05b8bf4125900b8205c8f62715` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:17.322039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c1ed05b8bf4125900b8205c8f62715)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:17.324416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:17.324499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d3e53-afd7-4d76-9ca4-afe6e3b7ce14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:17.325136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d3e53-afd7-4d76-9ca4-afe6e3b7ce14 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:17.325419 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d3e53-afd7-4d76-9ca4-afe6e3b7ce14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:17.325785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d3e53-afd7-4d76-9ca4-afe6e3b7ce14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:17.335331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d3e53-afd7-4d76-9ca4-afe6e3b7ce14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:17.336940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d3e53-afd7-4d76-9ca4-afe6e3b7ce14 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:17.346396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:17.348912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1083/2202] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:17.367902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:17.461591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c1ed05b8bf4125900b8205c8f62715', 'request_id': 'req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:17.555851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c1ed05b8bf4125900b8205c8f62715', 'request_id': 'req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:17.563504 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c1ed05b8bf4125900b8205c8f62715', 'request_id': 'req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:17.579953 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] The token cache is being invalidate because project 36c1ed05b8bf4125900b8205c8f62715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:17.579953 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:17.579953 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:17.579953 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1120/2203] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:24:17 2022] DELETE /identity/v3/projects/36c1ed05b8bf4125900b8205c8f62715 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:17.584785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d3e53-afd7-4d76-9ca4-afe6e3b7ce14 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:17.597250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d3e53-afd7-4d76-9ca4-afe6e3b7ce14 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:17.686551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:17.720869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecd2ad-7ded-400c-90a4-dc48328372f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:17.722059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd2ad-7ded-400c-90a4-dc48328372f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:17.723004 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd2ad-7ded-400c-90a4-dc48328372f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:17.723476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd2ad-7ded-400c-90a4-dc48328372f3 admin admin] PATH_INFO: `/v3/users/0641249e5ce844d982f3097bcd90507e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:17.725809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecd2ad-7ded-400c-90a4-dc48328372f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0641249e5ce844d982f3097bcd90507e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:17.728333 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecd2ad-7ded-400c-90a4-dc48328372f3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:17.757953 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:17.788358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:17.993725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:17.993725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:18.010281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260fd94-ea00-4c4e-82d0-c9e909f3a92e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:18.016908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b0ecd2ad-7ded-400c-90a4-dc48328372f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0641249e5ce844d982f3097bcd90507e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:18.021766 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196329-0752-4ee4-aa8a-c66a88fa2593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:18.024121 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196329-0752-4ee4-aa8a-c66a88fa2593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:18.024497 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196329-0752-4ee4-aa8a-c66a88fa2593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:18.024855 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196329-0752-4ee4-aa8a-c66a88fa2593 admin admin] PATH_INFO: `/v3/projects/cd9553fd2a2047d7ace2e250b17c9c37` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:18.029369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5196329-0752-4ee4-aa8a-c66a88fa2593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9553fd2a2047d7ace2e250b17c9c37)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:18.041069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5196329-0752-4ee4-aa8a-c66a88fa2593 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:18.065780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b0ecd2ad-7ded-400c-90a4-dc48328372f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0641249e5ce844d982f3097bcd90507e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:18.067477 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b0ecd2ad-7ded-400c-90a4-dc48328372f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0641249e5ce844d982f3097bcd90507e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:18.145463 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b0ecd2ad-7ded-400c-90a4-dc48328372f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0641249e5ce844d982f3097bcd90507e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:18.148177 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b0ecd2ad-7ded-400c-90a4-dc48328372f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0641249e5ce844d982f3097bcd90507e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:18.166753 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1084/2204] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:24:17 2022] DELETE /identity/v3/users/0641249e5ce844d982f3097bcd90507e => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:18.226239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f5196329-0752-4ee4-aa8a-c66a88fa2593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9553fd2a2047d7ace2e250b17c9c37', 'request_id': 'req-f5196329-0752-4ee4-aa8a-c66a88fa2593'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:18.301984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f5196329-0752-4ee4-aa8a-c66a88fa2593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9553fd2a2047d7ace2e250b17c9c37', 'request_id': 'req-f5196329-0752-4ee4-aa8a-c66a88fa2593'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:18.326089 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f5196329-0752-4ee4-aa8a-c66a88fa2593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9553fd2a2047d7ace2e250b17c9c37', 'request_id': 'req-f5196329-0752-4ee4-aa8a-c66a88fa2593'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:18.346410 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f5196329-0752-4ee4-aa8a-c66a88fa2593 admin admin] The token cache is being invalidate because project cd9553fd2a2047d7ace2e250b17c9c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:18.347017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f5196329-0752-4ee4-aa8a-c66a88fa2593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:18.347781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f5196329-0752-4ee4-aa8a-c66a88fa2593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:18.350490 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1121/2205] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:24:17 2022] DELETE /identity/v3/projects/cd9553fd2a2047d7ace2e250b17c9c37 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:18.965003 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecd2ad-7ded-400c-90a4-dc48328372f3 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:18.967654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b0ecd2ad-7ded-400c-90a4-dc48328372f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:19.084074 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecd2ad-7ded-400c-90a4-dc48328372f3 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:19.123134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:19.160581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490773a2-6357-407e-8725-81a0d4e4eadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:19.163495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490773a2-6357-407e-8725-81a0d4e4eadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:19.163495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490773a2-6357-407e-8725-81a0d4e4eadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:19.163495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490773a2-6357-407e-8725-81a0d4e4eadc admin admin] PATH_INFO: `/v3/projects/a9da4d34c1274e6c9a5abd59b1c21c61` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:19.164395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490773a2-6357-407e-8725-81a0d4e4eadc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9da4d34c1274e6c9a5abd59b1c21c61)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:19.166547 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490773a2-6357-407e-8725-81a0d4e4eadc admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:19.300455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-490773a2-6357-407e-8725-81a0d4e4eadc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9da4d34c1274e6c9a5abd59b1c21c61', 'request_id': 'req-490773a2-6357-407e-8725-81a0d4e4eadc'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:19.361935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-490773a2-6357-407e-8725-81a0d4e4eadc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9da4d34c1274e6c9a5abd59b1c21c61', 'request_id': 'req-490773a2-6357-407e-8725-81a0d4e4eadc'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:19.369546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-490773a2-6357-407e-8725-81a0d4e4eadc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9da4d34c1274e6c9a5abd59b1c21c61', 'request_id': 'req-490773a2-6357-407e-8725-81a0d4e4eadc'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:19.383387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-490773a2-6357-407e-8725-81a0d4e4eadc admin admin] The token cache is being invalidate because project a9da4d34c1274e6c9a5abd59b1c21c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:19.383700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-490773a2-6357-407e-8725-81a0d4e4eadc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:19.384897 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-490773a2-6357-407e-8725-81a0d4e4eadc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:19.386498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1085/2206] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:24:18 2022] DELETE /identity/v3/projects/a9da4d34c1274e6c9a5abd59b1c21c61 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:19.391407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255d63b-d471-495d-8bfd-1e242d8c7f79 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:19.391862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255d63b-d471-495d-8bfd-1e242d8c7f79 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:19.391862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255d63b-d471-495d-8bfd-1e242d8c7f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:19.411046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0255d63b-d471-495d-8bfd-1e242d8c7f79 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:19.412404 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0255d63b-d471-495d-8bfd-1e242d8c7f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:19.462814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:19.488534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1122/2207] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:24:19.496937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395ffeb-55ad-4690-b767-0dcd1d76baf2 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:19.497421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395ffeb-55ad-4690-b767-0dcd1d76baf2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:19.498309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395ffeb-55ad-4690-b767-0dcd1d76baf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:19.518867 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f395ffeb-55ad-4690-b767-0dcd1d76baf2 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:19.520200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f395ffeb-55ad-4690-b767-0dcd1d76baf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:19.531027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1086/2208] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:19.535214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255d63b-d471-495d-8bfd-1e242d8c7f79 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:19.550735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255d63b-d471-495d-8bfd-1e242d8c7f79 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:19.557064 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56332543-9cf4-402f-b158-112158b29dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:19.558073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56332543-9cf4-402f-b158-112158b29dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:19.558362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56332543-9cf4-402f-b158-112158b29dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:19.558641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56332543-9cf4-402f-b158-112158b29dcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:19.559392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56332543-9cf4-402f-b158-112158b29dcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:24:19.559883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56332543-9cf4-402f-b158-112158b29dcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:19.562170 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56332543-9cf4-402f-b158-112158b29dcf admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:19.575772 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1123/2209] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:24:19.580950 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395ffeb-55ad-4690-b767-0dcd1d76baf2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:19.593768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395ffeb-55ad-4690-b767-0dcd1d76baf2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:19.600753 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d083add-2e2f-4071-a588-f0b5aa12e316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:19.604040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d083add-2e2f-4071-a588-f0b5aa12e316 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:19.604040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d083add-2e2f-4071-a588-f0b5aa12e316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:19.604040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d083add-2e2f-4071-a588-f0b5aa12e316 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:19.604040 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d083add-2e2f-4071-a588-f0b5aa12e316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:19.604735 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d083add-2e2f-4071-a588-f0b5aa12e316 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:19.681255 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1087/2210] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:24:19 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:24:19.682523 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56332543-9cf4-402f-b158-112158b29dcf admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:19.693392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56332543-9cf4-402f-b158-112158b29dcf admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:19.767267 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e5428-c18f-4420-a0a4-62acf64f9d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:19.767955 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e5428-c18f-4420-a0a4-62acf64f9d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:19.770487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e5428-c18f-4420-a0a4-62acf64f9d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:19.770487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e5428-c18f-4420-a0a4-62acf64f9d23 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:19.770487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e5428-c18f-4420-a0a4-62acf64f9d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:19.771439 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e5428-c18f-4420-a0a4-62acf64f9d23 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:19.881590 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1124/2211] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:24:19 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:24:19.885968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d083add-2e2f-4071-a588-f0b5aa12e316 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:19.898750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d083add-2e2f-4071-a588-f0b5aa12e316 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:19.908678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847da9d3-80fa-4285-92c9-f48b41441eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:19.909852 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847da9d3-80fa-4285-92c9-f48b41441eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:19.910332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847da9d3-80fa-4285-92c9-f48b41441eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:19.910797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847da9d3-80fa-4285-92c9-f48b41441eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:19.912525 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847da9d3-80fa-4285-92c9-f48b41441eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:19.914371 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847da9d3-80fa-4285-92c9-f48b41441eb9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:19.928815 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1088/2212] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:19.933011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e5428-c18f-4420-a0a4-62acf64f9d23 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:19.944804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e5428-c18f-4420-a0a4-62acf64f9d23 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:19.949862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd6383-ba03-4601-94e0-81d0dcfa8a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:19.950581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd6383-ba03-4601-94e0-81d0dcfa8a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:19.950870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd6383-ba03-4601-94e0-81d0dcfa8a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:19.951149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd6383-ba03-4601-94e0-81d0dcfa8a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:19.951894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd6383-ba03-4601-94e0-81d0dcfa8a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:19.953555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd6383-ba03-4601-94e0-81d0dcfa8a4d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:19.965198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1125/2213] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:19.972270 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847da9d3-80fa-4285-92c9-f48b41441eb9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:19.981626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847da9d3-80fa-4285-92c9-f48b41441eb9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:19.986565 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483903ad-a976-47ff-8ed0-d514048770d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:19.987459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483903ad-a976-47ff-8ed0-d514048770d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:19.987763 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483903ad-a976-47ff-8ed0-d514048770d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:19.988070 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483903ad-a976-47ff-8ed0-d514048770d0 admin admin] PATH_INFO: `/v3/projects/581aae5e810f4a0c8385f8e5ce96627d/users/8040a3f4cc0b45baa8a10a2ddcc55554/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:20.005368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483903ad-a976-47ff-8ed0-d514048770d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581aae5e810f4a0c8385f8e5ce96627d, user_id=8040a3f4cc0b45baa8a10a2ddcc55554, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:20.008251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483903ad-a976-47ff-8ed0-d514048770d0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:20.102241 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1089/2214] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:24:19 2022] PUT /identity/v3/projects/581aae5e810f4a0c8385f8e5ce96627d/users/8040a3f4cc0b45baa8a10a2ddcc55554/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:20.110341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcc0d8-46df-4ed3-977e-3ddf79300f19 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:20.111219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcc0d8-46df-4ed3-977e-3ddf79300f19 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:20.112836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcc0d8-46df-4ed3-977e-3ddf79300f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:20.159265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a0bcc0d8-46df-4ed3-977e-3ddf79300f19 None None] MFA Rules not processed for user `8040a3f4cc0b45baa8a10a2ddcc55554`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:20.161668 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a0bcc0d8-46df-4ed3-977e-3ddf79300f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:20.253994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1126/2215] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:20.258156 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483903ad-a976-47ff-8ed0-d514048770d0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:20.346032 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483903ad-a976-47ff-8ed0-d514048770d0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:20.356679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65c9b-13c1-4f14-99bb-ab8bfc24cd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:20.357364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65c9b-13c1-4f14-99bb-ab8bfc24cd9c admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:20.357649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65c9b-13c1-4f14-99bb-ab8bfc24cd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:20.357924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65c9b-13c1-4f14-99bb-ab8bfc24cd9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:20.358624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d65c9b-13c1-4f14-99bb-ab8bfc24cd9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:20.360651 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d65c9b-13c1-4f14-99bb-ab8bfc24cd9c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:20.369495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:20.464243 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1090/2216] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:24:20 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:24:20.465440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bcc0d8-46df-4ed3-977e-3ddf79300f19 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:20.477350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bcc0d8-46df-4ed3-977e-3ddf79300f19 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:20.525486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:20.538581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d859c-d07b-45f6-b755-0746bd0f3ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:20.539385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d859c-d07b-45f6-b755-0746bd0f3ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:20.539653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d859c-d07b-45f6-b755-0746bd0f3ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:20.540205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d859c-d07b-45f6-b755-0746bd0f3ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:20.540675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d859c-d07b-45f6-b755-0746bd0f3ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:20.542603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d859c-d07b-45f6-b755-0746bd0f3ea0 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:20.603833 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1127/2217] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:24:20 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:24:20.608231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65c9b-13c1-4f14-99bb-ab8bfc24cd9c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:20.625295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65c9b-13c1-4f14-99bb-ab8bfc24cd9c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:20.628215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dcbf9-4c66-483d-8028-71e9ccf289f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:20.629409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dcbf9-4c66-483d-8028-71e9ccf289f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:20.631179 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dcbf9-4c66-483d-8028-71e9ccf289f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:20.631615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dcbf9-4c66-483d-8028-71e9ccf289f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:20.632400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dcbf9-4c66-483d-8028-71e9ccf289f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:20.634281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dcbf9-4c66-483d-8028-71e9ccf289f7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:20.646875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1091/2218] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:20.651061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d859c-d07b-45f6-b755-0746bd0f3ea0 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:20.661394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d859c-d07b-45f6-b755-0746bd0f3ea0 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:20.666866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da5224-b8e1-4197-a0e2-ae8ff62c3bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:20.668044 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da5224-b8e1-4197-a0e2-ae8ff62c3bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:20.668044 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da5224-b8e1-4197-a0e2-ae8ff62c3bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:20.668241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da5224-b8e1-4197-a0e2-ae8ff62c3bad admin admin] PATH_INFO: `/v3/projects/e5b21a53ca06469494506dd52bc14c2f/users/b13f46e5e466462ab8446b1abb90ad0f/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:20.686811 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da5224-b8e1-4197-a0e2-ae8ff62c3bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b21a53ca06469494506dd52bc14c2f, user_id=b13f46e5e466462ab8446b1abb90ad0f, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:20.690348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da5224-b8e1-4197-a0e2-ae8ff62c3bad admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:20.778429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1128/2219] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:24:20 2022] PUT /identity/v3/projects/e5b21a53ca06469494506dd52bc14c2f/users/b13f46e5e466462ab8446b1abb90ad0f/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:20.779714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dcbf9-4c66-483d-8028-71e9ccf289f7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:20.792126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dcbf9-4c66-483d-8028-71e9ccf289f7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:20.862168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746ea7b-42e3-4dd0-a069-cdf4c5da0914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:20.862863 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746ea7b-42e3-4dd0-a069-cdf4c5da0914 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:20.863359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746ea7b-42e3-4dd0-a069-cdf4c5da0914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:20.863644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746ea7b-42e3-4dd0-a069-cdf4c5da0914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:20.865163 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746ea7b-42e3-4dd0-a069-cdf4c5da0914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:20.870216 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746ea7b-42e3-4dd0-a069-cdf4c5da0914 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:20.878390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1092/2220] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:20.882725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da5224-b8e1-4197-a0e2-ae8ff62c3bad admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:20.894705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da5224-b8e1-4197-a0e2-ae8ff62c3bad admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:20.957734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed164315-ccdb-4e13-9411-391cba7bc190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:20.957734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164315-ccdb-4e13-9411-391cba7bc190 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:20.957734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164315-ccdb-4e13-9411-391cba7bc190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:20.957734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164315-ccdb-4e13-9411-391cba7bc190 admin admin] PATH_INFO: `/v3/projects/e5b21a53ca06469494506dd52bc14c2f/users/b13f46e5e466462ab8446b1abb90ad0f/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:20.959043 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed164315-ccdb-4e13-9411-391cba7bc190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b21a53ca06469494506dd52bc14c2f, user_id=b13f46e5e466462ab8446b1abb90ad0f, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:20.959043 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed164315-ccdb-4e13-9411-391cba7bc190 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:20.964798 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1129/2221] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:24:20 2022] PUT /identity/v3/projects/e5b21a53ca06469494506dd52bc14c2f/users/b13f46e5e466462ab8446b1abb90ad0f/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:20.976643 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30d6f-8d4e-4080-b383-662079e6e281 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:20.977175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30d6f-8d4e-4080-b383-662079e6e281 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:20.977280 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30d6f-8d4e-4080-b383-662079e6e281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:21.009131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6de30d6f-8d4e-4080-b383-662079e6e281 None None] MFA Rules not processed for user `b13f46e5e466462ab8446b1abb90ad0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:21.010490 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6de30d6f-8d4e-4080-b383-662079e6e281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:21.111260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1093/2222] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:21.126524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed164315-ccdb-4e13-9411-391cba7bc190 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:21.128500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ed164315-ccdb-4e13-9411-391cba7bc190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:21.206070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed164315-ccdb-4e13-9411-391cba7bc190 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:21.210659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379b3ca-e38c-4103-a5b0-2432ccd53471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:21.210887 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379b3ca-e38c-4103-a5b0-2432ccd53471 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:21.210974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379b3ca-e38c-4103-a5b0-2432ccd53471 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:21.211258 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379b3ca-e38c-4103-a5b0-2432ccd53471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:21.279078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379b3ca-e38c-4103-a5b0-2432ccd53471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:21.280864 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379b3ca-e38c-4103-a5b0-2432ccd53471 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:21.292591 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1130/2223] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:23.448015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de30d6f-8d4e-4080-b383-662079e6e281 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:23.449458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6de30d6f-8d4e-4080-b383-662079e6e281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:23.522403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de30d6f-8d4e-4080-b383-662079e6e281 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:23.526999 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738d48d-5c19-4a0d-bd51-6ff391344050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:23.527885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738d48d-5c19-4a0d-bd51-6ff391344050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:23.528230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738d48d-5c19-4a0d-bd51-6ff391344050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:23.528541 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738d48d-5c19-4a0d-bd51-6ff391344050 admin admin] PATH_INFO: `/v3/users/8ff699275a974745900040005682f0af` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:23.529746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738d48d-5c19-4a0d-bd51-6ff391344050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff699275a974745900040005682f0af)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:23.531694 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738d48d-5c19-4a0d-bd51-6ff391344050 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:23.533371 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:23.759623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7738d48d-5c19-4a0d-bd51-6ff391344050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff699275a974745900040005682f0af'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:23.771893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7738d48d-5c19-4a0d-bd51-6ff391344050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff699275a974745900040005682f0af'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:23.772586 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7738d48d-5c19-4a0d-bd51-6ff391344050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff699275a974745900040005682f0af'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:23.853144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7738d48d-5c19-4a0d-bd51-6ff391344050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff699275a974745900040005682f0af'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:23.853773 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7738d48d-5c19-4a0d-bd51-6ff391344050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff699275a974745900040005682f0af'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:23.867722 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1094/2224] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:24:23 2022] DELETE /identity/v3/users/8ff699275a974745900040005682f0af => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:23.872345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dae30-ec21-4ce7-acac-934503fcbab3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:23.872814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dae30-ec21-4ce7-acac-934503fcbab3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:23.872903 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dae30-ec21-4ce7-acac-934503fcbab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:23.889681 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-578dae30-ec21-4ce7-acac-934503fcbab3 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:23.890882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-578dae30-ec21-4ce7-acac-934503fcbab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:23.939308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:23.950404 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1131/2225] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:23.960905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738d48d-5c19-4a0d-bd51-6ff391344050 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:23.962310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7738d48d-5c19-4a0d-bd51-6ff391344050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:24.027980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738d48d-5c19-4a0d-bd51-6ff391344050 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:24.031778 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851897a-ce7c-405f-af01-a66311e87414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:24.032598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851897a-ce7c-405f-af01-a66311e87414 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:24.032982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851897a-ce7c-405f-af01-a66311e87414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:24.033362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851897a-ce7c-405f-af01-a66311e87414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:24.050382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851897a-ce7c-405f-af01-a66311e87414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:24.050382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851897a-ce7c-405f-af01-a66311e87414 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:24.069222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1095/2226] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:24.615551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dae30-ec21-4ce7-acac-934503fcbab3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:24.617140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-578dae30-ec21-4ce7-acac-934503fcbab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:24.629106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851897a-ce7c-405f-af01-a66311e87414 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:24.630962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d851897a-ce7c-405f-af01-a66311e87414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:24.648598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851897a-ce7c-405f-af01-a66311e87414 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:24.653420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:24.654802 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:24.655300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:24.655803 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] PATH_INFO: `/v3/projects/200eada200204d3894a877c1e0204553` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:24.657637 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] RBAC: Authorizing `identity:delete_project(project_id=200eada200204d3894a877c1e0204553)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:24.659946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:24.706113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dae30-ec21-4ce7-acac-934503fcbab3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:24.712815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed281a3e-7fce-4008-8d65-08cb282eb557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:24.713590 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed281a3e-7fce-4008-8d65-08cb282eb557 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:24.715196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed281a3e-7fce-4008-8d65-08cb282eb557 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:24.715508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed281a3e-7fce-4008-8d65-08cb282eb557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:24.718024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ed281a3e-7fce-4008-8d65-08cb282eb557 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:24.824463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed281a3e-7fce-4008-8d65-08cb282eb557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:24.826585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed281a3e-7fce-4008-8d65-08cb282eb557 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:24.846693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200eada200204d3894a877c1e0204553', 'request_id': 'req-07c13fba-4801-40cd-a085-0e8297a0cead'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:24.857702 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1132/2227] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:24.956078 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200eada200204d3894a877c1e0204553', 'request_id': 'req-07c13fba-4801-40cd-a085-0e8297a0cead'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:24.963247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200eada200204d3894a877c1e0204553', 'request_id': 'req-07c13fba-4801-40cd-a085-0e8297a0cead'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:24.981558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] The token cache is being invalidate because project 200eada200204d3894a877c1e0204553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:24.981995 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:24.982840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:24.984686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1096/2228] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:24:24 2022] DELETE /identity/v3/projects/200eada200204d3894a877c1e0204553 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:34.839288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=52 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:34.977109 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=79,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:36.757442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f43f-f62d-4695-84c1-f6c4dea57b15 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:36.757946 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f43f-f62d-4695-84c1-f6c4dea57b15 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:36.758027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f43f-f62d-4695-84c1-f6c4dea57b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:36.776742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1b19f43f-f62d-4695-84c1-f6c4dea57b15 None None] MFA Rules not processed for user `42686ca331b14f548fb013dccf68bcc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:36.778331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1b19f43f-f62d-4695-84c1-f6c4dea57b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:36.845997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1133/2229] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:40.377295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:40.380089 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:40.447359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c13fba-4801-40cd-a085-0e8297a0cead admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:40.452034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d598c-7a30-429c-aebd-35cad40b8cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:40.452912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d598c-7a30-429c-aebd-35cad40b8cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:40.453196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d598c-7a30-429c-aebd-35cad40b8cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:40.453475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d598c-7a30-429c-aebd-35cad40b8cf4 admin admin] PATH_INFO: `/v3/users/8040a3f4cc0b45baa8a10a2ddcc55554` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:40.454674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d598c-7a30-429c-aebd-35cad40b8cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8040a3f4cc0b45baa8a10a2ddcc55554)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:40.456654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d598c-7a30-429c-aebd-35cad40b8cf4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:40.653543 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-593d598c-7a30-429c-aebd-35cad40b8cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8040a3f4cc0b45baa8a10a2ddcc55554'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:40.666882 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-593d598c-7a30-429c-aebd-35cad40b8cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8040a3f4cc0b45baa8a10a2ddcc55554'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:40.667654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-593d598c-7a30-429c-aebd-35cad40b8cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8040a3f4cc0b45baa8a10a2ddcc55554'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:40.727250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-593d598c-7a30-429c-aebd-35cad40b8cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8040a3f4cc0b45baa8a10a2ddcc55554'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:40.728182 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-593d598c-7a30-429c-aebd-35cad40b8cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8040a3f4cc0b45baa8a10a2ddcc55554'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:40.742030 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1097/2230] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:24:40 2022] DELETE /identity/v3/users/8040a3f4cc0b45baa8a10a2ddcc55554 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:40.746503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2640ca4-4bf1-400b-b8dd-fa45f408583e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:40.746970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2640ca4-4bf1-400b-b8dd-fa45f408583e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:40.747189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2640ca4-4bf1-400b-b8dd-fa45f408583e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:40.765401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b2640ca4-4bf1-400b-b8dd-fa45f408583e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:40.766601 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b2640ca4-4bf1-400b-b8dd-fa45f408583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:40.826589 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1134/2231] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:40.836297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d598c-7a30-429c-aebd-35cad40b8cf4 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:40.837688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-593d598c-7a30-429c-aebd-35cad40b8cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:40.896780 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d598c-7a30-429c-aebd-35cad40b8cf4 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:40.900470 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939acf9-03e7-47e4-a3e6-8d2a753468d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:40.901123 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939acf9-03e7-47e4-a3e6-8d2a753468d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:40.901409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939acf9-03e7-47e4-a3e6-8d2a753468d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:40.901687 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939acf9-03e7-47e4-a3e6-8d2a753468d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:40.911461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939acf9-03e7-47e4-a3e6-8d2a753468d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:40.913037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939acf9-03e7-47e4-a3e6-8d2a753468d0 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:40.922724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1098/2232] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:41.321250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2640ca4-4bf1-400b-b8dd-fa45f408583e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:41.322674 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b2640ca4-4bf1-400b-b8dd-fa45f408583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:41.337947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2640ca4-4bf1-400b-b8dd-fa45f408583e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:41.341992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:41.342877 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:41.343166 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:41.343469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] PATH_INFO: `/v3/projects/581aae5e810f4a0c8385f8e5ce96627d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:41.344864 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=581aae5e810f4a0c8385f8e5ce96627d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:41.347813 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:41.429432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581aae5e810f4a0c8385f8e5ce96627d', 'request_id': 'req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:41.474557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581aae5e810f4a0c8385f8e5ce96627d', 'request_id': 'req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:41.481697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581aae5e810f4a0c8385f8e5ce96627d', 'request_id': 'req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:41.494058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] The token cache is being invalidate because project 581aae5e810f4a0c8385f8e5ce96627d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:41.494458 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:41.495163 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:41.496955 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1135/2233] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:24:41 2022] DELETE /identity/v3/projects/581aae5e810f4a0c8385f8e5ce96627d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:24:41.500654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939acf9-03e7-47e4-a3e6-8d2a753468d0 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:41.510990 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939acf9-03e7-47e4-a3e6-8d2a753468d0 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:41.529975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:41.579848 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c921c-7a8c-4c5d-941e-d6ef6ec1b394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:41.580761 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c921c-7a8c-4c5d-941e-d6ef6ec1b394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:41.581046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c921c-7a8c-4c5d-941e-d6ef6ec1b394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:41.582035 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c921c-7a8c-4c5d-941e-d6ef6ec1b394 admin admin] PATH_INFO: `/v3/users/b13f46e5e466462ab8446b1abb90ad0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:41.583261 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c921c-7a8c-4c5d-941e-d6ef6ec1b394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13f46e5e466462ab8446b1abb90ad0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:41.585220 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c921c-7a8c-4c5d-941e-d6ef6ec1b394 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:41.895169 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6b8c921c-7a8c-4c5d-941e-d6ef6ec1b394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13f46e5e466462ab8446b1abb90ad0f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:41.924686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6b8c921c-7a8c-4c5d-941e-d6ef6ec1b394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13f46e5e466462ab8446b1abb90ad0f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:41.926154 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6b8c921c-7a8c-4c5d-941e-d6ef6ec1b394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13f46e5e466462ab8446b1abb90ad0f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:42.012929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6b8c921c-7a8c-4c5d-941e-d6ef6ec1b394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13f46e5e466462ab8446b1abb90ad0f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:42.013761 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6b8c921c-7a8c-4c5d-941e-d6ef6ec1b394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13f46e5e466462ab8446b1abb90ad0f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:42.035537 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1099/2234] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:24:41 2022] DELETE /identity/v3/users/b13f46e5e466462ab8446b1abb90ad0f => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:42.631324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:42.633684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:42.652115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b7e21-fefd-4318-b2a8-7ec0f27fadbc admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:42.675332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:42.721458 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677fc13-359f-444c-b365-f3a3258d10e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:42.723768 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677fc13-359f-444c-b365-f3a3258d10e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:42.725677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677fc13-359f-444c-b365-f3a3258d10e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:42.726311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677fc13-359f-444c-b365-f3a3258d10e0 admin admin] PATH_INFO: `/v3/projects/e5b21a53ca06469494506dd52bc14c2f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:42.727956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677fc13-359f-444c-b365-f3a3258d10e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b21a53ca06469494506dd52bc14c2f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:42.732901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677fc13-359f-444c-b365-f3a3258d10e0 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:42.874460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5677fc13-359f-444c-b365-f3a3258d10e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b21a53ca06469494506dd52bc14c2f', 'request_id': 'req-5677fc13-359f-444c-b365-f3a3258d10e0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:42.937046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5677fc13-359f-444c-b365-f3a3258d10e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b21a53ca06469494506dd52bc14c2f', 'request_id': 'req-5677fc13-359f-444c-b365-f3a3258d10e0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:42.943320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5677fc13-359f-444c-b365-f3a3258d10e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b21a53ca06469494506dd52bc14c2f', 'request_id': 'req-5677fc13-359f-444c-b365-f3a3258d10e0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:42.958048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5677fc13-359f-444c-b365-f3a3258d10e0 admin admin] The token cache is being invalidate because project e5b21a53ca06469494506dd52bc14c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:24:42.958345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5677fc13-359f-444c-b365-f3a3258d10e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:42.959203 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5677fc13-359f-444c-b365-f3a3258d10e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:24:42.965915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1136/2235] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:24:42 2022] DELETE /identity/v3/projects/e5b21a53ca06469494506dd52bc14c2f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:42.966166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfcb15-4263-456a-9e28-222ed3c50422 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:42.966624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfcb15-4263-456a-9e28-222ed3c50422 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:42.966733 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfcb15-4263-456a-9e28-222ed3c50422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:42.993136 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-42dfcb15-4263-456a-9e28-222ed3c50422 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:42.994504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-42dfcb15-4263-456a-9e28-222ed3c50422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:43.082101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00c826-ab98-48b7-8315-156de69ae626 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:43.082603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00c826-ab98-48b7-8315-156de69ae626 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:43.082966 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00c826-ab98-48b7-8315-156de69ae626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:43.084197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1100/2236] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:24:43.104088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1f00c826-ab98-48b7-8315-156de69ae626 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:43.105323 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1f00c826-ab98-48b7-8315-156de69ae626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:43.113624 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1137/2237] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:43.118287 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfcb15-4263-456a-9e28-222ed3c50422 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:43.129140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfcb15-4263-456a-9e28-222ed3c50422 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:43.133727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a752e-06a8-48ed-8b15-ffa04a8b03a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:43.134388 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a752e-06a8-48ed-8b15-ffa04a8b03a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:43.134671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a752e-06a8-48ed-8b15-ffa04a8b03a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:43.134941 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a752e-06a8-48ed-8b15-ffa04a8b03a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:43.135665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a752e-06a8-48ed-8b15-ffa04a8b03a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:24:43.135967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a752e-06a8-48ed-8b15-ffa04a8b03a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:43.137695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a752e-06a8-48ed-8b15-ffa04a8b03a3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:43.151952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1101/2238] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:24:43.156809 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00c826-ab98-48b7-8315-156de69ae626 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:43.168829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00c826-ab98-48b7-8315-156de69ae626 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:43.174051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07fc19-3c27-41f8-94e4-38840c60cfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:43.174857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07fc19-3c27-41f8-94e4-38840c60cfd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:43.175604 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07fc19-3c27-41f8-94e4-38840c60cfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:43.176032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07fc19-3c27-41f8-94e4-38840c60cfd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:43.177340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07fc19-3c27-41f8-94e4-38840c60cfd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:43.179435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07fc19-3c27-41f8-94e4-38840c60cfd4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:43.296011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1138/2239] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:24:43 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:24:43.300437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a752e-06a8-48ed-8b15-ffa04a8b03a3 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:43.308825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a752e-06a8-48ed-8b15-ffa04a8b03a3 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:43.345198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:43.390449 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f243f-daa8-4462-b0c1-3c8c0e4feb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:43.391135 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f243f-daa8-4462-b0c1-3c8c0e4feb0d admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:43.391419 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f243f-daa8-4462-b0c1-3c8c0e4feb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:43.391696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f243f-daa8-4462-b0c1-3c8c0e4feb0d admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:43.392556 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f243f-daa8-4462-b0c1-3c8c0e4feb0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:43.395113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f243f-daa8-4462-b0c1-3c8c0e4feb0d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:43.508189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1102/2240] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:24:43 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:24:43.511926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07fc19-3c27-41f8-94e4-38840c60cfd4 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:43.526449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07fc19-3c27-41f8-94e4-38840c60cfd4 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:43.534396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bac33-e46a-4b81-8f92-b2f274a93ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:43.535671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bac33-e46a-4b81-8f92-b2f274a93ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:43.541432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bac33-e46a-4b81-8f92-b2f274a93ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:43.541432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bac33-e46a-4b81-8f92-b2f274a93ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:43.541432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bac33-e46a-4b81-8f92-b2f274a93ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:43.541432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bac33-e46a-4b81-8f92-b2f274a93ac7 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:43.552548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1139/2241] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:24:43.556475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f243f-daa8-4462-b0c1-3c8c0e4feb0d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:43.568211 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f243f-daa8-4462-b0c1-3c8c0e4feb0d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:43.572967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7fc4f-7793-4386-9fd7-7fb13069c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:43.573681 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7fc4f-7793-4386-9fd7-7fb13069c628 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:43.573967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7fc4f-7793-4386-9fd7-7fb13069c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:43.574241 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7fc4f-7793-4386-9fd7-7fb13069c628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:43.574975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7fc4f-7793-4386-9fd7-7fb13069c628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:43.576608 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7fc4f-7793-4386-9fd7-7fb13069c628 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:43.586932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1103/2242] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:24:43.591258 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bac33-e46a-4b81-8f92-b2f274a93ac7 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:43.604154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bac33-e46a-4b81-8f92-b2f274a93ac7 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:43.609235 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc7445-4d8c-47dd-bc65-d3b9d33a38fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:43.616120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc7445-4d8c-47dd-bc65-d3b9d33a38fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:43.616120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc7445-4d8c-47dd-bc65-d3b9d33a38fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:43.616120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc7445-4d8c-47dd-bc65-d3b9d33a38fa admin admin] PATH_INFO: `/v3/projects/d8c75810254643fd9f456412fdbe940f/users/2b995a1cb96141d5b7b437e645936089/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:43.633013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc7445-4d8c-47dd-bc65-d3b9d33a38fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c75810254643fd9f456412fdbe940f, user_id=2b995a1cb96141d5b7b437e645936089, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:43.635368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc7445-4d8c-47dd-bc65-d3b9d33a38fa admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:43.720761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1140/2243] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:24:43 2022] PUT /identity/v3/projects/d8c75810254643fd9f456412fdbe940f/users/2b995a1cb96141d5b7b437e645936089/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:24:43.732487 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a506e1-74c1-4903-b1f8-8b3a3e3a9b3f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:43.732866 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a506e1-74c1-4903-b1f8-8b3a3e3a9b3f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:43.733709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a506e1-74c1-4903-b1f8-8b3a3e3a9b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:43.775381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-23a506e1-74c1-4903-b1f8-8b3a3e3a9b3f None None] MFA Rules not processed for user `2b995a1cb96141d5b7b437e645936089`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:43.785755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-23a506e1-74c1-4903-b1f8-8b3a3e3a9b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:43.844693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1104/2244] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:24:43.858408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc7445-4d8c-47dd-bc65-d3b9d33a38fa admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:43.860397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9bfc7445-4d8c-47dd-bc65-d3b9d33a38fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:43.934493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:43.957160 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc7445-4d8c-47dd-bc65-d3b9d33a38fa admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:43.960899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d9722-5bbe-4b17-91aa-4f2563fb8c8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397a66eb12254a65bf05bc9fff9a868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:43.961567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d9722-5bbe-4b17-91aa-4f2563fb8c8c service glance] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:43.961849 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d9722-5bbe-4b17-91aa-4f2563fb8c8c service glance] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:43.962125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d9722-5bbe-4b17-91aa-4f2563fb8c8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:43.973145 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d9722-5bbe-4b17-91aa-4f2563fb8c8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:43.974500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d9722-5bbe-4b17-91aa-4f2563fb8c8c service glance] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:43.983138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1141/2245] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:50.121006 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6deaf-9488-40ef-b343-75e0a69e9b5b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:50.121493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6deaf-9488-40ef-b343-75e0a69e9b5b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:50.121629 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6deaf-9488-40ef-b343-75e0a69e9b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:50.143718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1ab6deaf-9488-40ef-b343-75e0a69e9b5b None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:50.145084 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1ab6deaf-9488-40ef-b343-75e0a69e9b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:50.209361 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1105/2246] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:24:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:24:50.276027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d9722-5bbe-4b17-91aa-4f2563fb8c8c service glance] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:50.277519 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4b0d9722-5bbe-4b17-91aa-4f2563fb8c8c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:50.367316 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d9722-5bbe-4b17-91aa-4f2563fb8c8c service glance] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:50.374952 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db51732-407e-4c61-bf11-eb9f7df7d0b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:50.375854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db51732-407e-4c61-bf11-eb9f7df7d0b5 service swift] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:50.376847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db51732-407e-4c61-bf11-eb9f7df7d0b5 service swift] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:50.377286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db51732-407e-4c61-bf11-eb9f7df7d0b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:50.389540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db51732-407e-4c61-bf11-eb9f7df7d0b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:50.391727 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db51732-407e-4c61-bf11-eb9f7df7d0b5 service swift] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:50.401830 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1142/2247] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:24:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:24:51.972817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02825c-4f52-494a-90a6-10c58e3441d7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:51.973437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02825c-4f52-494a-90a6-10c58e3441d7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:51.973437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02825c-4f52-494a-90a6-10c58e3441d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:52.007275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9f02825c-4f52-494a-90a6-10c58e3441d7 None None] MFA Rules not processed for user `8acb1c9eead84a11a48c1a217ce82584`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:24:52.008762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9f02825c-4f52-494a-90a6-10c58e3441d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:52.094962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:52.140352 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1106/2248] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:24:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:00.398188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=42 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:02.158539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=6 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:04.593214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db51732-407e-4c61-bf11-eb9f7df7d0b5 service swift] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:04.654945 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db51732-407e-4c61-bf11-eb9f7df7d0b5 service swift] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:04.660263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5abaf2-1c32-4d3e-8320-c4d9692c4c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:04.661143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5abaf2-1c32-4d3e-8320-c4d9692c4c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:04.661441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5abaf2-1c32-4d3e-8320-c4d9692c4c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:04.661713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5abaf2-1c32-4d3e-8320-c4d9692c4c7f admin admin] PATH_INFO: `/v3/users/2b995a1cb96141d5b7b437e645936089` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:04.662905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5abaf2-1c32-4d3e-8320-c4d9692c4c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b995a1cb96141d5b7b437e645936089)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:04.664871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5abaf2-1c32-4d3e-8320-c4d9692c4c7f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:04.869449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-aa5abaf2-1c32-4d3e-8320-c4d9692c4c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b995a1cb96141d5b7b437e645936089'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:04.882656 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-aa5abaf2-1c32-4d3e-8320-c4d9692c4c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b995a1cb96141d5b7b437e645936089'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:04.946298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-aa5abaf2-1c32-4d3e-8320-c4d9692c4c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b995a1cb96141d5b7b437e645936089'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:04.946924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-aa5abaf2-1c32-4d3e-8320-c4d9692c4c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b995a1cb96141d5b7b437e645936089'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:04.955169 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-aa5abaf2-1c32-4d3e-8320-c4d9692c4c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b995a1cb96141d5b7b437e645936089'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:04.961155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1143/2249] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:25:04 2022] DELETE /identity/v3/users/2b995a1cb96141d5b7b437e645936089 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:25:04.965669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74820dc-3586-4385-9030-ad8f31633f90 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:04.966121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74820dc-3586-4385-9030-ad8f31633f90 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:04.966213 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74820dc-3586-4385-9030-ad8f31633f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:04.983915 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d74820dc-3586-4385-9030-ad8f31633f90 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:04.985186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d74820dc-3586-4385-9030-ad8f31633f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:05.042878 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1107/2250] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:05.052713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5abaf2-1c32-4d3e-8320-c4d9692c4c7f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:05.054029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-aa5abaf2-1c32-4d3e-8320-c4d9692c4c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:05.110378 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5abaf2-1c32-4d3e-8320-c4d9692c4c7f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:05.114469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c00ff-5b11-47be-bd67-668810869f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:05.115110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c00ff-5b11-47be-bd67-668810869f13 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:05.115391 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c00ff-5b11-47be-bd67-668810869f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:05.115691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c00ff-5b11-47be-bd67-668810869f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:05.124684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c00ff-5b11-47be-bd67-668810869f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:05.126829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c00ff-5b11-47be-bd67-668810869f13 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:05.136126 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1144/2251] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:25:05.538451 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74820dc-3586-4385-9030-ad8f31633f90 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:05.540064 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d74820dc-3586-4385-9030-ad8f31633f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:05.559453 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74820dc-3586-4385-9030-ad8f31633f90 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:05.564505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f7661-2174-408a-b255-44d0bbb1e665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:05.565649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7661-2174-408a-b255-44d0bbb1e665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:05.566049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7661-2174-408a-b255-44d0bbb1e665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:05.566410 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7661-2174-408a-b255-44d0bbb1e665 admin admin] PATH_INFO: `/v3/projects/d8c75810254643fd9f456412fdbe940f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:05.569720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f7661-2174-408a-b255-44d0bbb1e665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c75810254643fd9f456412fdbe940f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:05.570543 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f7661-2174-408a-b255-44d0bbb1e665 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:05.640964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bc4c5-df04-4b47-b646-d3cb7075c817 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:05.641436 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bc4c5-df04-4b47-b646-d3cb7075c817 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:05.641530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bc4c5-df04-4b47-b646-d3cb7075c817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:05.659600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-936bc4c5-df04-4b47-b646-d3cb7075c817 None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:05.660851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-936bc4c5-df04-4b47-b646-d3cb7075c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:05.663032 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ad0f7661-2174-408a-b255-44d0bbb1e665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c75810254643fd9f456412fdbe940f', 'request_id': 'req-ad0f7661-2174-408a-b255-44d0bbb1e665'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:05.678668 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:05.716738 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1145/2252] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:25:05.729658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bc4c5-df04-4b47-b646-d3cb7075c817 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:05.730997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-936bc4c5-df04-4b47-b646-d3cb7075c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:05.740358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ad0f7661-2174-408a-b255-44d0bbb1e665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c75810254643fd9f456412fdbe940f', 'request_id': 'req-ad0f7661-2174-408a-b255-44d0bbb1e665'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:05.746856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ad0f7661-2174-408a-b255-44d0bbb1e665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c75810254643fd9f456412fdbe940f', 'request_id': 'req-ad0f7661-2174-408a-b255-44d0bbb1e665'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:05.758392 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ad0f7661-2174-408a-b255-44d0bbb1e665 admin admin] The token cache is being invalidate because project d8c75810254643fd9f456412fdbe940f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:25:05.758392 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ad0f7661-2174-408a-b255-44d0bbb1e665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:05.759069 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ad0f7661-2174-408a-b255-44d0bbb1e665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:05.760692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1108/2253] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:25:05 2022] DELETE /identity/v3/projects/d8c75810254643fd9f456412fdbe940f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:25:05.765428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdc110-2a8a-42ef-bdcd-3e7cb86e6894 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:05.766065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdc110-2a8a-42ef-bdcd-3e7cb86e6894 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:05.766065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdc110-2a8a-42ef-bdcd-3e7cb86e6894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:05.784351 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-71cdc110-2a8a-42ef-bdcd-3e7cb86e6894 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:05.785557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-71cdc110-2a8a-42ef-bdcd-3e7cb86e6894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:05.803060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bc4c5-df04-4b47-b646-d3cb7075c817 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:05.808551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9861bd-e575-4e48-9c33-f2156f1339b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:05.809219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9861bd-e575-4e48-9c33-f2156f1339b1 service swift] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:05.809636 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9861bd-e575-4e48-9c33-f2156f1339b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:05.810276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9861bd-e575-4e48-9c33-f2156f1339b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:05.812176 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cc9861bd-e575-4e48-9c33-f2156f1339b1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:05.823330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9861bd-e575-4e48-9c33-f2156f1339b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:05.825039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9861bd-e575-4e48-9c33-f2156f1339b1 service swift] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:05.833505 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1146/2254] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:25:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 10:25:05.847565 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1109/2255] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:05.855270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae7a1d-26fd-4810-a983-9ac1fec309fd None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:05.855573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae7a1d-26fd-4810-a983-9ac1fec309fd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:05.855899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae7a1d-26fd-4810-a983-9ac1fec309fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:05.880050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-37ae7a1d-26fd-4810-a983-9ac1fec309fd None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:05.881259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-37ae7a1d-26fd-4810-a983-9ac1fec309fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:05.889269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1147/2256] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:05.894028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdc110-2a8a-42ef-bdcd-3e7cb86e6894 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:05.903875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdc110-2a8a-42ef-bdcd-3e7cb86e6894 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:05.909143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8dbd1-62fe-4f58-8e1d-e749b5cdceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:05.909833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8dbd1-62fe-4f58-8e1d-e749b5cdceb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:05.915350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8dbd1-62fe-4f58-8e1d-e749b5cdceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:05.915350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8dbd1-62fe-4f58-8e1d-e749b5cdceb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:05.915350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8dbd1-62fe-4f58-8e1d-e749b5cdceb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:25:05.915350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8dbd1-62fe-4f58-8e1d-e749b5cdceb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:05.915350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8dbd1-62fe-4f58-8e1d-e749b5cdceb0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:05.925251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1110/2257] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:25:05.929878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae7a1d-26fd-4810-a983-9ac1fec309fd None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:05.939730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae7a1d-26fd-4810-a983-9ac1fec309fd None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:05.944961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a0b89-7437-40b9-b1b7-0c6538e87e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:05.950285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a0b89-7437-40b9-b1b7-0c6538e87e62 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:05.950285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a0b89-7437-40b9-b1b7-0c6538e87e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:05.950285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a0b89-7437-40b9-b1b7-0c6538e87e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:05.950285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a0b89-7437-40b9-b1b7-0c6538e87e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:05.950285 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a0b89-7437-40b9-b1b7-0c6538e87e62 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:06.038794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1148/2258] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:25:05 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:25:06.042417 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8dbd1-62fe-4f58-8e1d-e749b5cdceb0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:06.054565 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8dbd1-62fe-4f58-8e1d-e749b5cdceb0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:06.076560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:06.193740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1ed5-a24b-4e5e-947c-df21610e4aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:06.195009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1ed5-a24b-4e5e-947c-df21610e4aee admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:06.196743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1ed5-a24b-4e5e-947c-df21610e4aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:06.196743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1ed5-a24b-4e5e-947c-df21610e4aee admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:06.197194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc1ed5-a24b-4e5e-947c-df21610e4aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:06.199432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc1ed5-a24b-4e5e-947c-df21610e4aee admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:06.316567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a0b89-7437-40b9-b1b7-0c6538e87e62 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:06.326386 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1111/2259] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:25:06 2022] POST /identity/v3/users => generated 286 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:25:06.332675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a0b89-7437-40b9-b1b7-0c6538e87e62 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:06.338939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f45252-8298-4a54-8d07-551649f7215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:06.339909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f45252-8298-4a54-8d07-551649f7215a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:06.342885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f45252-8298-4a54-8d07-551649f7215a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:06.342885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f45252-8298-4a54-8d07-551649f7215a admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:06.342885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f45252-8298-4a54-8d07-551649f7215a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:06.343195 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f45252-8298-4a54-8d07-551649f7215a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:06.367727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1ed5-a24b-4e5e-947c-df21610e4aee admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:06.376869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1149/2260] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:25:06.382854 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1ed5-a24b-4e5e-947c-df21610e4aee admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:06.388335 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1e02b-a6c3-4d09-b894-c4a1b1b1f474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:06.389075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1e02b-a6c3-4d09-b894-c4a1b1b1f474 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:06.389367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1e02b-a6c3-4d09-b894-c4a1b1b1f474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:06.389652 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1e02b-a6c3-4d09-b894-c4a1b1b1f474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:06.390543 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1e02b-a6c3-4d09-b894-c4a1b1b1f474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:06.392785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1e02b-a6c3-4d09-b894-c4a1b1b1f474 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:06.411862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f45252-8298-4a54-8d07-551649f7215a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:06.417643 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1112/2261] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:25:06.425550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f45252-8298-4a54-8d07-551649f7215a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:06.432228 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dee75-dcf6-41fc-83f4-520d4f412622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:06.433565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dee75-dcf6-41fc-83f4-520d4f412622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:06.433905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dee75-dcf6-41fc-83f4-520d4f412622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:06.434192 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dee75-dcf6-41fc-83f4-520d4f412622 admin admin] PATH_INFO: `/v3/projects/39741895aeb746e29650fb3ddeca5f27/users/f225c0e898ad4863b81c8d2abe0d2696/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:06.454058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dee75-dcf6-41fc-83f4-520d4f412622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39741895aeb746e29650fb3ddeca5f27, user_id=f225c0e898ad4863b81c8d2abe0d2696, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:06.457939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dee75-dcf6-41fc-83f4-520d4f412622 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:06.560444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1150/2262] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:25:06 2022] PUT /identity/v3/projects/39741895aeb746e29650fb3ddeca5f27/users/f225c0e898ad4863b81c8d2abe0d2696/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:25:06.573903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefbdbd-7eb1-4a75-a7e1-a6175cfc59bd None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:06.578787 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefbdbd-7eb1-4a75-a7e1-a6175cfc59bd None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:06.578787 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefbdbd-7eb1-4a75-a7e1-a6175cfc59bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:06.617870 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ddefbdbd-7eb1-4a75-a7e1-a6175cfc59bd None None] MFA Rules not processed for user `f225c0e898ad4863b81c8d2abe0d2696`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:06.620255 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ddefbdbd-7eb1-4a75-a7e1-a6175cfc59bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:06.725856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1113/2263] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:06.742263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dee75-dcf6-41fc-83f4-520d4f412622 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:06.744329 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-071dee75-dcf6-41fc-83f4-520d4f412622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:06.817122 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dee75-dcf6-41fc-83f4-520d4f412622 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:06.824030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572bdec-19c7-4bd2-9a4b-a4a6b46db9cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397a66eb12254a65bf05bc9fff9a868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:06.824742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572bdec-19c7-4bd2-9a4b-a4a6b46db9cf service glance] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:06.825027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572bdec-19c7-4bd2-9a4b-a4a6b46db9cf service glance] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:06.825304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572bdec-19c7-4bd2-9a4b-a4a6b46db9cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:06.832279 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:06.834807 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572bdec-19c7-4bd2-9a4b-a4a6b46db9cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:06.836334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572bdec-19c7-4bd2-9a4b-a4a6b46db9cf service glance] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:06.846949 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1151/2264] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:25:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:25:09.499793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3d8d7-1c19-4ccf-9d61-bee602ff3cbd None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:09.510146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3d8d7-1c19-4ccf-9d61-bee602ff3cbd None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:09.510146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3d8d7-1c19-4ccf-9d61-bee602ff3cbd None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:09.510146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1114/2265] 10.222.0.74 () {54 vars in 921 bytes} [Thu Jul 14 10:25:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:25:09.516820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93467d-e439-4e91-8287-a3cfd55c1e3e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:09.517438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93467d-e439-4e91-8287-a3cfd55c1e3e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:09.517729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93467d-e439-4e91-8287-a3cfd55c1e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:09.538824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-bf93467d-e439-4e91-8287-a3cfd55c1e3e None None] MFA Rules not processed for user `2a0626754b40449ba2346d05c5c90a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:09.540679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bf93467d-e439-4e91-8287-a3cfd55c1e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:09.631705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1152/2266] 10.222.0.74 () {58 vars in 1018 bytes} [Thu Jul 14 10:25:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:16.722132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:19.621309 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=33 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:24.833058 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3d8d7-1c19-4ccf-9d61-bee602ff3cbd None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:24.845945 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3d8d7-1c19-4ccf-9d61-bee602ff3cbd None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:24.850376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aaf060-4bf6-4fce-9de6-2d5747c6b1ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397a66eb12254a65bf05bc9fff9a868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:24.851046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaf060-4bf6-4fce-9de6-2d5747c6b1ec service glance] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:24.851336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaf060-4bf6-4fce-9de6-2d5747c6b1ec service glance] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:24.851894 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaf060-4bf6-4fce-9de6-2d5747c6b1ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:24.865316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aaf060-4bf6-4fce-9de6-2d5747c6b1ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:24.866964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aaf060-4bf6-4fce-9de6-2d5747c6b1ec service glance] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:24.880168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1115/2267] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:25:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:25:25.095785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5ab9-d6ec-4acc-9140-b78c3084699f None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:25.096409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5ab9-d6ec-4acc-9140-b78c3084699f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:25.096409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5ab9-d6ec-4acc-9140-b78c3084699f None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:25.097920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1153/2268] 10.222.0.74 () {54 vars in 921 bytes} [Thu Jul 14 10:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:25:25.103067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63075-1ea4-483b-85dd-a5c9f3113431 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:25.103362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63075-1ea4-483b-85dd-a5c9f3113431 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:25.103640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63075-1ea4-483b-85dd-a5c9f3113431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:25.122955 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7ca63075-1ea4-483b-85dd-a5c9f3113431 None None] MFA Rules not processed for user `bf41e7a4968e4ab9bce98f6e1c050b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:25.124279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7ca63075-1ea4-483b-85dd-a5c9f3113431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:25.189860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1116/2269] 10.222.0.74 () {58 vars in 1018 bytes} [Thu Jul 14 10:25:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:25.199717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a5ab9-d6ec-4acc-9140-b78c3084699f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:25.201658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c20a5ab9-d6ec-4acc-9140-b78c3084699f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:25.217132 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a5ab9-d6ec-4acc-9140-b78c3084699f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:25.224015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58146f1f-89df-439d-8f0e-23aff645c5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:25.225232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58146f1f-89df-439d-8f0e-23aff645c5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:25.225517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58146f1f-89df-439d-8f0e-23aff645c5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:25.225797 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58146f1f-89df-439d-8f0e-23aff645c5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:25.236564 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58146f1f-89df-439d-8f0e-23aff645c5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:25.238044 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58146f1f-89df-439d-8f0e-23aff645c5f8 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:25.247766 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1154/2270] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:25:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:25:25.344898 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dd2fd-a7c1-4692-a71d-1c8cb3c060c8 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:25.345285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dd2fd-a7c1-4692-a71d-1c8cb3c060c8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:25.345643 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dd2fd-a7c1-4692-a71d-1c8cb3c060c8 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:25.347292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1117/2271] 10.222.0.74 () {54 vars in 921 bytes} [Thu Jul 14 10:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:25:25.353666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564d62e-68fe-46fd-ba5a-439adffcf15b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:25.354280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564d62e-68fe-46fd-ba5a-439adffcf15b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:25.354741 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564d62e-68fe-46fd-ba5a-439adffcf15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:25.376545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3564d62e-68fe-46fd-ba5a-439adffcf15b None None] MFA Rules not processed for user `2a0626754b40449ba2346d05c5c90a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:25.377857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3564d62e-68fe-46fd-ba5a-439adffcf15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:25.387139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1155/2272] 10.222.0.74 () {58 vars in 1018 bytes} [Thu Jul 14 10:25:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:25:25.398103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dd2fd-a7c1-4692-a71d-1c8cb3c060c8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:25.409850 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dd2fd-a7c1-4692-a71d-1c8cb3c060c8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:25.414277 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a81dac-0723-4f59-beba-d8b431f15863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:25.414933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a81dac-0723-4f59-beba-d8b431f15863 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:25.415219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a81dac-0723-4f59-beba-d8b431f15863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:25.415503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a81dac-0723-4f59-beba-d8b431f15863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:25.427543 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a81dac-0723-4f59-beba-d8b431f15863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:25.429082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a81dac-0723-4f59-beba-d8b431f15863 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:25.442658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1118/2273] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:25:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:25:29.374270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2207bac-1197-4da6-8fa6-062c722435e6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:29.375566 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2207bac-1197-4da6-8fa6-062c722435e6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:29.375566 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2207bac-1197-4da6-8fa6-062c722435e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:29.394089 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e2207bac-1197-4da6-8fa6-062c722435e6 None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:29.395347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e2207bac-1197-4da6-8fa6-062c722435e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:29.449685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1156/2274] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:25:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:29.462294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a81dac-0723-4f59-beba-d8b431f15863 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:29.463604 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-60a81dac-0723-4f59-beba-d8b431f15863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:29.534591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a81dac-0723-4f59-beba-d8b431f15863 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:29.539705 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265729c3-cf69-4369-aa19-4a1a63f734b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:29.540580 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265729c3-cf69-4369-aa19-4a1a63f734b7 service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:29.544941 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265729c3-cf69-4369-aa19-4a1a63f734b7 service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:29.544941 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265729c3-cf69-4369-aa19-4a1a63f734b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:29.550055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265729c3-cf69-4369-aa19-4a1a63f734b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:29.551789 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265729c3-cf69-4369-aa19-4a1a63f734b7 service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:29.560177 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1119/2275] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:25:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:25:30.158682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3c997-3d20-4779-a2a6-687b34defde2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:30.158968 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3c997-3d20-4779-a2a6-687b34defde2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:30.159671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3c997-3d20-4779-a2a6-687b34defde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:30.184629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-89d3c997-3d20-4779-a2a6-687b34defde2 None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:30.185948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-89d3c997-3d20-4779-a2a6-687b34defde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:30.202317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1157/2276] 10.222.0.74 () {58 vars in 967 bytes} [Thu Jul 14 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:30.219911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265729c3-cf69-4369-aa19-4a1a63f734b7 service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:30.231413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265729c3-cf69-4369-aa19-4a1a63f734b7 service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:30.239727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a1ddc-3b78-4a91-a552-87a9cc208fff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:30.241919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a1ddc-3b78-4a91-a552-87a9cc208fff service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:30.241919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a1ddc-3b78-4a91-a552-87a9cc208fff service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:30.241919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a1ddc-3b78-4a91-a552-87a9cc208fff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:30.251401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a1ddc-3b78-4a91-a552-87a9cc208fff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:30.253356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a1ddc-3b78-4a91-a552-87a9cc208fff service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:30.264898 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1120/2277] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:25:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:25:34.451070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3c997-3d20-4779-a2a6-687b34defde2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:34.451070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-89d3c997-3d20-4779-a2a6-687b34defde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:34.533031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3c997-3d20-4779-a2a6-687b34defde2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:34.538117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbff3b-1029-4dec-8c30-2be11cbb0c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:34.539160 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbff3b-1029-4dec-8c30-2be11cbb0c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:34.539552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbff3b-1029-4dec-8c30-2be11cbb0c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:34.539936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbff3b-1029-4dec-8c30-2be11cbb0c65 admin admin] PATH_INFO: `/v3/users/42686ca331b14f548fb013dccf68bcc6` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:34.541686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbff3b-1029-4dec-8c30-2be11cbb0c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42686ca331b14f548fb013dccf68bcc6)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:34.545046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbff3b-1029-4dec-8c30-2be11cbb0c65 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:34.970496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-32bbff3b-1029-4dec-8c30-2be11cbb0c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42686ca331b14f548fb013dccf68bcc6'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:34.985627 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-32bbff3b-1029-4dec-8c30-2be11cbb0c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42686ca331b14f548fb013dccf68bcc6'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:35.080354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-32bbff3b-1029-4dec-8c30-2be11cbb0c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42686ca331b14f548fb013dccf68bcc6'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:35.084125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-32bbff3b-1029-4dec-8c30-2be11cbb0c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42686ca331b14f548fb013dccf68bcc6'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:35.090379 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-32bbff3b-1029-4dec-8c30-2be11cbb0c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42686ca331b14f548fb013dccf68bcc6'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:35.092585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:35.098115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1158/2278] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:25:34 2022] DELETE /identity/v3/users/42686ca331b14f548fb013dccf68bcc6 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:25:35.425556 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a1ddc-3b78-4a91-a552-87a9cc208fff service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:35.439242 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a1ddc-3b78-4a91-a552-87a9cc208fff service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:35.506366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512910df-266f-44af-adb8-084f54082e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:35.507243 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512910df-266f-44af-adb8-084f54082e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:35.507526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512910df-266f-44af-adb8-084f54082e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:35.507861 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512910df-266f-44af-adb8-084f54082e45 admin admin] PATH_INFO: `/v3/projects/59ed5bc7ca1c4d7795fc40241e264a52` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:35.509147 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512910df-266f-44af-adb8-084f54082e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ed5bc7ca1c4d7795fc40241e264a52)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:35.511155 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512910df-266f-44af-adb8-084f54082e45 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:35.513052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:35.621553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-512910df-266f-44af-adb8-084f54082e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ed5bc7ca1c4d7795fc40241e264a52', 'request_id': 'req-512910df-266f-44af-adb8-084f54082e45'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:35.692491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-512910df-266f-44af-adb8-084f54082e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ed5bc7ca1c4d7795fc40241e264a52', 'request_id': 'req-512910df-266f-44af-adb8-084f54082e45'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:35.699122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-512910df-266f-44af-adb8-084f54082e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ed5bc7ca1c4d7795fc40241e264a52', 'request_id': 'req-512910df-266f-44af-adb8-084f54082e45'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:35.711708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-512910df-266f-44af-adb8-084f54082e45 admin admin] The token cache is being invalidate because project 59ed5bc7ca1c4d7795fc40241e264a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:25:35.712053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-512910df-266f-44af-adb8-084f54082e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:35.712726 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-512910df-266f-44af-adb8-084f54082e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:35.714332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1121/2279] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:25:35 2022] DELETE /identity/v3/projects/59ed5bc7ca1c4d7795fc40241e264a52 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:25:35.721341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4205d-1e25-4d78-a01b-0da695efbee6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:35.721913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4205d-1e25-4d78-a01b-0da695efbee6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:35.721913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4205d-1e25-4d78-a01b-0da695efbee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:35.742728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d8e4205d-1e25-4d78-a01b-0da695efbee6 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:35.744139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d8e4205d-1e25-4d78-a01b-0da695efbee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:35.810515 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1159/2280] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:35.818133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4169dd-429b-4e21-a0e5-63c429406b24 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:35.818717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4169dd-429b-4e21-a0e5-63c429406b24 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:35.818846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4169dd-429b-4e21-a0e5-63c429406b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:35.838257 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9d4169dd-429b-4e21-a0e5-63c429406b24 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:35.839587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9d4169dd-429b-4e21-a0e5-63c429406b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:35.850802 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1122/2281] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:35.855040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4205d-1e25-4d78-a01b-0da695efbee6 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:35.866198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4205d-1e25-4d78-a01b-0da695efbee6 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:35.871579 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b58a3-14e0-4b46-88d2-63bdfd9c3134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:35.872585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b58a3-14e0-4b46-88d2-63bdfd9c3134 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:35.872992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b58a3-14e0-4b46-88d2-63bdfd9c3134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:35.873351 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b58a3-14e0-4b46-88d2-63bdfd9c3134 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:35.874133 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b58a3-14e0-4b46-88d2-63bdfd9c3134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:25:35.874408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b58a3-14e0-4b46-88d2-63bdfd9c3134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:35.876078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b58a3-14e0-4b46-88d2-63bdfd9c3134 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:35.890708 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1160/2282] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:25:35.895150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4169dd-429b-4e21-a0e5-63c429406b24 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:35.905767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4169dd-429b-4e21-a0e5-63c429406b24 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:35.910905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c40dac-5800-45fc-92ff-ace1ff22c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:35.911737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c40dac-5800-45fc-92ff-ace1ff22c856 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:35.912155 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c40dac-5800-45fc-92ff-ace1ff22c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:35.912533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c40dac-5800-45fc-92ff-ace1ff22c856 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:35.913410 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c40dac-5800-45fc-92ff-ace1ff22c856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:35.915422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c40dac-5800-45fc-92ff-ace1ff22c856 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:35.986170 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1123/2283] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:25:35 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:25:35.990659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b58a3-14e0-4b46-88d2-63bdfd9c3134 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:36.002117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b58a3-14e0-4b46-88d2-63bdfd9c3134 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:36.097024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8fc9c-81ff-4d4a-9509-afb914afbc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:36.097998 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8fc9c-81ff-4d4a-9509-afb914afbc74 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:36.098465 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8fc9c-81ff-4d4a-9509-afb914afbc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:36.098776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8fc9c-81ff-4d4a-9509-afb914afbc74 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:36.099692 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8fc9c-81ff-4d4a-9509-afb914afbc74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:36.101858 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8fc9c-81ff-4d4a-9509-afb914afbc74 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:36.471030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1161/2284] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:25:35 2022] POST /identity/v3/users => generated 293 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:25:36.475877 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c40dac-5800-45fc-92ff-ace1ff22c856 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:36.490321 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c40dac-5800-45fc-92ff-ace1ff22c856 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:36.495439 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e333d6-082f-434d-8e42-a39c9b451b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:36.504430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e333d6-082f-434d-8e42-a39c9b451b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:36.504430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e333d6-082f-434d-8e42-a39c9b451b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:36.504430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e333d6-082f-434d-8e42-a39c9b451b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:36.504430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e333d6-082f-434d-8e42-a39c9b451b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:36.504430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e333d6-082f-434d-8e42-a39c9b451b0b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:36.511289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1124/2285] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:25:36.516152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8fc9c-81ff-4d4a-9509-afb914afbc74 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:36.534573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8fc9c-81ff-4d4a-9509-afb914afbc74 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:36.534573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2004514-868f-4048-af56-85b70e177ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:36.534573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2004514-868f-4048-af56-85b70e177ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:36.534573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2004514-868f-4048-af56-85b70e177ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:36.534895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2004514-868f-4048-af56-85b70e177ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:36.534976 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2004514-868f-4048-af56-85b70e177ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:36.540374 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2004514-868f-4048-af56-85b70e177ff7 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:36.562631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1162/2286] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:25:36.566494 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e333d6-082f-434d-8e42-a39c9b451b0b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:36.579679 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e333d6-082f-434d-8e42-a39c9b451b0b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:36.584499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cec01c-eb30-4c40-9e7e-af3cb6e2d3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:36.585411 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cec01c-eb30-4c40-9e7e-af3cb6e2d3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:36.585689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cec01c-eb30-4c40-9e7e-af3cb6e2d3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:36.585959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cec01c-eb30-4c40-9e7e-af3cb6e2d3f0 admin admin] PATH_INFO: `/v3/projects/c8b4ffbbd77f43a08e91ea5062af3b6b/users/0d6c9a776e6f4f3ba512a8fe8e9a6cd3/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:36.604162 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cec01c-eb30-4c40-9e7e-af3cb6e2d3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b4ffbbd77f43a08e91ea5062af3b6b, user_id=0d6c9a776e6f4f3ba512a8fe8e9a6cd3, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:36.607412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cec01c-eb30-4c40-9e7e-af3cb6e2d3f0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:36.711019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1125/2287] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:25:36 2022] PUT /identity/v3/projects/c8b4ffbbd77f43a08e91ea5062af3b6b/users/0d6c9a776e6f4f3ba512a8fe8e9a6cd3/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:25:36.717023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d125a6-8c4b-44bd-a2ef-f794fa657b04 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:36.718183 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d125a6-8c4b-44bd-a2ef-f794fa657b04 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:36.718491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d125a6-8c4b-44bd-a2ef-f794fa657b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:36.739616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-43d125a6-8c4b-44bd-a2ef-f794fa657b04 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:36.742957 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-43d125a6-8c4b-44bd-a2ef-f794fa657b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:36.809150 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1163/2288] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:36.825513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cec01c-eb30-4c40-9e7e-af3cb6e2d3f0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:36.827548 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c5cec01c-eb30-4c40-9e7e-af3cb6e2d3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:36.894413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cec01c-eb30-4c40-9e7e-af3cb6e2d3f0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:36.898534 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7aa2d-cca1-4e53-8726-ae18f96b809c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:36.899471 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7aa2d-cca1-4e53-8726-ae18f96b809c service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:36.904689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7aa2d-cca1-4e53-8726-ae18f96b809c service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:36.905328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7aa2d-cca1-4e53-8726-ae18f96b809c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:36.915840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7aa2d-cca1-4e53-8726-ae18f96b809c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:36.917558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7aa2d-cca1-4e53-8726-ae18f96b809c service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:36.929905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1126/2289] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:25:40.393422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d125a6-8c4b-44bd-a2ef-f794fa657b04 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:40.395021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-43d125a6-8c4b-44bd-a2ef-f794fa657b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:40.403475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:40.407711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d125a6-8c4b-44bd-a2ef-f794fa657b04 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:40.412694 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74167446-7ee1-4a7b-a143-47fc29ad0711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:40.415264 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74167446-7ee1-4a7b-a143-47fc29ad0711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:40.415264 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74167446-7ee1-4a7b-a143-47fc29ad0711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:40.415264 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74167446-7ee1-4a7b-a143-47fc29ad0711 admin admin] PATH_INFO: `/v3/users/f225c0e898ad4863b81c8d2abe0d2696` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:40.416129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74167446-7ee1-4a7b-a143-47fc29ad0711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f225c0e898ad4863b81c8d2abe0d2696)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:40.418382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74167446-7ee1-4a7b-a143-47fc29ad0711 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:40.687879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-74167446-7ee1-4a7b-a143-47fc29ad0711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f225c0e898ad4863b81c8d2abe0d2696'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:40.702504 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-74167446-7ee1-4a7b-a143-47fc29ad0711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f225c0e898ad4863b81c8d2abe0d2696'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:40.771711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-74167446-7ee1-4a7b-a143-47fc29ad0711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f225c0e898ad4863b81c8d2abe0d2696'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:40.772790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-74167446-7ee1-4a7b-a143-47fc29ad0711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f225c0e898ad4863b81c8d2abe0d2696'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:40.783135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-74167446-7ee1-4a7b-a143-47fc29ad0711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f225c0e898ad4863b81c8d2abe0d2696'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:40.789653 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1164/2290] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:25:40 2022] DELETE /identity/v3/users/f225c0e898ad4863b81c8d2abe0d2696 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:25:40.794034 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d1b3e-57d0-4238-b181-7a1785549cb8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:40.794640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d1b3e-57d0-4238-b181-7a1785549cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:40.794640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d1b3e-57d0-4238-b181-7a1785549cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:40.813024 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f17d1b3e-57d0-4238-b181-7a1785549cb8 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:40.816904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f17d1b3e-57d0-4238-b181-7a1785549cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:40.842235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:40.882758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1127/2291] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:40.894661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74167446-7ee1-4a7b-a143-47fc29ad0711 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:40.896778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-74167446-7ee1-4a7b-a143-47fc29ad0711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:41.035197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74167446-7ee1-4a7b-a143-47fc29ad0711 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:41.048584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b0656-92dd-4db5-9e83-f0ef27624ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:41.049282 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b0656-92dd-4db5-9e83-f0ef27624ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:41.049612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b0656-92dd-4db5-9e83-f0ef27624ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:41.049973 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b0656-92dd-4db5-9e83-f0ef27624ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:41.071280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b0656-92dd-4db5-9e83-f0ef27624ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:41.072773 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b0656-92dd-4db5-9e83-f0ef27624ec1 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:41.118614 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1165/2292] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:25:41.774140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d1b3e-57d0-4238-b181-7a1785549cb8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:41.776049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f17d1b3e-57d0-4238-b181-7a1785549cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:41.791598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d1b3e-57d0-4238-b181-7a1785549cb8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:41.798421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:41.800038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:41.800038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:41.804593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] PATH_INFO: `/v3/projects/39741895aeb746e29650fb3ddeca5f27` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:41.804593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39741895aeb746e29650fb3ddeca5f27)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:41.804593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:41.939637 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39741895aeb746e29650fb3ddeca5f27', 'request_id': 'req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:42.000365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39741895aeb746e29650fb3ddeca5f27', 'request_id': 'req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:42.010313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39741895aeb746e29650fb3ddeca5f27', 'request_id': 'req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:42.027704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] The token cache is being invalidate because project 39741895aeb746e29650fb3ddeca5f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:25:42.028579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:42.030202 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:25:42.032085 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1128/2293] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:25:41 2022] DELETE /identity/v3/projects/39741895aeb746e29650fb3ddeca5f27 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:25:42.866132 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dcff6-b0d7-4047-9204-a843ed33ed8c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:42.866630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dcff6-b0d7-4047-9204-a843ed33ed8c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:42.866764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dcff6-b0d7-4047-9204-a843ed33ed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:42.903197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c20dcff6-b0d7-4047-9204-a843ed33ed8c None None] MFA Rules not processed for user `0d6c9a776e6f4f3ba512a8fe8e9a6cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:42.904816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c20dcff6-b0d7-4047-9204-a843ed33ed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:43.016760 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1166/2294] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:25:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:43.021210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:43.022745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:43.102708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70555fd8-7ee2-4ae0-b024-a25a4ae81e82 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:43.108441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436510bd-be35-4471-9dc8-7ea8cfb5c822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:43.109121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436510bd-be35-4471-9dc8-7ea8cfb5c822 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:43.109406 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436510bd-be35-4471-9dc8-7ea8cfb5c822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:43.109682 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436510bd-be35-4471-9dc8-7ea8cfb5c822 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:43.110403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436510bd-be35-4471-9dc8-7ea8cfb5c822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:43.112368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436510bd-be35-4471-9dc8-7ea8cfb5c822 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:43.225424 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1129/2295] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:25:43 2022] POST /identity/v3/projects => generated 383 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:25:43.229499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dcff6-b0d7-4047-9204-a843ed33ed8c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:43.241501 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dcff6-b0d7-4047-9204-a843ed33ed8c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:43.246597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:43.304800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d21e5f-f35b-4941-b51c-450c9d16266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:43.305579 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d21e5f-f35b-4941-b51c-450c9d16266d admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:43.309361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d21e5f-f35b-4941-b51c-450c9d16266d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:43.309361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d21e5f-f35b-4941-b51c-450c9d16266d admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:43.309361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d21e5f-f35b-4941-b51c-450c9d16266d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:43.309361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d21e5f-f35b-4941-b51c-450c9d16266d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:43.380280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1167/2296] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:25:43 2022] POST /identity/v3/users => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:25:43.385284 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436510bd-be35-4471-9dc8-7ea8cfb5c822 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:43.403319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436510bd-be35-4471-9dc8-7ea8cfb5c822 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:43.408832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc0542-df11-44bf-83f5-2b30be6ea276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:43.414364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0542-df11-44bf-83f5-2b30be6ea276 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:43.414364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0542-df11-44bf-83f5-2b30be6ea276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:43.414364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0542-df11-44bf-83f5-2b30be6ea276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:43.414364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc0542-df11-44bf-83f5-2b30be6ea276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:43.414364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc0542-df11-44bf-83f5-2b30be6ea276 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:43.433396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1130/2297] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:25:43.437288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d21e5f-f35b-4941-b51c-450c9d16266d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:43.448015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d21e5f-f35b-4941-b51c-450c9d16266d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:43.453930 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12876003-9ce7-4cac-838c-2d7489e90f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:43.455294 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12876003-9ce7-4cac-838c-2d7489e90f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:43.455587 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12876003-9ce7-4cac-838c-2d7489e90f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:43.455854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12876003-9ce7-4cac-838c-2d7489e90f8d admin admin] PATH_INFO: `/v3/projects/faf38a2209ce48b5a4bd78a44040b107/users/2b8311bc987444cfab7072584cff292e/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:43.475691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12876003-9ce7-4cac-838c-2d7489e90f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf38a2209ce48b5a4bd78a44040b107, user_id=2b8311bc987444cfab7072584cff292e, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:43.479526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12876003-9ce7-4cac-838c-2d7489e90f8d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:43.600697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1168/2298] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:25:43 2022] PUT /identity/v3/projects/faf38a2209ce48b5a4bd78a44040b107/users/2b8311bc987444cfab7072584cff292e/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:25:43.605122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc0542-df11-44bf-83f5-2b30be6ea276 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:43.621919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc0542-df11-44bf-83f5-2b30be6ea276 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:43.658753 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:43.707526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce5428-7c58-43e5-a33c-96c5abb64d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:43.708247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce5428-7c58-43e5-a33c-96c5abb64d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:43.709823 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce5428-7c58-43e5-a33c-96c5abb64d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:43.709823 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce5428-7c58-43e5-a33c-96c5abb64d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:43.710013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce5428-7c58-43e5-a33c-96c5abb64d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:43.712043 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce5428-7c58-43e5-a33c-96c5abb64d38 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:43.726435 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1131/2299] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:25:43.728415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12876003-9ce7-4cac-838c-2d7489e90f8d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:43.744259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12876003-9ce7-4cac-838c-2d7489e90f8d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:43.750033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f85176-242a-4e0e-b86c-63a71d79b128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:43.750926 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f85176-242a-4e0e-b86c-63a71d79b128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:43.751210 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f85176-242a-4e0e-b86c-63a71d79b128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:43.751484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f85176-242a-4e0e-b86c-63a71d79b128 admin admin] PATH_INFO: `/v3/projects/faf38a2209ce48b5a4bd78a44040b107/users/2b8311bc987444cfab7072584cff292e/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:43.753938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f85176-242a-4e0e-b86c-63a71d79b128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf38a2209ce48b5a4bd78a44040b107, user_id=2b8311bc987444cfab7072584cff292e, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:43.756660 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f85176-242a-4e0e-b86c-63a71d79b128 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:43.772754 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1169/2300] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:25:43 2022] PUT /identity/v3/projects/faf38a2209ce48b5a4bd78a44040b107/users/2b8311bc987444cfab7072584cff292e/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:25:47.118651 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8c1f-dbe1-4653-80ff-5810f0d9bebf None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:47.119172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8c1f-dbe1-4653-80ff-5810f0d9bebf None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:47.119368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8c1f-dbe1-4653-80ff-5810f0d9bebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:47.154361 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-cf6c8c1f-dbe1-4653-80ff-5810f0d9bebf None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:47.156212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-cf6c8c1f-dbe1-4653-80ff-5810f0d9bebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:47.249964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1132/2301] 10.222.0.74 () {58 vars in 967 bytes} [Thu Jul 14 10:25:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:47.258428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f85176-242a-4e0e-b86c-63a71d79b128 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:47.260356 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-50f85176-242a-4e0e-b86c-63a71d79b128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:47.389401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f85176-242a-4e0e-b86c-63a71d79b128 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:47.395175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a323a4c-4a4d-4575-9ee1-5066cfac3672 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:47.396500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a323a4c-4a4d-4575-9ee1-5066cfac3672 service swift] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:47.396904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a323a4c-4a4d-4575-9ee1-5066cfac3672 service swift] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:47.397287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a323a4c-4a4d-4575-9ee1-5066cfac3672 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:47.419357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a323a4c-4a4d-4575-9ee1-5066cfac3672 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:47.422545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a323a4c-4a4d-4575-9ee1-5066cfac3672 service swift] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:47.451744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1170/2302] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:25:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:25:47.653178 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfa057-3048-4831-bf7c-d65c5b41ebd5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:47.653592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfa057-3048-4831-bf7c-d65c5b41ebd5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:47.653974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfa057-3048-4831-bf7c-d65c5b41ebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:47.688080 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4cbfa057-3048-4831-bf7c-d65c5b41ebd5 None None] MFA Rules not processed for user `3af2be9c1e9a4f0c8f4bdaa04769756c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:47.690460 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4cbfa057-3048-4831-bf7c-d65c5b41ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:47.761003 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1133/2303] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:25:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:51.238498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4f0c3-d228-4ab2-916c-0f55c7f3d009 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:51.239099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4f0c3-d228-4ab2-916c-0f55c7f3d009 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:51.239099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4f0c3-d228-4ab2-916c-0f55c7f3d009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:51.275173 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e7a4f0c3-d228-4ab2-916c-0f55c7f3d009 None None] MFA Rules not processed for user `2b8311bc987444cfab7072584cff292e`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:51.276442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e7a4f0c3-d228-4ab2-916c-0f55c7f3d009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:51.339510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:51.372078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1171/2304] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:25:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:51.390038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfa057-3048-4831-bf7c-d65c5b41ebd5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:51.390727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4cbfa057-3048-4831-bf7c-d65c5b41ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:51.511527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfa057-3048-4831-bf7c-d65c5b41ebd5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:51.515811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059b142-c2b9-4f02-98ae-4dd2636ed240 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397a66eb12254a65bf05bc9fff9a868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:51.516592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b142-c2b9-4f02-98ae-4dd2636ed240 service glance] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:51.516879 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b142-c2b9-4f02-98ae-4dd2636ed240 service glance] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:51.517208 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b142-c2b9-4f02-98ae-4dd2636ed240 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:51.557003 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:51.598865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059b142-c2b9-4f02-98ae-4dd2636ed240 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:51.600378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059b142-c2b9-4f02-98ae-4dd2636ed240 service glance] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:51.610817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1134/2305] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:25:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:25:51.815823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40d321-ff17-4329-9dde-df45e5484498 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:51.816163 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40d321-ff17-4329-9dde-df45e5484498 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:51.816448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40d321-ff17-4329-9dde-df45e5484498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:51.835120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1e40d321-ff17-4329-9dde-df45e5484498 None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:51.836375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1e40d321-ff17-4329-9dde-df45e5484498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:51.845681 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1172/2306] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:25:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:51.866484 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059b142-c2b9-4f02-98ae-4dd2636ed240 service glance] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:51.878365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059b142-c2b9-4f02-98ae-4dd2636ed240 service glance] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:51.889319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bdac0-1a8b-45f4-84e3-7dc786d254c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:51.890019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bdac0-1a8b-45f4-84e3-7dc786d254c9 service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:51.890312 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bdac0-1a8b-45f4-84e3-7dc786d254c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:51.890592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bdac0-1a8b-45f4-84e3-7dc786d254c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:51.903639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bdac0-1a8b-45f4-84e3-7dc786d254c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:51.910505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bdac0-1a8b-45f4-84e3-7dc786d254c9 service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:51.915116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1135/2307] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:25:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:26:01.829744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=14 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:26:01.913768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=21 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:26:03.122479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72156099-9fd3-4e5b-ba51-de406b7663bc None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:26:03.123013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72156099-9fd3-4e5b-ba51-de406b7663bc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:26:03.123013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72156099-9fd3-4e5b-ba51-de406b7663bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:26:03.140964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-72156099-9fd3-4e5b-ba51-de406b7663bc None None] MFA Rules not processed for user `0d6c9a776e6f4f3ba512a8fe8e9a6cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:26:03.142270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-72156099-9fd3-4e5b-ba51-de406b7663bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:26:03.149332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1173/2308] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:26:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:26:05.752485 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bdac0-1a8b-45f4-84e3-7dc786d254c9 service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:26:05.754735 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-752bdac0-1a8b-45f4-84e3-7dc786d254c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:26:05.824811 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bdac0-1a8b-45f4-84e3-7dc786d254c9 service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:26:05.830406 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57806ce-c444-46e6-9c45-b200ebed4189 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784d36c16d343cc961a22d956ee30f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:26:05.831058 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57806ce-c444-46e6-9c45-b200ebed4189 service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:26:05.831345 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57806ce-c444-46e6-9c45-b200ebed4189 service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:26:05.831627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57806ce-c444-46e6-9c45-b200ebed4189 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:26:05.833425 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d57806ce-c444-46e6-9c45-b200ebed4189 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:26:05.844985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57806ce-c444-46e6-9c45-b200ebed4189 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:26:05.846613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57806ce-c444-46e6-9c45-b200ebed4189 service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:26:05.857028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1136/2309] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:26:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:26:07.728698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c3346-0c89-41b0-a94f-a196bbd29278 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:26:07.729197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c3346-0c89-41b0-a94f-a196bbd29278 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:26:07.729387 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c3346-0c89-41b0-a94f-a196bbd29278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:26:07.752733 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f48c3346-0c89-41b0-a94f-a196bbd29278 None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:26:07.754250 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f48c3346-0c89-41b0-a94f-a196bbd29278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:26:07.764686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1174/2310] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:26:07.779207 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57806ce-c444-46e6-9c45-b200ebed4189 service placement] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:26:07.791417 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57806ce-c444-46e6-9c45-b200ebed4189 service placement] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:26:07.799001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624dbb1-1a71-4b77-8be4-f2fc7ff9334a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:26:07.799763 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624dbb1-1a71-4b77-8be4-f2fc7ff9334a service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:26:07.799949 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624dbb1-1a71-4b77-8be4-f2fc7ff9334a service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:26:07.800872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624dbb1-1a71-4b77-8be4-f2fc7ff9334a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:26:07.810656 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624dbb1-1a71-4b77-8be4-f2fc7ff9334a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:26:07.812342 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624dbb1-1a71-4b77-8be4-f2fc7ff9334a service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:26:07.822516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1137/2311] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:26:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:26:17.745930 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=6 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:26:17.819125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=38 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:26:38.208398 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c3346-0c89-41b0-a94f-a196bbd29278 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:26:38.211288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f48c3346-0c89-41b0-a94f-a196bbd29278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:26:38.287409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c3346-0c89-41b0-a94f-a196bbd29278 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:26:38.292222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b4b86-832c-409d-a1ee-771d2121c71a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:26:38.294050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b4b86-832c-409d-a1ee-771d2121c71a service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:26:38.294566 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b4b86-832c-409d-a1ee-771d2121c71a service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:26:38.295499 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b4b86-832c-409d-a1ee-771d2121c71a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:26:38.314813 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b4b86-832c-409d-a1ee-771d2121c71a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:26:38.316428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b4b86-832c-409d-a1ee-771d2121c71a service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:26:38.331635 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1175/2312] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:26:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:26:41.664570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f69cad-5765-41b1-87ab-7e00775066bb None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:26:41.665133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f69cad-5765-41b1-87ab-7e00775066bb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:26:41.665133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f69cad-5765-41b1-87ab-7e00775066bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:26:41.683163 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-53f69cad-5765-41b1-87ab-7e00775066bb None None] MFA Rules not processed for user `69e33c07f0844f228bef34d242d3be11`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:26:41.684420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-53f69cad-5765-41b1-87ab-7e00775066bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:26:41.742094 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1138/2313] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:26:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:26:48.323245 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=26 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:26:51.735082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=25 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:26:58.803366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aa274-1349-40ce-bfdb-26f3fd5163a3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:26:58.803875 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aa274-1349-40ce-bfdb-26f3fd5163a3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:26:58.804601 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aa274-1349-40ce-bfdb-26f3fd5163a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:26:58.821804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-764aa274-1349-40ce-bfdb-26f3fd5163a3 None None] MFA Rules not processed for user `8acb1c9eead84a11a48c1a217ce82584`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:26:58.823004 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-764aa274-1349-40ce-bfdb-26f3fd5163a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:26:58.879763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1176/2314] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:26:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:27:08.872252 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=25 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:27:10.217941 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b674-86f5-4747-867f-078afc106201 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:27:10.218527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b674-86f5-4747-867f-078afc106201 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:27:10.218527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b674-86f5-4747-867f-078afc106201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:27:10.237367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f7e4b674-86f5-4747-867f-078afc106201 None None] MFA Rules not processed for user `3af2be9c1e9a4f0c8f4bdaa04769756c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:27:10.238601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f7e4b674-86f5-4747-867f-078afc106201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:27:10.245611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1139/2315] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:27:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:27:12.866829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510b421-f35d-4089-bae9-6f1f5218528b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:27:12.867353 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510b421-f35d-4089-bae9-6f1f5218528b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:27:12.867481 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510b421-f35d-4089-bae9-6f1f5218528b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:27:12.887444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8510b421-f35d-4089-bae9-6f1f5218528b None None] MFA Rules not processed for user `35057047c93946a7a1ff01bd649abd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:27:12.888883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8510b421-f35d-4089-bae9-6f1f5218528b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:27:12.945902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1177/2316] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:27:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:27:20.230850 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:27:22.941886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=25 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:27:45.052707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4b674-86f5-4747-867f-078afc106201 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:27:45.054083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f7e4b674-86f5-4747-867f-078afc106201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:27:45.111449 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4b674-86f5-4747-867f-078afc106201 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:27:45.114884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e5b2c-9700-4b33-afc1-6d5c6790b41a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:27:45.115522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e5b2c-9700-4b33-afc1-6d5c6790b41a service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:27:45.115801 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e5b2c-9700-4b33-afc1-6d5c6790b41a service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:27:45.116112 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e5b2c-9700-4b33-afc1-6d5c6790b41a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:27:45.117860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-570e5b2c-9700-4b33-afc1-6d5c6790b41a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:27:45.187755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e5b2c-9700-4b33-afc1-6d5c6790b41a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:27:45.189208 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e5b2c-9700-4b33-afc1-6d5c6790b41a service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:27:45.199865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1140/2317] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:27:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:27:46.945225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510b421-f35d-4089-bae9-6f1f5218528b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:27:46.956381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510b421-f35d-4089-bae9-6f1f5218528b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:27:46.960234 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453b0f9-8085-48a1-8c25-76ca5f37f20a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:27:46.960931 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453b0f9-8085-48a1-8c25-76ca5f37f20a service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:27:46.961200 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453b0f9-8085-48a1-8c25-76ca5f37f20a service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:27:46.961478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453b0f9-8085-48a1-8c25-76ca5f37f20a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:27:46.963324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7453b0f9-8085-48a1-8c25-76ca5f37f20a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:27:46.977562 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453b0f9-8085-48a1-8c25-76ca5f37f20a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:27:46.978986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453b0f9-8085-48a1-8c25-76ca5f37f20a service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:27:46.990316 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1178/2318] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:27:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:27:53.037981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e5b2c-9700-4b33-afc1-6d5c6790b41a service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:27:53.039387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-570e5b2c-9700-4b33-afc1-6d5c6790b41a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:27:53.056440 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e5b2c-9700-4b33-afc1-6d5c6790b41a service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:27:53.063454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f5f74-3768-47d0-97f4-63d88e5f7cba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:27:53.064162 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f5f74-3768-47d0-97f4-63d88e5f7cba service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:27:53.064451 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f5f74-3768-47d0-97f4-63d88e5f7cba service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:27:53.064732 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f5f74-3768-47d0-97f4-63d88e5f7cba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:27:53.066533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b58f5f74-3768-47d0-97f4-63d88e5f7cba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:27:53.078930 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f5f74-3768-47d0-97f4-63d88e5f7cba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:27:53.080876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f5f74-3768-47d0-97f4-63d88e5f7cba service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:27:53.091693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1141/2319] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:27:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:27:56.985339 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=6 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:27:59.938245 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453b0f9-8085-48a1-8c25-76ca5f37f20a service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:27:59.939811 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7453b0f9-8085-48a1-8c25-76ca5f37f20a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:27:59.954188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453b0f9-8085-48a1-8c25-76ca5f37f20a service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:27:59.960036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388cfdc-b79b-481c-941e-3c35656c42e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:27:59.960685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388cfdc-b79b-481c-941e-3c35656c42e6 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:27:59.960970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388cfdc-b79b-481c-941e-3c35656c42e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:27:59.961262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388cfdc-b79b-481c-941e-3c35656c42e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:27:59.963000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2388cfdc-b79b-481c-941e-3c35656c42e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:27:59.973160 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388cfdc-b79b-481c-941e-3c35656c42e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:27:59.974715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388cfdc-b79b-481c-941e-3c35656c42e6 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:27:59.983432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1179/2320] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:27:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:03.087233 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=60 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:08.068954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedab003-9c33-439b-92c9-b76797952aea None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:08.069497 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedab003-9c33-439b-92c9-b76797952aea None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:08.069580 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedab003-9c33-439b-92c9-b76797952aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:08.087481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-dedab003-9c33-439b-92c9-b76797952aea None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:08.088876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-dedab003-9c33-439b-92c9-b76797952aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:08.096095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1142/2321] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:28:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:08.137150 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388cfdc-b79b-481c-941e-3c35656c42e6 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:08.148551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388cfdc-b79b-481c-941e-3c35656c42e6 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:08.154628 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466f543-03f3-4533-92ab-55d266928db9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:08.156040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466f543-03f3-4533-92ab-55d266928db9 service swift] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:08.156040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466f543-03f3-4533-92ab-55d266928db9 service swift] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:08.156040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466f543-03f3-4533-92ab-55d266928db9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:08.164425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466f543-03f3-4533-92ab-55d266928db9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:08.165998 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466f543-03f3-4533-92ab-55d266928db9 service swift] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:08.175531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1180/2322] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:28:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:28:10.835083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedab003-9c33-439b-92c9-b76797952aea None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:10.840529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-dedab003-9c33-439b-92c9-b76797952aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:10.852540 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedab003-9c33-439b-92c9-b76797952aea None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:10.856400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c50fa-6e8b-4dbf-b342-7e46878542d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:10.857559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c50fa-6e8b-4dbf-b342-7e46878542d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:10.857839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c50fa-6e8b-4dbf-b342-7e46878542d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:10.858113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c50fa-6e8b-4dbf-b342-7e46878542d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:10.860044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c87c50fa-6e8b-4dbf-b342-7e46878542d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:10.927033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c50fa-6e8b-4dbf-b342-7e46878542d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:10.928504 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c50fa-6e8b-4dbf-b342-7e46878542d9 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:10.940430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1143/2323] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:13.579947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466f543-03f3-4533-92ab-55d266928db9 service swift] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:13.594344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466f543-03f3-4533-92ab-55d266928db9 service swift] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:13.606265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081159d1-a4f9-4ef9-8368-90643c1b72a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:13.608762 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081159d1-a4f9-4ef9-8368-90643c1b72a9 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:13.609278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081159d1-a4f9-4ef9-8368-90643c1b72a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:13.609778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081159d1-a4f9-4ef9-8368-90643c1b72a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:13.612998 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-081159d1-a4f9-4ef9-8368-90643c1b72a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:13.643134 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081159d1-a4f9-4ef9-8368-90643c1b72a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:13.645072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081159d1-a4f9-4ef9-8368-90643c1b72a9 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:13.660294 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1181/2324] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:15.740428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c50fa-6e8b-4dbf-b342-7e46878542d9 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:15.753871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c50fa-6e8b-4dbf-b342-7e46878542d9 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:15.759542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a93d1-3ec1-441c-84b1-eb19f4d38db4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784d36c16d343cc961a22d956ee30f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:15.760446 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a93d1-3ec1-441c-84b1-eb19f4d38db4 service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:15.761215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a93d1-3ec1-441c-84b1-eb19f4d38db4 service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:15.761503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a93d1-3ec1-441c-84b1-eb19f4d38db4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:15.765046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5b1a93d1-3ec1-441c-84b1-eb19f4d38db4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:15.781271 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a93d1-3ec1-441c-84b1-eb19f4d38db4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:15.783555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a93d1-3ec1-441c-84b1-eb19f4d38db4 service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:15.801427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1144/2325] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:15.887765 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081159d1-a4f9-4ef9-8368-90643c1b72a9 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:15.889878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-081159d1-a4f9-4ef9-8368-90643c1b72a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:15.912963 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081159d1-a4f9-4ef9-8368-90643c1b72a9 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:15.921029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c4fb4-f10c-4528-8a8c-4375da540264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:15.922648 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c4fb4-f10c-4528-8a8c-4375da540264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:15.923210 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c4fb4-f10c-4528-8a8c-4375da540264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:15.923630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c4fb4-f10c-4528-8a8c-4375da540264 admin admin] PATH_INFO: `/v3/users/8acb1c9eead84a11a48c1a217ce82584` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:15.925042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c4fb4-f10c-4528-8a8c-4375da540264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8acb1c9eead84a11a48c1a217ce82584)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:15.927232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c4fb4-f10c-4528-8a8c-4375da540264 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:16.154871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f47c4fb4-f10c-4528-8a8c-4375da540264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8acb1c9eead84a11a48c1a217ce82584'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:16.173348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f47c4fb4-f10c-4528-8a8c-4375da540264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8acb1c9eead84a11a48c1a217ce82584'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:16.253880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f47c4fb4-f10c-4528-8a8c-4375da540264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8acb1c9eead84a11a48c1a217ce82584'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:16.254647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f47c4fb4-f10c-4528-8a8c-4375da540264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8acb1c9eead84a11a48c1a217ce82584'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:16.265154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f47c4fb4-f10c-4528-8a8c-4375da540264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8acb1c9eead84a11a48c1a217ce82584'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:16.295199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1182/2326] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:28:15 2022] DELETE /identity/v3/users/8acb1c9eead84a11a48c1a217ce82584 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:16.628692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a93d1-3ec1-441c-84b1-eb19f4d38db4 service placement] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:16.643036 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a93d1-3ec1-441c-84b1-eb19f4d38db4 service placement] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:16.731607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c840f-6955-46e1-bb03-440fcb8a9b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:16.732982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c840f-6955-46e1-bb03-440fcb8a9b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:16.733521 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c840f-6955-46e1-bb03-440fcb8a9b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:16.734023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c840f-6955-46e1-bb03-440fcb8a9b01 admin admin] PATH_INFO: `/v3/projects/4cc0556d9ff741a295bd274063056fb7` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:16.735603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c840f-6955-46e1-bb03-440fcb8a9b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc0556d9ff741a295bd274063056fb7)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:16.741838 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c840f-6955-46e1-bb03-440fcb8a9b01 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:16.919464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-eb0c840f-6955-46e1-bb03-440fcb8a9b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc0556d9ff741a295bd274063056fb7', 'request_id': 'req-eb0c840f-6955-46e1-bb03-440fcb8a9b01'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:16.980928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-eb0c840f-6955-46e1-bb03-440fcb8a9b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc0556d9ff741a295bd274063056fb7', 'request_id': 'req-eb0c840f-6955-46e1-bb03-440fcb8a9b01'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:16.986431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-eb0c840f-6955-46e1-bb03-440fcb8a9b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc0556d9ff741a295bd274063056fb7', 'request_id': 'req-eb0c840f-6955-46e1-bb03-440fcb8a9b01'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:17.015423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-eb0c840f-6955-46e1-bb03-440fcb8a9b01 admin admin] The token cache is being invalidate because project 4cc0556d9ff741a295bd274063056fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:28:17.015716 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-eb0c840f-6955-46e1-bb03-440fcb8a9b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:17.016606 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-eb0c840f-6955-46e1-bb03-440fcb8a9b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:17.018578 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1145/2327] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:28:16 2022] DELETE /identity/v3/projects/4cc0556d9ff741a295bd274063056fb7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:17.023867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e0e1b-004f-4e9a-b943-333dbfbbe69f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:17.024373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e0e1b-004f-4e9a-b943-333dbfbbe69f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:17.024484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e0e1b-004f-4e9a-b943-333dbfbbe69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:17.051238 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b08e0e1b-004f-4e9a-b943-333dbfbbe69f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:17.055549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b08e0e1b-004f-4e9a-b943-333dbfbbe69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:17.152156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1183/2328] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:17.159848 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48557eb-3b56-4199-aa25-5081a946b373 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:17.160398 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48557eb-3b56-4199-aa25-5081a946b373 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:17.164512 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48557eb-3b56-4199-aa25-5081a946b373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:17.171726 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:17.184270 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f48557eb-3b56-4199-aa25-5081a946b373 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:17.185795 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f48557eb-3b56-4199-aa25-5081a946b373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:17.195467 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1146/2329] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:28:17.200627 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e0e1b-004f-4e9a-b943-333dbfbbe69f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:17.211740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e0e1b-004f-4e9a-b943-333dbfbbe69f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:17.217494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c7bde-ada8-491c-8d11-603ea0666e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:17.218235 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c7bde-ada8-491c-8d11-603ea0666e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:17.218612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c7bde-ada8-491c-8d11-603ea0666e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:17.218960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c7bde-ada8-491c-8d11-603ea0666e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:17.219965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c7bde-ada8-491c-8d11-603ea0666e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:28:17.220691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c7bde-ada8-491c-8d11-603ea0666e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:17.222518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c7bde-ada8-491c-8d11-603ea0666e86 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:17.237939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1184/2330] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:28:17.242373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48557eb-3b56-4199-aa25-5081a946b373 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:17.257855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48557eb-3b56-4199-aa25-5081a946b373 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:17.263067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1efc1-a7f3-494f-b3bc-1b87e5ddf9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:17.263884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1efc1-a7f3-494f-b3bc-1b87e5ddf9ca admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:17.264314 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1efc1-a7f3-494f-b3bc-1b87e5ddf9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:17.264691 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1efc1-a7f3-494f-b3bc-1b87e5ddf9ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:17.265530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1efc1-a7f3-494f-b3bc-1b87e5ddf9ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:17.267611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1efc1-a7f3-494f-b3bc-1b87e5ddf9ca admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:17.423172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1147/2331] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:28:17 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:28:17.427193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c7bde-ada8-491c-8d11-603ea0666e86 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:17.442986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c7bde-ada8-491c-8d11-603ea0666e86 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:17.473417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:17.542734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896a94b-6c9f-4d70-9f08-cec10e258109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:17.543526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896a94b-6c9f-4d70-9f08-cec10e258109 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:17.543841 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896a94b-6c9f-4d70-9f08-cec10e258109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:17.544155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896a94b-6c9f-4d70-9f08-cec10e258109 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:17.544856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896a94b-6c9f-4d70-9f08-cec10e258109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:17.547348 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896a94b-6c9f-4d70-9f08-cec10e258109 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:17.672180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1185/2332] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:28:17 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:28:17.676444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1efc1-a7f3-494f-b3bc-1b87e5ddf9ca admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:17.692222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1efc1-a7f3-494f-b3bc-1b87e5ddf9ca admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:17.697129 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01b324-4d10-460d-8b1d-a40698fd1727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:17.697942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01b324-4d10-460d-8b1d-a40698fd1727 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:17.698267 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01b324-4d10-460d-8b1d-a40698fd1727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:17.698548 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01b324-4d10-460d-8b1d-a40698fd1727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:17.699320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01b324-4d10-460d-8b1d-a40698fd1727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:17.701103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01b324-4d10-460d-8b1d-a40698fd1727 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:17.733382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1148/2333] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:28:17.737620 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896a94b-6c9f-4d70-9f08-cec10e258109 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:17.750909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896a94b-6c9f-4d70-9f08-cec10e258109 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:17.759704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87844e4a-4f1a-4521-b0f5-c6a481ef2eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:17.760489 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87844e4a-4f1a-4521-b0f5-c6a481ef2eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:17.764709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87844e4a-4f1a-4521-b0f5-c6a481ef2eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:17.764709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87844e4a-4f1a-4521-b0f5-c6a481ef2eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:17.764709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87844e4a-4f1a-4521-b0f5-c6a481ef2eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:17.764709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87844e4a-4f1a-4521-b0f5-c6a481ef2eb2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:17.776776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1186/2334] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:28:17.781147 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01b324-4d10-460d-8b1d-a40698fd1727 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:17.792535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01b324-4d10-460d-8b1d-a40698fd1727 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:17.797893 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d848050-22af-42cf-9a68-40a903a0548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:17.798803 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d848050-22af-42cf-9a68-40a903a0548b admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:17.799239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d848050-22af-42cf-9a68-40a903a0548b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:17.799527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d848050-22af-42cf-9a68-40a903a0548b admin admin] PATH_INFO: `/v3/projects/0ed704d7ed214a0fabd09afbee356429/users/7b1edc44cd4747708ba0e176fabc5568/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:17.816273 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d848050-22af-42cf-9a68-40a903a0548b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed704d7ed214a0fabd09afbee356429, user_id=7b1edc44cd4747708ba0e176fabc5568, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:17.819119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d848050-22af-42cf-9a68-40a903a0548b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:18.225483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1149/2335] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:28:17 2022] PUT /identity/v3/projects/0ed704d7ed214a0fabd09afbee356429/users/7b1edc44cd4747708ba0e176fabc5568/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:28:18.237026 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b20f6f-e3c9-430d-a199-4656fb372976 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:18.237661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b20f6f-e3c9-430d-a199-4656fb372976 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:18.237661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b20f6f-e3c9-430d-a199-4656fb372976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:18.265424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c8b20f6f-e3c9-430d-a199-4656fb372976 None None] MFA Rules not processed for user `7b1edc44cd4747708ba0e176fabc5568`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:18.266511 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c8b20f6f-e3c9-430d-a199-4656fb372976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:18.329001 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1187/2336] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:18.333495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d848050-22af-42cf-9a68-40a903a0548b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:18.396346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d848050-22af-42cf-9a68-40a903a0548b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:18.401444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c68f07-75dd-4d6c-baa8-225021c89895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:18.402113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68f07-75dd-4d6c-baa8-225021c89895 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:18.402433 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68f07-75dd-4d6c-baa8-225021c89895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:18.402742 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68f07-75dd-4d6c-baa8-225021c89895 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:18.404120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c68f07-75dd-4d6c-baa8-225021c89895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:18.406037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c68f07-75dd-4d6c-baa8-225021c89895 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:18.561087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1150/2337] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:28:18 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:28:18.564804 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b20f6f-e3c9-430d-a199-4656fb372976 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:18.578501 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b20f6f-e3c9-430d-a199-4656fb372976 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:18.643929 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a462f8-5fe0-4483-b708-5e349e037fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:18.644764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a462f8-5fe0-4483-b708-5e349e037fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:18.645056 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a462f8-5fe0-4483-b708-5e349e037fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:18.645312 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a462f8-5fe0-4483-b708-5e349e037fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:18.646166 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a462f8-5fe0-4483-b708-5e349e037fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:18.653680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a462f8-5fe0-4483-b708-5e349e037fb2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:18.764131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1188/2338] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:28:18 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:28:18.767806 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c68f07-75dd-4d6c-baa8-225021c89895 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:18.790665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c68f07-75dd-4d6c-baa8-225021c89895 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:18.795356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed623d8-eb00-4c00-9575-dbbef675b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:18.810465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed623d8-eb00-4c00-9575-dbbef675b0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:18.810465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed623d8-eb00-4c00-9575-dbbef675b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:18.810465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed623d8-eb00-4c00-9575-dbbef675b0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:18.810465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed623d8-eb00-4c00-9575-dbbef675b0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:18.810465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed623d8-eb00-4c00-9575-dbbef675b0fa admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:18.816182 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1151/2339] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:28:18.822826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a462f8-5fe0-4483-b708-5e349e037fb2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:18.831487 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a462f8-5fe0-4483-b708-5e349e037fb2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:18.840112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9621b2c-d97f-444c-b1f0-09a534acc0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:18.845536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9621b2c-d97f-444c-b1f0-09a534acc0ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:18.845536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9621b2c-d97f-444c-b1f0-09a534acc0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:18.845536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9621b2c-d97f-444c-b1f0-09a534acc0ab admin admin] PATH_INFO: `/v3/projects/887ebb6ffad84a0fa9c65f890c0eef70/users/6a40713ec2da455c9e43d34f0cdebdf3/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:18.859000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9621b2c-d97f-444c-b1f0-09a534acc0ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=887ebb6ffad84a0fa9c65f890c0eef70, user_id=6a40713ec2da455c9e43d34f0cdebdf3, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:18.862334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9621b2c-d97f-444c-b1f0-09a534acc0ab admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:18.865357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:18.955743 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1189/2340] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:28:18 2022] PUT /identity/v3/projects/887ebb6ffad84a0fa9c65f890c0eef70/users/6a40713ec2da455c9e43d34f0cdebdf3/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:18.956834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed623d8-eb00-4c00-9575-dbbef675b0fa admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:18.967503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed623d8-eb00-4c00-9575-dbbef675b0fa admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:19.033640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcde66-a2ea-4a17-828e-88d8ce1f1323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:19.034371 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcde66-a2ea-4a17-828e-88d8ce1f1323 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:19.035960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcde66-a2ea-4a17-828e-88d8ce1f1323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:19.036283 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcde66-a2ea-4a17-828e-88d8ce1f1323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:19.037031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcde66-a2ea-4a17-828e-88d8ce1f1323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:19.038654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcde66-a2ea-4a17-828e-88d8ce1f1323 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:19.060757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9621b2c-d97f-444c-b1f0-09a534acc0ab admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:19.062898 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1152/2341] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:28:19.073224 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9621b2c-d97f-444c-b1f0-09a534acc0ab admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:19.081740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab88ff-9d38-41a3-8a06-bde7acc55d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:19.082824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab88ff-9d38-41a3-8a06-bde7acc55d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:19.083109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab88ff-9d38-41a3-8a06-bde7acc55d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:19.083407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab88ff-9d38-41a3-8a06-bde7acc55d81 admin admin] PATH_INFO: `/v3/projects/887ebb6ffad84a0fa9c65f890c0eef70/users/6a40713ec2da455c9e43d34f0cdebdf3/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:19.085654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab88ff-9d38-41a3-8a06-bde7acc55d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=887ebb6ffad84a0fa9c65f890c0eef70, user_id=6a40713ec2da455c9e43d34f0cdebdf3, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:19.088461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab88ff-9d38-41a3-8a06-bde7acc55d81 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:19.107060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1190/2342] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:28:19 2022] PUT /identity/v3/projects/887ebb6ffad84a0fa9c65f890c0eef70/users/6a40713ec2da455c9e43d34f0cdebdf3/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:28:19.117981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758427b-9359-40ba-bea6-ff66136b59eb None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:19.118279 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758427b-9359-40ba-bea6-ff66136b59eb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:19.118559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758427b-9359-40ba-bea6-ff66136b59eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:19.145076 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:19.153411 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4758427b-9359-40ba-bea6-ff66136b59eb None None] MFA Rules not processed for user `6a40713ec2da455c9e43d34f0cdebdf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:19.154692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4758427b-9359-40ba-bea6-ff66136b59eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:19.232933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1153/2343] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:19.244767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab88ff-9d38-41a3-8a06-bde7acc55d81 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:19.247860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-25ab88ff-9d38-41a3-8a06-bde7acc55d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:19.311014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab88ff-9d38-41a3-8a06-bde7acc55d81 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:19.314691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c00524-9bed-408a-b9c8-f26d5b72217e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:19.315371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c00524-9bed-408a-b9c8-f26d5b72217e service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:19.315658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c00524-9bed-408a-b9c8-f26d5b72217e service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:19.315937 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c00524-9bed-408a-b9c8-f26d5b72217e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:19.382036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c00524-9bed-408a-b9c8-f26d5b72217e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:19.383475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c00524-9bed-408a-b9c8-f26d5b72217e service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:19.392703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1191/2344] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:20.863274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758427b-9359-40ba-bea6-ff66136b59eb None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:20.865289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4758427b-9359-40ba-bea6-ff66136b59eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:20.923866 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758427b-9359-40ba-bea6-ff66136b59eb None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:20.927492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1758c-beab-4c32-988d-fefa2f531069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:20.928184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1758c-beab-4c32-988d-fefa2f531069 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:20.928468 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1758c-beab-4c32-988d-fefa2f531069 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:20.928745 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1758c-beab-4c32-988d-fefa2f531069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:20.930541 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2ea1758c-beab-4c32-988d-fefa2f531069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:20.941129 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1758c-beab-4c32-988d-fefa2f531069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:20.942565 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1758c-beab-4c32-988d-fefa2f531069 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:20.951430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1154/2345] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:21.108739 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c00524-9bed-408a-b9c8-f26d5b72217e service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:21.111205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e7c00524-9bed-408a-b9c8-f26d5b72217e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:21.124392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c00524-9bed-408a-b9c8-f26d5b72217e service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:21.130753 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836ff96-7573-47fc-bbbc-9b91064cd510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:21.132108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ff96-7573-47fc-bbbc-9b91064cd510 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:21.132108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ff96-7573-47fc-bbbc-9b91064cd510 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:21.132325 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ff96-7573-47fc-bbbc-9b91064cd510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:21.143620 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836ff96-7573-47fc-bbbc-9b91064cd510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:21.144613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836ff96-7573-47fc-bbbc-9b91064cd510 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:21.155145 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1192/2346] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:22.146470 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1758c-beab-4c32-988d-fefa2f531069 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:22.148027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2ea1758c-beab-4c32-988d-fefa2f531069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:22.235790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1758c-beab-4c32-988d-fefa2f531069 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:22.241842 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac46578-23a0-458a-8ffa-0d1549c4455d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:22.242512 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac46578-23a0-458a-8ffa-0d1549c4455d service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:22.242804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac46578-23a0-458a-8ffa-0d1549c4455d service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:22.243092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac46578-23a0-458a-8ffa-0d1549c4455d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:22.245067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7ac46578-23a0-458a-8ffa-0d1549c4455d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:22.261153 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac46578-23a0-458a-8ffa-0d1549c4455d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:22.266202 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac46578-23a0-458a-8ffa-0d1549c4455d service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:22.281359 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1155/2347] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:25.398565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836ff96-7573-47fc-bbbc-9b91064cd510 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:25.465888 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836ff96-7573-47fc-bbbc-9b91064cd510 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:25.470430 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80c72a-ffab-478d-8fb7-887699e57439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:25.471300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80c72a-ffab-478d-8fb7-887699e57439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:25.471582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80c72a-ffab-478d-8fb7-887699e57439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:25.471856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80c72a-ffab-478d-8fb7-887699e57439 admin admin] PATH_INFO: `/v3/users/7b1edc44cd4747708ba0e176fabc5568` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:25.473078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80c72a-ffab-478d-8fb7-887699e57439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1edc44cd4747708ba0e176fabc5568)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:25.475012 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80c72a-ffab-478d-8fb7-887699e57439 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:25.500636 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:INSERT=2,keystone:SELECT=94,keystone:DELETE=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:25.656392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9d80c72a-ffab-478d-8fb7-887699e57439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1edc44cd4747708ba0e176fabc5568'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:25.668288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9d80c72a-ffab-478d-8fb7-887699e57439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1edc44cd4747708ba0e176fabc5568'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:25.755249 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9d80c72a-ffab-478d-8fb7-887699e57439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1edc44cd4747708ba0e176fabc5568'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:25.755882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9d80c72a-ffab-478d-8fb7-887699e57439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1edc44cd4747708ba0e176fabc5568'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:25.763442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9d80c72a-ffab-478d-8fb7-887699e57439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1edc44cd4747708ba0e176fabc5568'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:25.769423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1193/2348] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:28:25 2022] DELETE /identity/v3/users/7b1edc44cd4747708ba0e176fabc5568 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:25.774151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81129b9d-f6e2-4474-a7fc-6e920ab77b5d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:25.774647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81129b9d-f6e2-4474-a7fc-6e920ab77b5d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:25.774746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81129b9d-f6e2-4474-a7fc-6e920ab77b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:25.797430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-81129b9d-f6e2-4474-a7fc-6e920ab77b5d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:25.798843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-81129b9d-f6e2-4474-a7fc-6e920ab77b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:25.823613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:25.867377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1156/2349] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:25.883974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80c72a-ffab-478d-8fb7-887699e57439 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:25.885921 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9d80c72a-ffab-478d-8fb7-887699e57439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:25.951775 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80c72a-ffab-478d-8fb7-887699e57439 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:25.955793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9be94-3ab6-42c2-917c-08fb5ad61909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:25.956567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9be94-3ab6-42c2-917c-08fb5ad61909 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:25.964224 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9be94-3ab6-42c2-917c-08fb5ad61909 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:25.964677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9be94-3ab6-42c2-917c-08fb5ad61909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:25.975440 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9be94-3ab6-42c2-917c-08fb5ad61909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:25.976966 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9be94-3ab6-42c2-917c-08fb5ad61909 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:25.989748 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1194/2350] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:26.498717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81129b9d-f6e2-4474-a7fc-6e920ab77b5d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:26.501912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-81129b9d-f6e2-4474-a7fc-6e920ab77b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:26.517600 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81129b9d-f6e2-4474-a7fc-6e920ab77b5d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:26.522310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:26.523234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:26.523517 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:26.523795 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] PATH_INFO: `/v3/projects/0ed704d7ed214a0fabd09afbee356429` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:26.525017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed704d7ed214a0fabd09afbee356429)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:26.526963 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:26.639586 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed704d7ed214a0fabd09afbee356429', 'request_id': 'req-89a318f6-b782-4cde-b704-88b751b4b7e7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:26.721282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed704d7ed214a0fabd09afbee356429', 'request_id': 'req-89a318f6-b782-4cde-b704-88b751b4b7e7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:26.723069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9be94-3ab6-42c2-917c-08fb5ad61909 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:26.727728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed704d7ed214a0fabd09afbee356429', 'request_id': 'req-89a318f6-b782-4cde-b704-88b751b4b7e7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:26.732388 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9be94-3ab6-42c2-917c-08fb5ad61909 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:26.739368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] The token cache is being invalidate because project 0ed704d7ed214a0fabd09afbee356429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:28:26.739660 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:26.740334 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:26.742085 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1157/2351] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:28:26 2022] DELETE /identity/v3/projects/0ed704d7ed214a0fabd09afbee356429 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:26.745959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:26.747320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:26.783781 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e73bf-3adb-4e43-a5a5-f80db38954c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:26.784640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e73bf-3adb-4e43-a5a5-f80db38954c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:26.785004 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e73bf-3adb-4e43-a5a5-f80db38954c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:26.785350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e73bf-3adb-4e43-a5a5-f80db38954c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:26.787488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e96e73bf-3adb-4e43-a5a5-f80db38954c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:26.798390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e73bf-3adb-4e43-a5a5-f80db38954c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:26.800084 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e73bf-3adb-4e43-a5a5-f80db38954c2 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:26.809340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1195/2352] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:28:26.814480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a318f6-b782-4cde-b704-88b751b4b7e7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:26.820155 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e82545-0d18-4160-9d1e-b68c1267bf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:26.821049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82545-0d18-4160-9d1e-b68c1267bf53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:26.821382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82545-0d18-4160-9d1e-b68c1267bf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:26.821665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82545-0d18-4160-9d1e-b68c1267bf53 admin admin] PATH_INFO: `/v3/users/6a40713ec2da455c9e43d34f0cdebdf3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:26.822895 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e82545-0d18-4160-9d1e-b68c1267bf53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a40713ec2da455c9e43d34f0cdebdf3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:26.825434 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e82545-0d18-4160-9d1e-b68c1267bf53 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:27.114065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b4e82545-0d18-4160-9d1e-b68c1267bf53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a40713ec2da455c9e43d34f0cdebdf3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:27.115973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:27.127580 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b4e82545-0d18-4160-9d1e-b68c1267bf53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a40713ec2da455c9e43d34f0cdebdf3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:27.128375 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b4e82545-0d18-4160-9d1e-b68c1267bf53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a40713ec2da455c9e43d34f0cdebdf3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:27.236854 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b4e82545-0d18-4160-9d1e-b68c1267bf53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a40713ec2da455c9e43d34f0cdebdf3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:27.237686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b4e82545-0d18-4160-9d1e-b68c1267bf53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a40713ec2da455c9e43d34f0cdebdf3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:27.263054 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1158/2353] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:28:26 2022] DELETE /identity/v3/users/6a40713ec2da455c9e43d34f0cdebdf3 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:28:27.744408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e73bf-3adb-4e43-a5a5-f80db38954c2 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:27.744408 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e96e73bf-3adb-4e43-a5a5-f80db38954c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:27.798517 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:27.821925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e73bf-3adb-4e43-a5a5-f80db38954c2 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:27.892532 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb82543-cd4f-49bd-b693-361bb0c4a2cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784d36c16d343cc961a22d956ee30f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:27.894221 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb82543-cd4f-49bd-b693-361bb0c4a2cd service placement] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:27.894611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb82543-cd4f-49bd-b693-361bb0c4a2cd service placement] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:27.895278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb82543-cd4f-49bd-b693-361bb0c4a2cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:27.897693 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fdb82543-cd4f-49bd-b693-361bb0c4a2cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:27.910598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb82543-cd4f-49bd-b693-361bb0c4a2cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:27.912729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb82543-cd4f-49bd-b693-361bb0c4a2cd service placement] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:27.925633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1196/2354] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:27.980194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e82545-0d18-4160-9d1e-b68c1267bf53 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:27.981977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b4e82545-0d18-4160-9d1e-b68c1267bf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:28.037212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b4414-de26-475f-bfb5-27817d20cae6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:28.037212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b4414-de26-475f-bfb5-27817d20cae6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:28.037212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b4414-de26-475f-bfb5-27817d20cae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:28.068100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e52b4414-de26-475f-bfb5-27817d20cae6 None None] MFA Rules not processed for user `3af2be9c1e9a4f0c8f4bdaa04769756c`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:28.070367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e52b4414-de26-475f-bfb5-27817d20cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:28.098543 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e82545-0d18-4160-9d1e-b68c1267bf53 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:28.103196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05460539-f77f-4380-a7f6-cc1537dac45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:28.104099 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05460539-f77f-4380-a7f6-cc1537dac45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:28.104386 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05460539-f77f-4380-a7f6-cc1537dac45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:28.104663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05460539-f77f-4380-a7f6-cc1537dac45b admin admin] PATH_INFO: `/v3/projects/887ebb6ffad84a0fa9c65f890c0eef70` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:28.106421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05460539-f77f-4380-a7f6-cc1537dac45b admin admin] RBAC: Authorizing `identity:delete_project(project_id=887ebb6ffad84a0fa9c65f890c0eef70)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:28.108448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05460539-f77f-4380-a7f6-cc1537dac45b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:28.134634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1197/2355] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:28.229401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-05460539-f77f-4380-a7f6-cc1537dac45b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '887ebb6ffad84a0fa9c65f890c0eef70', 'request_id': 'req-05460539-f77f-4380-a7f6-cc1537dac45b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.303784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-05460539-f77f-4380-a7f6-cc1537dac45b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '887ebb6ffad84a0fa9c65f890c0eef70', 'request_id': 'req-05460539-f77f-4380-a7f6-cc1537dac45b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.312511 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-05460539-f77f-4380-a7f6-cc1537dac45b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '887ebb6ffad84a0fa9c65f890c0eef70', 'request_id': 'req-05460539-f77f-4380-a7f6-cc1537dac45b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.324879 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-05460539-f77f-4380-a7f6-cc1537dac45b admin admin] The token cache is being invalidate because project 887ebb6ffad84a0fa9c65f890c0eef70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:28:28.325176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-05460539-f77f-4380-a7f6-cc1537dac45b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.325835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-05460539-f77f-4380-a7f6-cc1537dac45b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.327643 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1159/2356] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:28:27 2022] DELETE /identity/v3/projects/887ebb6ffad84a0fa9c65f890c0eef70 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:28.332612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2e104-ac94-41c5-a84f-8fd19cc6d24e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:28.332986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2e104-ac94-41c5-a84f-8fd19cc6d24e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:28.333338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2e104-ac94-41c5-a84f-8fd19cc6d24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:28.359894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-54a2e104-ac94-41c5-a84f-8fd19cc6d24e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:28.361297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-54a2e104-ac94-41c5-a84f-8fd19cc6d24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:28.430723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1198/2357] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:28.439946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74aae67-8290-4a78-b0fe-f2e1a1635fb8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:28.440955 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74aae67-8290-4a78-b0fe-f2e1a1635fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:28.441251 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74aae67-8290-4a78-b0fe-f2e1a1635fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:28.461676 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f74aae67-8290-4a78-b0fe-f2e1a1635fb8 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:28.462902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f74aae67-8290-4a78-b0fe-f2e1a1635fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:28.471921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1160/2358] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:28.476335 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2e104-ac94-41c5-a84f-8fd19cc6d24e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:28.486871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2e104-ac94-41c5-a84f-8fd19cc6d24e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:28.491624 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c382cc4-71fb-4f13-8dd0-91cdf3119cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:28.492621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c382cc4-71fb-4f13-8dd0-91cdf3119cba admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:28.492911 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c382cc4-71fb-4f13-8dd0-91cdf3119cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:28.493190 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c382cc4-71fb-4f13-8dd0-91cdf3119cba admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:28.493920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c382cc4-71fb-4f13-8dd0-91cdf3119cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:28:28.494230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c382cc4-71fb-4f13-8dd0-91cdf3119cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:28.495838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c382cc4-71fb-4f13-8dd0-91cdf3119cba admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:28.511180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1199/2359] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:28:28.512907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74aae67-8290-4a78-b0fe-f2e1a1635fb8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:28.523202 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74aae67-8290-4a78-b0fe-f2e1a1635fb8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:28.528561 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e159e-56cb-4e98-98bd-34cd39882c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:28.529402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e159e-56cb-4e98-98bd-34cd39882c3d admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:28.529669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e159e-56cb-4e98-98bd-34cd39882c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:28.529940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e159e-56cb-4e98-98bd-34cd39882c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:28.530633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e159e-56cb-4e98-98bd-34cd39882c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:28.532618 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e159e-56cb-4e98-98bd-34cd39882c3d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:28.681233 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1161/2360] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:28:28 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:28:28.686124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c382cc4-71fb-4f13-8dd0-91cdf3119cba admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:28.707711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c382cc4-71fb-4f13-8dd0-91cdf3119cba admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:28.727695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:28.776643 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0c9f2-b1b8-44db-9809-6e2baf637e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:28.777280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0c9f2-b1b8-44db-9809-6e2baf637e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:28.777535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0c9f2-b1b8-44db-9809-6e2baf637e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:28.777838 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0c9f2-b1b8-44db-9809-6e2baf637e26 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:28.778526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0c9f2-b1b8-44db-9809-6e2baf637e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:28.780468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0c9f2-b1b8-44db-9809-6e2baf637e26 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:28.905066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1200/2361] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:28:28 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:28:28.909395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e159e-56cb-4e98-98bd-34cd39882c3d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:28.920413 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e159e-56cb-4e98-98bd-34cd39882c3d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:28.925057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f206af-b765-4b34-88f7-5c5e3d5bedf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:28.926122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f206af-b765-4b34-88f7-5c5e3d5bedf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:28.927117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f206af-b765-4b34-88f7-5c5e3d5bedf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:28.927117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f206af-b765-4b34-88f7-5c5e3d5bedf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:28.927316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f206af-b765-4b34-88f7-5c5e3d5bedf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:28.928925 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f206af-b765-4b34-88f7-5c5e3d5bedf6 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:28.941457 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1162/2362] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:28:28.945429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0c9f2-b1b8-44db-9809-6e2baf637e26 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:28.958430 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0c9f2-b1b8-44db-9809-6e2baf637e26 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:28.966535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433e55f-740d-48e5-9494-7122ada9f874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:28.973222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433e55f-740d-48e5-9494-7122ada9f874 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:28.973222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433e55f-740d-48e5-9494-7122ada9f874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:28.973222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433e55f-740d-48e5-9494-7122ada9f874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:28.973222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433e55f-740d-48e5-9494-7122ada9f874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:28.973222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433e55f-740d-48e5-9494-7122ada9f874 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:28.981914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1201/2363] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:28:28.986168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f206af-b765-4b34-88f7-5c5e3d5bedf6 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:29.007806 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f206af-b765-4b34-88f7-5c5e3d5bedf6 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:29.012793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306b6a2-4f0e-4476-a9ca-ce66eaf88c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:29.013690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306b6a2-4f0e-4476-a9ca-ce66eaf88c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:29.014016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306b6a2-4f0e-4476-a9ca-ce66eaf88c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:29.014392 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306b6a2-4f0e-4476-a9ca-ce66eaf88c76 admin admin] PATH_INFO: `/v3/projects/bdc7634593194817a527072af8f4f6c4/users/56881c9c910144cd91c1ae2f99a70635/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:29.050532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306b6a2-4f0e-4476-a9ca-ce66eaf88c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc7634593194817a527072af8f4f6c4, user_id=56881c9c910144cd91c1ae2f99a70635, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:29.054354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306b6a2-4f0e-4476-a9ca-ce66eaf88c76 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:29.058931 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:29.117692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1163/2364] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:28:28 2022] PUT /identity/v3/projects/bdc7634593194817a527072af8f4f6c4/users/56881c9c910144cd91c1ae2f99a70635/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:29.134830 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b654eac-bd84-458d-bd76-fc9bd5f02380 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:29.135136 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b654eac-bd84-458d-bd76-fc9bd5f02380 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:29.135382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b654eac-bd84-458d-bd76-fc9bd5f02380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:29.166232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0b654eac-bd84-458d-bd76-fc9bd5f02380 None None] MFA Rules not processed for user `56881c9c910144cd91c1ae2f99a70635`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:29.167951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0b654eac-bd84-458d-bd76-fc9bd5f02380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:29.249958 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1202/2365] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:28:29.254428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306b6a2-4f0e-4476-a9ca-ce66eaf88c76 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:29.317718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306b6a2-4f0e-4476-a9ca-ce66eaf88c76 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:29.322566 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd6b0c-e179-4c0a-911a-e0c9eb1ff095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:29.323228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd6b0c-e179-4c0a-911a-e0c9eb1ff095 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:29.323516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd6b0c-e179-4c0a-911a-e0c9eb1ff095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:29.323794 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd6b0c-e179-4c0a-911a-e0c9eb1ff095 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:29.325095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd6b0c-e179-4c0a-911a-e0c9eb1ff095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:29.326997 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd6b0c-e179-4c0a-911a-e0c9eb1ff095 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:29.442071 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1164/2366] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:28:29 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:28:29.446077 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b654eac-bd84-458d-bd76-fc9bd5f02380 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:29.458856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b654eac-bd84-458d-bd76-fc9bd5f02380 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:29.524288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb77ec-b4b4-4903-872b-75ea1258fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:29.524962 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb77ec-b4b4-4903-872b-75ea1258fb79 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:29.525301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb77ec-b4b4-4903-872b-75ea1258fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:29.525519 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb77ec-b4b4-4903-872b-75ea1258fb79 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:29.526466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb77ec-b4b4-4903-872b-75ea1258fb79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:29.529008 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb77ec-b4b4-4903-872b-75ea1258fb79 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:29.627814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1203/2367] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:28:29 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:28:29.628962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd6b0c-e179-4c0a-911a-e0c9eb1ff095 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:29.643324 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd6b0c-e179-4c0a-911a-e0c9eb1ff095 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:29.648501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6468b-f2a7-4698-a143-3e6def83c8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:29.649204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6468b-f2a7-4698-a143-3e6def83c8cb admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:29.649489 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6468b-f2a7-4698-a143-3e6def83c8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:29.649892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6468b-f2a7-4698-a143-3e6def83c8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:29.650634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6468b-f2a7-4698-a143-3e6def83c8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:29.652262 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6468b-f2a7-4698-a143-3e6def83c8cb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:29.673173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1165/2368] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:28:29.674232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb77ec-b4b4-4903-872b-75ea1258fb79 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:29.690414 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb77ec-b4b4-4903-872b-75ea1258fb79 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:29.700960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c0307-ea19-4299-88fe-5e3c77764f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:29.701890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c0307-ea19-4299-88fe-5e3c77764f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:29.702177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c0307-ea19-4299-88fe-5e3c77764f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:29.702766 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c0307-ea19-4299-88fe-5e3c77764f7c admin admin] PATH_INFO: `/v3/projects/207a8b350f2b4f389d9308019a4b6c95/users/bc387e25b5c44930918cf8c508303b1f/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:29.706581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:29.732573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c0307-ea19-4299-88fe-5e3c77764f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=207a8b350f2b4f389d9308019a4b6c95, user_id=bc387e25b5c44930918cf8c508303b1f, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:29.740637 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c0307-ea19-4299-88fe-5e3c77764f7c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:29.813108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1204/2369] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:28:29 2022] PUT /identity/v3/projects/207a8b350f2b4f389d9308019a4b6c95/users/bc387e25b5c44930918cf8c508303b1f/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:28:29.817290 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6468b-f2a7-4698-a143-3e6def83c8cb admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:29.829174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6468b-f2a7-4698-a143-3e6def83c8cb admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:29.886350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07d55c-a575-4ea0-a459-f73bef5bc4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:29.887001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07d55c-a575-4ea0-a459-f73bef5bc4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:29.887848 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07d55c-a575-4ea0-a459-f73bef5bc4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:29.888163 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07d55c-a575-4ea0-a459-f73bef5bc4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:29.888889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07d55c-a575-4ea0-a459-f73bef5bc4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:29.890483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07d55c-a575-4ea0-a459-f73bef5bc4d0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:29.900175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1166/2370] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:28:29.904441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c0307-ea19-4299-88fe-5e3c77764f7c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:29.914873 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c0307-ea19-4299-88fe-5e3c77764f7c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:29.919699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a8005-ef1a-4344-9e86-5c74ef6d9df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:29.920617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a8005-ef1a-4344-9e86-5c74ef6d9df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:29.920905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a8005-ef1a-4344-9e86-5c74ef6d9df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:29.921182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a8005-ef1a-4344-9e86-5c74ef6d9df0 admin admin] PATH_INFO: `/v3/projects/207a8b350f2b4f389d9308019a4b6c95/users/bc387e25b5c44930918cf8c508303b1f/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:29.923226 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a8005-ef1a-4344-9e86-5c74ef6d9df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207a8b350f2b4f389d9308019a4b6c95, user_id=bc387e25b5c44930918cf8c508303b1f, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:29.925890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a8005-ef1a-4344-9e86-5c74ef6d9df0 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:29.936878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1205/2371] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:28:29 2022] PUT /identity/v3/projects/207a8b350f2b4f389d9308019a4b6c95/users/bc387e25b5c44930918cf8c508303b1f/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:29.959134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539cf29-e816-47d6-b07c-5e38649b8308 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:29.959963 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539cf29-e816-47d6-b07c-5e38649b8308 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:29.959963 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539cf29-e816-47d6-b07c-5e38649b8308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:29.986505 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7539cf29-e816-47d6-b07c-5e38649b8308 None None] MFA Rules not processed for user `bc387e25b5c44930918cf8c508303b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:29.987744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7539cf29-e816-47d6-b07c-5e38649b8308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:30.042697 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:30.063381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1167/2372] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:30.077129 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a8005-ef1a-4344-9e86-5c74ef6d9df0 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:30.079110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a97a8005-ef1a-4344-9e86-5c74ef6d9df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:30.146885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a8005-ef1a-4344-9e86-5c74ef6d9df0 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:30.151806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254e0fc-e6d4-4b2b-9700-6752bd4d5798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:30.152226 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254e0fc-e6d4-4b2b-9700-6752bd4d5798 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:30.152530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254e0fc-e6d4-4b2b-9700-6752bd4d5798 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:30.152880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254e0fc-e6d4-4b2b-9700-6752bd4d5798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:30.164463 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254e0fc-e6d4-4b2b-9700-6752bd4d5798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:30.165931 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254e0fc-e6d4-4b2b-9700-6752bd4d5798 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:30.177029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1206/2373] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:30.960615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68fb0f-724c-4f7b-803e-5fe7fb4f3f25 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:30.961318 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68fb0f-724c-4f7b-803e-5fe7fb4f3f25 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:30.961949 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68fb0f-724c-4f7b-803e-5fe7fb4f3f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:30.991503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7d68fb0f-724c-4f7b-803e-5fe7fb4f3f25 None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:30.993501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7d68fb0f-724c-4f7b-803e-5fe7fb4f3f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:31.063787 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1168/2374] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:28:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:31.079832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254e0fc-e6d4-4b2b-9700-6752bd4d5798 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:31.081253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b254e0fc-e6d4-4b2b-9700-6752bd4d5798 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:31.169535 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254e0fc-e6d4-4b2b-9700-6752bd4d5798 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:31.176334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8a85d-c146-4abb-bb50-c85574409a3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:31.180031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8a85d-c146-4abb-bb50-c85574409a3f service swift] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:31.182899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8a85d-c146-4abb-bb50-c85574409a3f service swift] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:31.182899 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8a85d-c146-4abb-bb50-c85574409a3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:31.212086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8a85d-c146-4abb-bb50-c85574409a3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:31.212086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8a85d-c146-4abb-bb50-c85574409a3f service swift] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:31.237196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1207/2375] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:28:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:28:31.380568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68fb0f-724c-4f7b-803e-5fe7fb4f3f25 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:31.486097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68fb0f-724c-4f7b-803e-5fe7fb4f3f25 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:31.490555 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55592e9e-219f-4d07-9626-63aeadca8418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:31.491421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55592e9e-219f-4d07-9626-63aeadca8418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:31.491703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55592e9e-219f-4d07-9626-63aeadca8418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:31.491978 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55592e9e-219f-4d07-9626-63aeadca8418 admin admin] PATH_INFO: `/v3/users/56881c9c910144cd91c1ae2f99a70635` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:31.493195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55592e9e-219f-4d07-9626-63aeadca8418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56881c9c910144cd91c1ae2f99a70635)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:31.495168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55592e9e-219f-4d07-9626-63aeadca8418 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:31.638299 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-55592e9e-219f-4d07-9626-63aeadca8418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56881c9c910144cd91c1ae2f99a70635'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:31.655903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-55592e9e-219f-4d07-9626-63aeadca8418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56881c9c910144cd91c1ae2f99a70635'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:31.656558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-55592e9e-219f-4d07-9626-63aeadca8418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56881c9c910144cd91c1ae2f99a70635'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:31.732673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-55592e9e-219f-4d07-9626-63aeadca8418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56881c9c910144cd91c1ae2f99a70635'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:31.733163 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-55592e9e-219f-4d07-9626-63aeadca8418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56881c9c910144cd91c1ae2f99a70635'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:31.746071 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1169/2376] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:28:31 2022] DELETE /identity/v3/users/56881c9c910144cd91c1ae2f99a70635 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:31.751469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abf89-b128-44df-8af1-375f96b68831 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:31.751761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abf89-b128-44df-8af1-375f96b68831 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:31.752092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abf89-b128-44df-8af1-375f96b68831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:31.769106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a87abf89-b128-44df-8af1-375f96b68831 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:31.770306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a87abf89-b128-44df-8af1-375f96b68831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:31.828599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1208/2377] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:31.838300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55592e9e-219f-4d07-9626-63aeadca8418 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:31.839710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-55592e9e-219f-4d07-9626-63aeadca8418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:31.854020 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:31.898900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55592e9e-219f-4d07-9626-63aeadca8418 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:31.903215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1bb06-b7af-43e8-9527-f5da03e68fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:31.903851 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1bb06-b7af-43e8-9527-f5da03e68fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:31.904175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1bb06-b7af-43e8-9527-f5da03e68fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:31.904448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1bb06-b7af-43e8-9527-f5da03e68fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:31.913453 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1bb06-b7af-43e8-9527-f5da03e68fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:31.914878 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1bb06-b7af-43e8-9527-f5da03e68fb4 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:31.924376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1170/2378] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:28:32.393335 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87abf89-b128-44df-8af1-375f96b68831 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:32.395199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a87abf89-b128-44df-8af1-375f96b68831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:32.406158 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:32.410222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87abf89-b128-44df-8af1-375f96b68831 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:32.416597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:32.417738 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:32.418254 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:32.418545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] PATH_INFO: `/v3/projects/bdc7634593194817a527072af8f4f6c4` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:32.420078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc7634593194817a527072af8f4f6c4)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:32.422036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:32.556933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc7634593194817a527072af8f4f6c4', 'request_id': 'req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:32.628396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc7634593194817a527072af8f4f6c4', 'request_id': 'req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:32.634758 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc7634593194817a527072af8f4f6c4', 'request_id': 'req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:32.645794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] The token cache is being invalidate because project bdc7634593194817a527072af8f4f6c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:28:32.646089 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:32.646773 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:32.648361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1209/2379] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:28:32 2022] DELETE /identity/v3/projects/bdc7634593194817a527072af8f4f6c4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:32.652333 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1bb06-b7af-43e8-9527-f5da03e68fb4 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:32.662125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1bb06-b7af-43e8-9527-f5da03e68fb4 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:32.717961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c2c75-1677-468c-8c15-6505f56fb44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:32.718823 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2c75-1677-468c-8c15-6505f56fb44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:32.719107 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2c75-1677-468c-8c15-6505f56fb44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:32.719387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2c75-1677-468c-8c15-6505f56fb44f admin admin] PATH_INFO: `/v3/users/bc387e25b5c44930918cf8c508303b1f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:32.720604 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c2c75-1677-468c-8c15-6505f56fb44f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc387e25b5c44930918cf8c508303b1f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:32.722553 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c2c75-1677-468c-8c15-6505f56fb44f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:32.907746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4f0c2c75-1677-468c-8c15-6505f56fb44f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc387e25b5c44930918cf8c508303b1f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:32.924453 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4f0c2c75-1677-468c-8c15-6505f56fb44f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc387e25b5c44930918cf8c508303b1f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:32.925660 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4f0c2c75-1677-468c-8c15-6505f56fb44f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc387e25b5c44930918cf8c508303b1f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:32.989282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4f0c2c75-1677-468c-8c15-6505f56fb44f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc387e25b5c44930918cf8c508303b1f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:32.989932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4f0c2c75-1677-468c-8c15-6505f56fb44f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc387e25b5c44930918cf8c508303b1f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:33.004021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1171/2380] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:28:32 2022] DELETE /identity/v3/users/bc387e25b5c44930918cf8c508303b1f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:33.476806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:33.479079 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:33.503941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1748ea-a8f0-43c6-9cb5-d3ec03b32885 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:33.612230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe59f3-022e-4627-ae09-d6f557fd311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:33.613206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe59f3-022e-4627-ae09-d6f557fd311f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:33.613496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe59f3-022e-4627-ae09-d6f557fd311f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:33.613848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe59f3-022e-4627-ae09-d6f557fd311f admin admin] PATH_INFO: `/v3/projects/207a8b350f2b4f389d9308019a4b6c95` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:33.615125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe59f3-022e-4627-ae09-d6f557fd311f admin admin] RBAC: Authorizing `identity:delete_project(project_id=207a8b350f2b4f389d9308019a4b6c95)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:33.617758 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe59f3-022e-4627-ae09-d6f557fd311f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:33.746871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7afe59f3-022e-4627-ae09-d6f557fd311f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207a8b350f2b4f389d9308019a4b6c95', 'request_id': 'req-7afe59f3-022e-4627-ae09-d6f557fd311f'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:33.857733 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7afe59f3-022e-4627-ae09-d6f557fd311f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207a8b350f2b4f389d9308019a4b6c95', 'request_id': 'req-7afe59f3-022e-4627-ae09-d6f557fd311f'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:33.865697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7afe59f3-022e-4627-ae09-d6f557fd311f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207a8b350f2b4f389d9308019a4b6c95', 'request_id': 'req-7afe59f3-022e-4627-ae09-d6f557fd311f'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:33.881669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7afe59f3-022e-4627-ae09-d6f557fd311f admin admin] The token cache is being invalidate because project 207a8b350f2b4f389d9308019a4b6c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:28:33.882107 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7afe59f3-022e-4627-ae09-d6f557fd311f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:33.882901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7afe59f3-022e-4627-ae09-d6f557fd311f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:33.884979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1210/2381] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:28:33 2022] DELETE /identity/v3/projects/207a8b350f2b4f389d9308019a4b6c95 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:33.890554 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aba6d-3b5a-44e8-99d3-c096e35aa1e2 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:33.891200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aba6d-3b5a-44e8-99d3-c096e35aa1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:33.891200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aba6d-3b5a-44e8-99d3-c096e35aa1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:33.910192 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-de5aba6d-3b5a-44e8-99d3-c096e35aa1e2 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:33.911416 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-de5aba6d-3b5a-44e8-99d3-c096e35aa1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:33.945565 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:33.986766 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1172/2382] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:33.987550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b620b-dddd-416b-9b24-9a9cd7e98ac4 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:33.987848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b620b-dddd-416b-9b24-9a9cd7e98ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:33.988205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b620b-dddd-416b-9b24-9a9cd7e98ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:34.008759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-575b620b-dddd-416b-9b24-9a9cd7e98ac4 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:34.010005 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-575b620b-dddd-416b-9b24-9a9cd7e98ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:34.018304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1211/2383] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:34.022781 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5aba6d-3b5a-44e8-99d3-c096e35aa1e2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:34.035193 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5aba6d-3b5a-44e8-99d3-c096e35aa1e2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:34.044943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56aafc-d61e-4976-9125-22e401199372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:34.045825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56aafc-d61e-4976-9125-22e401199372 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:34.046278 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56aafc-d61e-4976-9125-22e401199372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:34.046568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56aafc-d61e-4976-9125-22e401199372 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:34.047361 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56aafc-d61e-4976-9125-22e401199372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:28:34.047695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56aafc-d61e-4976-9125-22e401199372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:34.049476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56aafc-d61e-4976-9125-22e401199372 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:34.063338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1173/2384] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:28:34.067233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b620b-dddd-416b-9b24-9a9cd7e98ac4 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:34.076715 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b620b-dddd-416b-9b24-9a9cd7e98ac4 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:34.081739 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c832bf-cfbe-4039-b9ed-adf55e9ec86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:34.082401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c832bf-cfbe-4039-b9ed-adf55e9ec86f admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:34.082705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c832bf-cfbe-4039-b9ed-adf55e9ec86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:34.082969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c832bf-cfbe-4039-b9ed-adf55e9ec86f admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:34.083970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c832bf-cfbe-4039-b9ed-adf55e9ec86f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:34.085944 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c832bf-cfbe-4039-b9ed-adf55e9ec86f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:34.094840 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:34.190475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1212/2385] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:28:34 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:28:34.191610 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56aafc-d61e-4976-9125-22e401199372 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:34.202522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56aafc-d61e-4976-9125-22e401199372 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:34.267677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc5367-40d6-4f7a-9b96-e3c6fde2d060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:34.268307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc5367-40d6-4f7a-9b96-e3c6fde2d060 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:34.268589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc5367-40d6-4f7a-9b96-e3c6fde2d060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:34.268862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc5367-40d6-4f7a-9b96-e3c6fde2d060 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:34.269569 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc5367-40d6-4f7a-9b96-e3c6fde2d060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:34.271502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc5367-40d6-4f7a-9b96-e3c6fde2d060 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:34.330167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1174/2386] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:28:34 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:28:34.333797 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c832bf-cfbe-4039-b9ed-adf55e9ec86f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:34.346135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c832bf-cfbe-4039-b9ed-adf55e9ec86f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:34.351041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c4830-19e4-4ff5-862f-e93bad80bc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:34.351720 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c4830-19e4-4ff5-862f-e93bad80bc48 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:34.352139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c4830-19e4-4ff5-862f-e93bad80bc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:34.352316 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c4830-19e4-4ff5-862f-e93bad80bc48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:34.353105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c4830-19e4-4ff5-862f-e93bad80bc48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:34.354756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c4830-19e4-4ff5-862f-e93bad80bc48 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:34.365875 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1213/2387] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:28:34.370146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc5367-40d6-4f7a-9b96-e3c6fde2d060 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:34.381142 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc5367-40d6-4f7a-9b96-e3c6fde2d060 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:34.386265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa7f77-b8fc-483a-8ea6-f726abf19c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:34.387018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa7f77-b8fc-483a-8ea6-f726abf19c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:34.387301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa7f77-b8fc-483a-8ea6-f726abf19c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:34.387801 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa7f77-b8fc-483a-8ea6-f726abf19c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:34.388722 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa7f77-b8fc-483a-8ea6-f726abf19c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:34.390550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa7f77-b8fc-483a-8ea6-f726abf19c68 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:34.407113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1175/2388] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:28:34.408503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c4830-19e4-4ff5-862f-e93bad80bc48 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:34.420888 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c4830-19e4-4ff5-862f-e93bad80bc48 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:34.426736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad806e03-e4f1-4be2-aae7-94a7c3e4467b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:34.427784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad806e03-e4f1-4be2-aae7-94a7c3e4467b admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:34.428118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad806e03-e4f1-4be2-aae7-94a7c3e4467b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:34.428470 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad806e03-e4f1-4be2-aae7-94a7c3e4467b admin admin] PATH_INFO: `/v3/projects/24ed1838333245688f7084977bdd8a43/users/4d10d1188881432b8ff1da492fa8c99d/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:34.444143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad806e03-e4f1-4be2-aae7-94a7c3e4467b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ed1838333245688f7084977bdd8a43, user_id=4d10d1188881432b8ff1da492fa8c99d, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:34.446816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad806e03-e4f1-4be2-aae7-94a7c3e4467b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:34.525675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1214/2389] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:28:34 2022] PUT /identity/v3/projects/24ed1838333245688f7084977bdd8a43/users/4d10d1188881432b8ff1da492fa8c99d/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:34.536108 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573db45-7e01-4430-b467-f81b6ed541a4 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:34.536403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573db45-7e01-4430-b467-f81b6ed541a4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:34.536683 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573db45-7e01-4430-b467-f81b6ed541a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:34.568394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f573db45-7e01-4430-b467-f81b6ed541a4 None None] MFA Rules not processed for user `4d10d1188881432b8ff1da492fa8c99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:34.569757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f573db45-7e01-4430-b467-f81b6ed541a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:34.659076 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1176/2390] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:34.671703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad806e03-e4f1-4be2-aae7-94a7c3e4467b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:34.673479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ad806e03-e4f1-4be2-aae7-94a7c3e4467b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:34.755567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad806e03-e4f1-4be2-aae7-94a7c3e4467b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:34.759749 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445964b1-1058-4964-8150-ffd369afa43b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:34.760443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445964b1-1058-4964-8150-ffd369afa43b service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:34.760726 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445964b1-1058-4964-8150-ffd369afa43b service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:34.760998 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445964b1-1058-4964-8150-ffd369afa43b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:34.781263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445964b1-1058-4964-8150-ffd369afa43b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:34.783799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445964b1-1058-4964-8150-ffd369afa43b service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:34.802859 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1215/2391] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:34.827019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573db45-7e01-4430-b467-f81b6ed541a4 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:34.876709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:34.915300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573db45-7e01-4430-b467-f81b6ed541a4 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:34.921581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fafe9-002f-47c8-bccb-05f051319a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:34.922694 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fafe9-002f-47c8-bccb-05f051319a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:34.923077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fafe9-002f-47c8-bccb-05f051319a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:34.923455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fafe9-002f-47c8-bccb-05f051319a4f admin admin] PATH_INFO: `/v3/users/4d10d1188881432b8ff1da492fa8c99d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:34.925204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fafe9-002f-47c8-bccb-05f051319a4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d10d1188881432b8ff1da492fa8c99d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:34.927632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fafe9-002f-47c8-bccb-05f051319a4f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:35.221018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-783fafe9-002f-47c8-bccb-05f051319a4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d10d1188881432b8ff1da492fa8c99d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:35.240243 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-783fafe9-002f-47c8-bccb-05f051319a4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d10d1188881432b8ff1da492fa8c99d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:35.240949 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-783fafe9-002f-47c8-bccb-05f051319a4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d10d1188881432b8ff1da492fa8c99d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:35.760506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-783fafe9-002f-47c8-bccb-05f051319a4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d10d1188881432b8ff1da492fa8c99d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:35.761456 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-783fafe9-002f-47c8-bccb-05f051319a4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d10d1188881432b8ff1da492fa8c99d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:35.778676 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1177/2392] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:28:34 2022] DELETE /identity/v3/users/4d10d1188881432b8ff1da492fa8c99d => generated 0 bytes in 952 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:35.788595 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bd2f6-b256-4d7c-8e43-a95774ac4c94 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:35.789206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bd2f6-b256-4d7c-8e43-a95774ac4c94 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:35.789206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bd2f6-b256-4d7c-8e43-a95774ac4c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:35.827064 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-512bd2f6-b256-4d7c-8e43-a95774ac4c94 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:35.827064 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-512bd2f6-b256-4d7c-8e43-a95774ac4c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:35.909707 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1216/2393] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:28:35.920673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fafe9-002f-47c8-bccb-05f051319a4f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:35.922225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-783fafe9-002f-47c8-bccb-05f051319a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:36.012911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fafe9-002f-47c8-bccb-05f051319a4f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:36.017093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a75e66-e6b9-4e32-bdaa-d7fac4af0945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:36.017897 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75e66-e6b9-4e32-bdaa-d7fac4af0945 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:36.018214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75e66-e6b9-4e32-bdaa-d7fac4af0945 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:36.018509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75e66-e6b9-4e32-bdaa-d7fac4af0945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:36.038415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a75e66-e6b9-4e32-bdaa-d7fac4af0945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:36.040354 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a75e66-e6b9-4e32-bdaa-d7fac4af0945 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:36.065696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1178/2394] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:36.556583 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bd2f6-b256-4d7c-8e43-a95774ac4c94 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:36.558231 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-512bd2f6-b256-4d7c-8e43-a95774ac4c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:36.575151 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bd2f6-b256-4d7c-8e43-a95774ac4c94 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:36.587940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689a70d-1bc7-49af-994e-65e386b81879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:36.588887 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689a70d-1bc7-49af-994e-65e386b81879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:36.589138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689a70d-1bc7-49af-994e-65e386b81879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:36.589478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689a70d-1bc7-49af-994e-65e386b81879 admin admin] PATH_INFO: `/v3/projects/24ed1838333245688f7084977bdd8a43` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:36.590671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689a70d-1bc7-49af-994e-65e386b81879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ed1838333245688f7084977bdd8a43)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:36.592650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689a70d-1bc7-49af-994e-65e386b81879 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:36.692882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9689a70d-1bc7-49af-994e-65e386b81879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ed1838333245688f7084977bdd8a43', 'request_id': 'req-9689a70d-1bc7-49af-994e-65e386b81879'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:36.695416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:36.778009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9689a70d-1bc7-49af-994e-65e386b81879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ed1838333245688f7084977bdd8a43', 'request_id': 'req-9689a70d-1bc7-49af-994e-65e386b81879'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:36.783812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9689a70d-1bc7-49af-994e-65e386b81879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ed1838333245688f7084977bdd8a43', 'request_id': 'req-9689a70d-1bc7-49af-994e-65e386b81879'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:36.797193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9689a70d-1bc7-49af-994e-65e386b81879 admin admin] The token cache is being invalidate because project 24ed1838333245688f7084977bdd8a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:28:36.797878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9689a70d-1bc7-49af-994e-65e386b81879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:36.798356 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9689a70d-1bc7-49af-994e-65e386b81879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:36.800634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1217/2395] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:28:36 2022] DELETE /identity/v3/projects/24ed1838333245688f7084977bdd8a43 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:36.806134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5314684-e463-4697-bc21-2141978cb183 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:36.806472 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5314684-e463-4697-bc21-2141978cb183 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:36.806758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5314684-e463-4697-bc21-2141978cb183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:36.836095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d5314684-e463-4697-bc21-2141978cb183 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:36.837415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d5314684-e463-4697-bc21-2141978cb183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:36.936146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:36.945415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1179/2396] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:36.953785 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6d966-ceea-4501-90ce-555f4fb6b2ea None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:36.954170 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6d966-ceea-4501-90ce-555f4fb6b2ea None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:36.954528 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6d966-ceea-4501-90ce-555f4fb6b2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:36.984520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-55c6d966-ceea-4501-90ce-555f4fb6b2ea None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:36.985841 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-55c6d966-ceea-4501-90ce-555f4fb6b2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:36.994102 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1218/2397] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:36.998431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5314684-e463-4697-bc21-2141978cb183 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:37.008538 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5314684-e463-4697-bc21-2141978cb183 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:37.013949 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a0c9d-8918-49cf-81fd-77ef7bb5cc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:37.014620 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0c9d-8918-49cf-81fd-77ef7bb5cc8a admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:37.014959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0c9d-8918-49cf-81fd-77ef7bb5cc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:37.015188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0c9d-8918-49cf-81fd-77ef7bb5cc8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:37.015968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a0c9d-8918-49cf-81fd-77ef7bb5cc8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:28:37.017978 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a0c9d-8918-49cf-81fd-77ef7bb5cc8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:37.020077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a0c9d-8918-49cf-81fd-77ef7bb5cc8a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:37.036633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1180/2398] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:28:37.037902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6d966-ceea-4501-90ce-555f4fb6b2ea None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:37.060326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6d966-ceea-4501-90ce-555f4fb6b2ea None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:37.069192 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c985a68-910b-4dbc-97df-7fe2f239ab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:37.069974 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985a68-910b-4dbc-97df-7fe2f239ab42 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:37.070333 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985a68-910b-4dbc-97df-7fe2f239ab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:37.070689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985a68-910b-4dbc-97df-7fe2f239ab42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:37.071532 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c985a68-910b-4dbc-97df-7fe2f239ab42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:37.073583 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c985a68-910b-4dbc-97df-7fe2f239ab42 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:37.196943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1219/2399] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:28:37 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:28:37.203788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a0c9d-8918-49cf-81fd-77ef7bb5cc8a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:37.215513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a0c9d-8918-49cf-81fd-77ef7bb5cc8a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:37.286546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc067f-2da0-4071-91cf-1658c18a9380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:37.287335 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc067f-2da0-4071-91cf-1658c18a9380 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:37.287726 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc067f-2da0-4071-91cf-1658c18a9380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:37.288080 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc067f-2da0-4071-91cf-1658c18a9380 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:37.288849 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc067f-2da0-4071-91cf-1658c18a9380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:37.290903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc067f-2da0-4071-91cf-1658c18a9380 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:37.384380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1181/2400] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:28:37 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:28:37.391551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c985a68-910b-4dbc-97df-7fe2f239ab42 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:37.405970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c985a68-910b-4dbc-97df-7fe2f239ab42 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:37.411188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbd0e6-eafc-4972-9acf-2144337848ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:37.412130 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbd0e6-eafc-4972-9acf-2144337848ca admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:37.412514 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbd0e6-eafc-4972-9acf-2144337848ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:37.412868 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbd0e6-eafc-4972-9acf-2144337848ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:37.413976 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbd0e6-eafc-4972-9acf-2144337848ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:37.416360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbd0e6-eafc-4972-9acf-2144337848ca admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:37.435060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1220/2401] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:28:37.438132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc067f-2da0-4071-91cf-1658c18a9380 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:37.449874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc067f-2da0-4071-91cf-1658c18a9380 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:37.455731 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfda6ac-3bb2-4fb5-beb0-715dc7a156f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:37.456440 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfda6ac-3bb2-4fb5-beb0-715dc7a156f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:37.456724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfda6ac-3bb2-4fb5-beb0-715dc7a156f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:37.456999 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfda6ac-3bb2-4fb5-beb0-715dc7a156f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:37.458011 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfda6ac-3bb2-4fb5-beb0-715dc7a156f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:37.459965 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfda6ac-3bb2-4fb5-beb0-715dc7a156f7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:37.474863 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1182/2402] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:28:37.479060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbd0e6-eafc-4972-9acf-2144337848ca admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:37.489807 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbd0e6-eafc-4972-9acf-2144337848ca admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:37.494669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285c9c1-ee1f-4b0d-8df7-91950ee1e4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:37.495869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285c9c1-ee1f-4b0d-8df7-91950ee1e4ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:37.496315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285c9c1-ee1f-4b0d-8df7-91950ee1e4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:37.496602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285c9c1-ee1f-4b0d-8df7-91950ee1e4ee admin admin] PATH_INFO: `/v3/projects/e85389affb8e4e2c88cd9750b88ff166/users/d9257af1ec1b438e8e81a92837cdc90b/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:37.513450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285c9c1-ee1f-4b0d-8df7-91950ee1e4ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85389affb8e4e2c88cd9750b88ff166, user_id=d9257af1ec1b438e8e81a92837cdc90b, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:37.516157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285c9c1-ee1f-4b0d-8df7-91950ee1e4ee admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:37.584442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1221/2403] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:28:37 2022] PUT /identity/v3/projects/e85389affb8e4e2c88cd9750b88ff166/users/d9257af1ec1b438e8e81a92837cdc90b/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:28:37.596404 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32012ad8-e8bc-490e-acf6-3755c6675584 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:37.596793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32012ad8-e8bc-490e-acf6-3755c6675584 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:37.597148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32012ad8-e8bc-490e-acf6-3755c6675584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:37.632194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-32012ad8-e8bc-490e-acf6-3755c6675584 None None] MFA Rules not processed for user `d9257af1ec1b438e8e81a92837cdc90b`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:37.633500 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-32012ad8-e8bc-490e-acf6-3755c6675584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:37.705624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1183/2404] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:28:37.717663 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285c9c1-ee1f-4b0d-8df7-91950ee1e4ee admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:37.719520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e285c9c1-ee1f-4b0d-8df7-91950ee1e4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:37.781720 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285c9c1-ee1f-4b0d-8df7-91950ee1e4ee admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:37.786531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8644843-3a85-465b-b87e-c18db04fe57f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:37.788705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8644843-3a85-465b-b87e-c18db04fe57f service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:37.788705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8644843-3a85-465b-b87e-c18db04fe57f service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:37.788705 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8644843-3a85-465b-b87e-c18db04fe57f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:37.797971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8644843-3a85-465b-b87e-c18db04fe57f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:37.799597 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8644843-3a85-465b-b87e-c18db04fe57f service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:37.810623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1222/2405] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:28:40.037791 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32012ad8-e8bc-490e-acf6-3755c6675584 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:40.039255 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-32012ad8-e8bc-490e-acf6-3755c6675584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:40.157838 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:40.212875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32012ad8-e8bc-490e-acf6-3755c6675584 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:40.238788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ecf25-a672-447f-aa16-a9c090720ce2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:40.239618 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ecf25-a672-447f-aa16-a9c090720ce2 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:40.240027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ecf25-a672-447f-aa16-a9c090720ce2 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:40.240493 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ecf25-a672-447f-aa16-a9c090720ce2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:40.251270 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f67ecf25-a672-447f-aa16-a9c090720ce2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:40.280603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ecf25-a672-447f-aa16-a9c090720ce2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:40.282238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ecf25-a672-447f-aa16-a9c090720ce2 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:40.305167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1184/2406] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:45.489545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8644843-3a85-465b-b87e-c18db04fe57f service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:45.504086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8644843-3a85-465b-b87e-c18db04fe57f service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:45.510814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79905c5-07aa-4e7a-aae9-4a061589e7d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:45.511695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79905c5-07aa-4e7a-aae9-4a061589e7d7 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:45.512222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79905c5-07aa-4e7a-aae9-4a061589e7d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:45.512648 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79905c5-07aa-4e7a-aae9-4a061589e7d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:45.514736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f79905c5-07aa-4e7a-aae9-4a061589e7d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:45.528370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79905c5-07aa-4e7a-aae9-4a061589e7d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:45.530092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79905c5-07aa-4e7a-aae9-4a061589e7d7 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:45.540907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1223/2407] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:46.562085 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ecf25-a672-447f-aa16-a9c090720ce2 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:46.627789 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ecf25-a672-447f-aa16-a9c090720ce2 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:46.632674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb9ec2-5657-42db-9005-54cd85692c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:46.633563 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb9ec2-5657-42db-9005-54cd85692c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:46.633904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb9ec2-5657-42db-9005-54cd85692c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:46.634187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb9ec2-5657-42db-9005-54cd85692c6e admin admin] PATH_INFO: `/v3/users/d9257af1ec1b438e8e81a92837cdc90b` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:46.635940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb9ec2-5657-42db-9005-54cd85692c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9257af1ec1b438e8e81a92837cdc90b)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:46.637989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb9ec2-5657-42db-9005-54cd85692c6e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:46.887427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2fcb9ec2-5657-42db-9005-54cd85692c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9257af1ec1b438e8e81a92837cdc90b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:46.899531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2fcb9ec2-5657-42db-9005-54cd85692c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9257af1ec1b438e8e81a92837cdc90b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:46.900397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2fcb9ec2-5657-42db-9005-54cd85692c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9257af1ec1b438e8e81a92837cdc90b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:46.967115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2fcb9ec2-5657-42db-9005-54cd85692c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9257af1ec1b438e8e81a92837cdc90b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:46.967599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2fcb9ec2-5657-42db-9005-54cd85692c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9257af1ec1b438e8e81a92837cdc90b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:46.985532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1185/2408] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:28:46 2022] DELETE /identity/v3/users/d9257af1ec1b438e8e81a92837cdc90b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:46.987967 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729899d-e35a-4b00-b773-bacd6c142486 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:46.988459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729899d-e35a-4b00-b773-bacd6c142486 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:46.988568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729899d-e35a-4b00-b773-bacd6c142486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:47.006453 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2729899d-e35a-4b00-b773-bacd6c142486 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:47.007598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2729899d-e35a-4b00-b773-bacd6c142486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:47.070721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1224/2409] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:47.080635 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb9ec2-5657-42db-9005-54cd85692c6e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:47.082106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2fcb9ec2-5657-42db-9005-54cd85692c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:47.140273 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb9ec2-5657-42db-9005-54cd85692c6e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:47.146133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b37f8c-8de5-4d61-9d60-62b4328bc6a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:47.146133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b37f8c-8de5-4d61-9d60-62b4328bc6a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:47.146133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b37f8c-8de5-4d61-9d60-62b4328bc6a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:47.146133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b37f8c-8de5-4d61-9d60-62b4328bc6a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:47.153620 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:47.156204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b37f8c-8de5-4d61-9d60-62b4328bc6a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:47.157653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b37f8c-8de5-4d61-9d60-62b4328bc6a0 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:47.170336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1186/2410] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:28:47.653280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729899d-e35a-4b00-b773-bacd6c142486 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:47.657243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2729899d-e35a-4b00-b773-bacd6c142486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:47.668940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729899d-e35a-4b00-b773-bacd6c142486 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:47.673933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b9346-4f32-4e1a-85dd-831a8c37a0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:47.675021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b9346-4f32-4e1a-85dd-831a8c37a0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:47.675598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b9346-4f32-4e1a-85dd-831a8c37a0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:47.676114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b9346-4f32-4e1a-85dd-831a8c37a0fd admin admin] PATH_INFO: `/v3/projects/e85389affb8e4e2c88cd9750b88ff166` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:47.678130 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b9346-4f32-4e1a-85dd-831a8c37a0fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85389affb8e4e2c88cd9750b88ff166)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:47.680236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b9346-4f32-4e1a-85dd-831a8c37a0fd admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:47.681793 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:47.793165 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-619b9346-4f32-4e1a-85dd-831a8c37a0fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85389affb8e4e2c88cd9750b88ff166', 'request_id': 'req-619b9346-4f32-4e1a-85dd-831a8c37a0fd'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:47.879773 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-619b9346-4f32-4e1a-85dd-831a8c37a0fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85389affb8e4e2c88cd9750b88ff166', 'request_id': 'req-619b9346-4f32-4e1a-85dd-831a8c37a0fd'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:47.886820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-619b9346-4f32-4e1a-85dd-831a8c37a0fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85389affb8e4e2c88cd9750b88ff166', 'request_id': 'req-619b9346-4f32-4e1a-85dd-831a8c37a0fd'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:47.899431 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-619b9346-4f32-4e1a-85dd-831a8c37a0fd admin admin] The token cache is being invalidate because project e85389affb8e4e2c88cd9750b88ff166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:28:47.899718 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-619b9346-4f32-4e1a-85dd-831a8c37a0fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:47.900402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-619b9346-4f32-4e1a-85dd-831a8c37a0fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:47.902812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1225/2411] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:28:47 2022] DELETE /identity/v3/projects/e85389affb8e4e2c88cd9750b88ff166 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:47.907765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc539cc-a01f-4a2f-83c4-f5874e525116 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:47.908320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc539cc-a01f-4a2f-83c4-f5874e525116 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:47.914567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc539cc-a01f-4a2f-83c4-f5874e525116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:47.926583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3fc539cc-a01f-4a2f-83c4-f5874e525116 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:47.927892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3fc539cc-a01f-4a2f-83c4-f5874e525116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:48.003627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1187/2412] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:48.011909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f72fa-4600-4859-80f6-4f1511eea679 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:48.012466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f72fa-4600-4859-80f6-4f1511eea679 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:48.013328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f72fa-4600-4859-80f6-4f1511eea679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:48.034613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-703f72fa-4600-4859-80f6-4f1511eea679 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:48.035919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-703f72fa-4600-4859-80f6-4f1511eea679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:48.045067 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1226/2413] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:48.049752 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc539cc-a01f-4a2f-83c4-f5874e525116 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:48.065980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc539cc-a01f-4a2f-83c4-f5874e525116 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:48.070989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c4dc0-7c6f-409c-b289-4fd6437786cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:48.071663 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c4dc0-7c6f-409c-b289-4fd6437786cf admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:48.071948 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c4dc0-7c6f-409c-b289-4fd6437786cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:48.072252 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c4dc0-7c6f-409c-b289-4fd6437786cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:48.073559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c4dc0-7c6f-409c-b289-4fd6437786cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:28:48.073866 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c4dc0-7c6f-409c-b289-4fd6437786cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:48.075781 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c4dc0-7c6f-409c-b289-4fd6437786cf admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:48.088635 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1188/2414] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:28:48.093117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f72fa-4600-4859-80f6-4f1511eea679 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:48.102636 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f72fa-4600-4859-80f6-4f1511eea679 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:48.107418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd585114-d030-4c26-a401-eefe54ac8122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:48.108112 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd585114-d030-4c26-a401-eefe54ac8122 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:48.108398 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd585114-d030-4c26-a401-eefe54ac8122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:48.108673 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd585114-d030-4c26-a401-eefe54ac8122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:48.109493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd585114-d030-4c26-a401-eefe54ac8122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:48.111397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd585114-d030-4c26-a401-eefe54ac8122 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:48.237050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1227/2415] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:28:48 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:28:48.241633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c4dc0-7c6f-409c-b289-4fd6437786cf admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:48.255382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c4dc0-7c6f-409c-b289-4fd6437786cf admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:48.329384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa257f-f5c6-41be-9640-bdaf8d9f200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:48.329384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa257f-f5c6-41be-9640-bdaf8d9f200a admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:48.329384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa257f-f5c6-41be-9640-bdaf8d9f200a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:48.329384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa257f-f5c6-41be-9640-bdaf8d9f200a admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:48.330031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa257f-f5c6-41be-9640-bdaf8d9f200a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:48.330031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa257f-f5c6-41be-9640-bdaf8d9f200a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:48.417271 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1189/2416] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:28:48 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:28:48.426818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd585114-d030-4c26-a401-eefe54ac8122 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:48.437913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd585114-d030-4c26-a401-eefe54ac8122 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:48.442658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e886a2-32f9-4529-92a0-c8b820df6d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:48.443320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e886a2-32f9-4529-92a0-c8b820df6d76 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:48.443776 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e886a2-32f9-4529-92a0-c8b820df6d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:48.444097 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e886a2-32f9-4529-92a0-c8b820df6d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:48.444807 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e886a2-32f9-4529-92a0-c8b820df6d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:48.446392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e886a2-32f9-4529-92a0-c8b820df6d76 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:48.456676 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1228/2417] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:28:48.460727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa257f-f5c6-41be-9640-bdaf8d9f200a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:48.470979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa257f-f5c6-41be-9640-bdaf8d9f200a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:48.475713 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5852b6b-ade0-4e60-906b-581bc0d7b909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:48.476411 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5852b6b-ade0-4e60-906b-581bc0d7b909 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:48.476690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5852b6b-ade0-4e60-906b-581bc0d7b909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:48.476965 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5852b6b-ade0-4e60-906b-581bc0d7b909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:48.477695 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5852b6b-ade0-4e60-906b-581bc0d7b909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:48.479945 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5852b6b-ade0-4e60-906b-581bc0d7b909 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:48.490031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1190/2418] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:28:48.494177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e886a2-32f9-4529-92a0-c8b820df6d76 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:48.504680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e886a2-32f9-4529-92a0-c8b820df6d76 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:48.509366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80cae7-a50c-4459-ac13-79c5441929ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:48.510380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80cae7-a50c-4459-ac13-79c5441929ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:48.510728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80cae7-a50c-4459-ac13-79c5441929ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:48.511072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80cae7-a50c-4459-ac13-79c5441929ec admin admin] PATH_INFO: `/v3/projects/dd8067c5854a4234b06609f4e36ef8e0/users/4e14f6900cb540f687298b09c8fd5f57/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:48.533134 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80cae7-a50c-4459-ac13-79c5441929ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8067c5854a4234b06609f4e36ef8e0, user_id=4e14f6900cb540f687298b09c8fd5f57, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:48.535806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80cae7-a50c-4459-ac13-79c5441929ec admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:48.651430 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1229/2419] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:28:48 2022] PUT /identity/v3/projects/dd8067c5854a4234b06609f4e36ef8e0/users/4e14f6900cb540f687298b09c8fd5f57/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:28:48.662939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616f734-46ff-4e44-80ba-239adba7e8fd None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:48.663230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616f734-46ff-4e44-80ba-239adba7e8fd None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:48.663509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616f734-46ff-4e44-80ba-239adba7e8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:48.699217 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d616f734-46ff-4e44-80ba-239adba7e8fd None None] MFA Rules not processed for user `4e14f6900cb540f687298b09c8fd5f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:48.700785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d616f734-46ff-4e44-80ba-239adba7e8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:48.789967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:48.812382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1191/2420] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:48.830320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80cae7-a50c-4459-ac13-79c5441929ec admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:48.832041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6e80cae7-a50c-4459-ac13-79c5441929ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:48.890945 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80cae7-a50c-4459-ac13-79c5441929ec admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:48.895438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ad5d7-b9ae-4df9-b60d-ef6f6761a986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:48.896185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ad5d7-b9ae-4df9-b60d-ef6f6761a986 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:48.896474 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ad5d7-b9ae-4df9-b60d-ef6f6761a986 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:48.896751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ad5d7-b9ae-4df9-b60d-ef6f6761a986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:48.907582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ad5d7-b9ae-4df9-b60d-ef6f6761a986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:48.909104 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ad5d7-b9ae-4df9-b60d-ef6f6761a986 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:48.919065 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1230/2421] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:49.839952 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d2120-340c-4dc8-8e91-f2cc765d7e44 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:49.840809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d2120-340c-4dc8-8e91-f2cc765d7e44 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:49.841248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d2120-340c-4dc8-8e91-f2cc765d7e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:49.860451 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a57d2120-340c-4dc8-8e91-f2cc765d7e44 None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:49.866216 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a57d2120-340c-4dc8-8e91-f2cc765d7e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:49.948620 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1192/2422] 10.222.0.74 () {58 vars in 967 bytes} [Thu Jul 14 10:28:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:49.958697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ad5d7-b9ae-4df9-b60d-ef6f6761a986 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:49.960188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d13ad5d7-b9ae-4df9-b60d-ef6f6761a986 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:50.007823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:50.040214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ad5d7-b9ae-4df9-b60d-ef6f6761a986 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:50.045876 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07523cb3-a3ba-44a8-a28d-b68efd2fd4d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:50.046530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523cb3-a3ba-44a8-a28d-b68efd2fd4d2 service swift] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:50.046813 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523cb3-a3ba-44a8-a28d-b68efd2fd4d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:50.047096 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523cb3-a3ba-44a8-a28d-b68efd2fd4d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:50.055550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07523cb3-a3ba-44a8-a28d-b68efd2fd4d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:50.057802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07523cb3-a3ba-44a8-a28d-b68efd2fd4d2 service swift] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:50.066406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1231/2423] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:28:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:28:51.515188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d2120-340c-4dc8-8e91-f2cc765d7e44 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:51.516696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a57d2120-340c-4dc8-8e91-f2cc765d7e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:51.580791 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d2120-340c-4dc8-8e91-f2cc765d7e44 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:51.584528 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1376d-ffdd-4ee2-bf23-79500b997267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:51.585184 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1376d-ffdd-4ee2-bf23-79500b997267 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:51.585473 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1376d-ffdd-4ee2-bf23-79500b997267 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:51.585750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1376d-ffdd-4ee2-bf23-79500b997267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:51.588830 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b9d1376d-ffdd-4ee2-bf23-79500b997267 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:51.631788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dda29-8837-4b9f-a48e-f314aaef75d6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:51.632397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dda29-8837-4b9f-a48e-f314aaef75d6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:51.632397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dda29-8837-4b9f-a48e-f314aaef75d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:51.653927 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-507dda29-8837-4b9f-a48e-f314aaef75d6 None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:51.655222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-507dda29-8837-4b9f-a48e-f314aaef75d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:51.663301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1232/2424] 10.222.0.74 () {58 vars in 967 bytes} [Thu Jul 14 10:28:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:28:51.675375 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1376d-ffdd-4ee2-bf23-79500b997267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:51.677041 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1376d-ffdd-4ee2-bf23-79500b997267 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:51.679567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dda29-8837-4b9f-a48e-f314aaef75d6 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:51.688215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1193/2425] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:51.694508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dda29-8837-4b9f-a48e-f314aaef75d6 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:51.702281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddf515-396e-426e-b1c3-4743bb2fe4ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:51.703122 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddf515-396e-426e-b1c3-4743bb2fe4ff service swift] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:51.703473 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddf515-396e-426e-b1c3-4743bb2fe4ff service swift] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:51.703982 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddf515-396e-426e-b1c3-4743bb2fe4ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:51.713757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddf515-396e-426e-b1c3-4743bb2fe4ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:51.715704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddf515-396e-426e-b1c3-4743bb2fe4ff service swift] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:51.724615 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1233/2426] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:28:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:28:57.199094 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1376d-ffdd-4ee2-bf23-79500b997267 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:57.201209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b9d1376d-ffdd-4ee2-bf23-79500b997267 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:57.214531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1376d-ffdd-4ee2-bf23-79500b997267 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:57.219848 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b9ae7-3d2f-42d5-8db7-f35df236a396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:57.220947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b9ae7-3d2f-42d5-8db7-f35df236a396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:57.221387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b9ae7-3d2f-42d5-8db7-f35df236a396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:57.221814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b9ae7-3d2f-42d5-8db7-f35df236a396 admin admin] PATH_INFO: `/v3/users/35057047c93946a7a1ff01bd649abd9c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:57.226170 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b9ae7-3d2f-42d5-8db7-f35df236a396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35057047c93946a7a1ff01bd649abd9c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:57.226170 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b9ae7-3d2f-42d5-8db7-f35df236a396 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:57.456868 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:57.462862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-fa1b9ae7-3d2f-42d5-8db7-f35df236a396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35057047c93946a7a1ff01bd649abd9c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:57.476492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-fa1b9ae7-3d2f-42d5-8db7-f35df236a396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35057047c93946a7a1ff01bd649abd9c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:57.477305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-fa1b9ae7-3d2f-42d5-8db7-f35df236a396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35057047c93946a7a1ff01bd649abd9c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:57.558581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-fa1b9ae7-3d2f-42d5-8db7-f35df236a396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35057047c93946a7a1ff01bd649abd9c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:57.559229 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-fa1b9ae7-3d2f-42d5-8db7-f35df236a396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35057047c93946a7a1ff01bd649abd9c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:57.574418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1194/2427] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:28:57 2022] DELETE /identity/v3/users/35057047c93946a7a1ff01bd649abd9c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:57.837944 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddf515-396e-426e-b1c3-4743bb2fe4ff service swift] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:57.857384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddf515-396e-426e-b1c3-4743bb2fe4ff service swift] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:57.924346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc03387-20e7-4ce1-83f3-1d409eda9850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:57.925128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc03387-20e7-4ce1-83f3-1d409eda9850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:57.925412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc03387-20e7-4ce1-83f3-1d409eda9850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:57.925688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc03387-20e7-4ce1-83f3-1d409eda9850 admin admin] PATH_INFO: `/v3/projects/d6357076e00c4064a61a14fdb6b84aa1` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:57.927135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc03387-20e7-4ce1-83f3-1d409eda9850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6357076e00c4064a61a14fdb6b84aa1)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:57.929233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc03387-20e7-4ce1-83f3-1d409eda9850 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:58.052307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6cc03387-20e7-4ce1-83f3-1d409eda9850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6357076e00c4064a61a14fdb6b84aa1', 'request_id': 'req-6cc03387-20e7-4ce1-83f3-1d409eda9850'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:58.146791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6cc03387-20e7-4ce1-83f3-1d409eda9850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6357076e00c4064a61a14fdb6b84aa1', 'request_id': 'req-6cc03387-20e7-4ce1-83f3-1d409eda9850'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:58.154291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6cc03387-20e7-4ce1-83f3-1d409eda9850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6357076e00c4064a61a14fdb6b84aa1', 'request_id': 'req-6cc03387-20e7-4ce1-83f3-1d409eda9850'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:58.168871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6cc03387-20e7-4ce1-83f3-1d409eda9850 admin admin] The token cache is being invalidate because project d6357076e00c4064a61a14fdb6b84aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:28:58.169165 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6cc03387-20e7-4ce1-83f3-1d409eda9850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:58.169918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6cc03387-20e7-4ce1-83f3-1d409eda9850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:58.171660 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1234/2428] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:28:57 2022] DELETE /identity/v3/projects/d6357076e00c4064a61a14fdb6b84aa1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:58.177135 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cd8ae-ee8b-4106-9090-26acd029c17f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:58.177726 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cd8ae-ee8b-4106-9090-26acd029c17f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:58.178002 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cd8ae-ee8b-4106-9090-26acd029c17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:58.195968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-403cd8ae-ee8b-4106-9090-26acd029c17f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:58.197890 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-403cd8ae-ee8b-4106-9090-26acd029c17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:58.258391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1195/2429] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:28:58.267444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d0850-54ce-4b06-b95a-3178b55b4ba3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:58.267820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d0850-54ce-4b06-b95a-3178b55b4ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:58.268226 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d0850-54ce-4b06-b95a-3178b55b4ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:58.287084 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-352d0850-54ce-4b06-b95a-3178b55b4ba3 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:58.288384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-352d0850-54ce-4b06-b95a-3178b55b4ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:58.296550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1235/2430] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:58.300875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cd8ae-ee8b-4106-9090-26acd029c17f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:58.310743 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cd8ae-ee8b-4106-9090-26acd029c17f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:58.330168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28bfe7-6fb8-4177-8e26-8fe04c4833c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:58.330168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28bfe7-6fb8-4177-8e26-8fe04c4833c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:58.330168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28bfe7-6fb8-4177-8e26-8fe04c4833c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:58.330168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28bfe7-6fb8-4177-8e26-8fe04c4833c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:58.330540 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28bfe7-6fb8-4177-8e26-8fe04c4833c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:28:58.330540 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28bfe7-6fb8-4177-8e26-8fe04c4833c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:58.330540 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28bfe7-6fb8-4177-8e26-8fe04c4833c9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:58.334139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1196/2431] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:28:58.339074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d0850-54ce-4b06-b95a-3178b55b4ba3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:58.352677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d0850-54ce-4b06-b95a-3178b55b4ba3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:58.355987 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448940a4-7cbd-4a94-97bf-82c9fbdc75e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:58.367847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448940a4-7cbd-4a94-97bf-82c9fbdc75e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:58.367847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448940a4-7cbd-4a94-97bf-82c9fbdc75e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:58.367847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448940a4-7cbd-4a94-97bf-82c9fbdc75e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:58.367847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448940a4-7cbd-4a94-97bf-82c9fbdc75e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:58.367847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448940a4-7cbd-4a94-97bf-82c9fbdc75e6 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:58.429410 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:58.437902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1236/2432] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:28:58 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:28:58.442037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28bfe7-6fb8-4177-8e26-8fe04c4833c9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:58.452915 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28bfe7-6fb8-4177-8e26-8fe04c4833c9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:58.515226 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dae490-7c03-4113-93bf-adc97dd658ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:58.515900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dae490-7c03-4113-93bf-adc97dd658ab admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:58.516213 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dae490-7c03-4113-93bf-adc97dd658ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:58.516562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dae490-7c03-4113-93bf-adc97dd658ab admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:58.517263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dae490-7c03-4113-93bf-adc97dd658ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:58.519218 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dae490-7c03-4113-93bf-adc97dd658ab admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:58.590063 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1197/2433] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:28:58 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:28:58.594346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448940a4-7cbd-4a94-97bf-82c9fbdc75e6 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:58.608563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448940a4-7cbd-4a94-97bf-82c9fbdc75e6 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:58.613334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5bcb8-0986-439f-95ba-021269bdc395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:58.614013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5bcb8-0986-439f-95ba-021269bdc395 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:58.614326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5bcb8-0986-439f-95ba-021269bdc395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:58.614603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5bcb8-0986-439f-95ba-021269bdc395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:58.615335 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5bcb8-0986-439f-95ba-021269bdc395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:58.616981 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5bcb8-0986-439f-95ba-021269bdc395 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:58.627403 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1237/2434] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:28:58.631303 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dae490-7c03-4113-93bf-adc97dd658ab admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:58.641971 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dae490-7c03-4113-93bf-adc97dd658ab admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:58.646764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823fe0b-0a2c-4451-9fc8-02eafd715384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:58.647647 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823fe0b-0a2c-4451-9fc8-02eafd715384 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:58.647934 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823fe0b-0a2c-4451-9fc8-02eafd715384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:58.648247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823fe0b-0a2c-4451-9fc8-02eafd715384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:58.648980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823fe0b-0a2c-4451-9fc8-02eafd715384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:58.651117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823fe0b-0a2c-4451-9fc8-02eafd715384 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:58.661634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1198/2435] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:28:58.666668 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5bcb8-0986-439f-95ba-021269bdc395 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:58.685875 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5bcb8-0986-439f-95ba-021269bdc395 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:58.692689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef831b-7a63-4c1e-9cbf-e22375c23e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:58.693871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef831b-7a63-4c1e-9cbf-e22375c23e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:58.694152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef831b-7a63-4c1e-9cbf-e22375c23e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:58.694425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef831b-7a63-4c1e-9cbf-e22375c23e17 admin admin] PATH_INFO: `/v3/projects/70c2405d57444083b28ea800b9eb6868/users/e5fee1877c7e4298ab8214e44e251e33/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:58.711428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef831b-7a63-4c1e-9cbf-e22375c23e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c2405d57444083b28ea800b9eb6868, user_id=e5fee1877c7e4298ab8214e44e251e33, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:58.714644 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef831b-7a63-4c1e-9cbf-e22375c23e17 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:58.793442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1238/2436] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:28:58 2022] PUT /identity/v3/projects/70c2405d57444083b28ea800b9eb6868/users/e5fee1877c7e4298ab8214e44e251e33/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:28:58.804075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e6aec-3cbe-49a4-8109-694ed26d1a2c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:58.804357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e6aec-3cbe-49a4-8109-694ed26d1a2c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:58.804632 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e6aec-3cbe-49a4-8109-694ed26d1a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:58.831844 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2c2e6aec-3cbe-49a4-8109-694ed26d1a2c None None] MFA Rules not processed for user `e5fee1877c7e4298ab8214e44e251e33`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:58.833140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2c2e6aec-3cbe-49a4-8109-694ed26d1a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:58.846203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:58.899256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1199/2437] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:28:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:28:58.911395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef831b-7a63-4c1e-9cbf-e22375c23e17 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:58.913264 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-baef831b-7a63-4c1e-9cbf-e22375c23e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:58.985530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef831b-7a63-4c1e-9cbf-e22375c23e17 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:58.991223 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136798a-df69-4527-9700-ba773a02c030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:58.991940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136798a-df69-4527-9700-ba773a02c030 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:58.992224 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136798a-df69-4527-9700-ba773a02c030 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:58.992510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136798a-df69-4527-9700-ba773a02c030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:59.001296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136798a-df69-4527-9700-ba773a02c030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:59.003041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136798a-df69-4527-9700-ba773a02c030 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:59.013079 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1239/2438] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:01.709653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e6aec-3cbe-49a4-8109-694ed26d1a2c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:01.711207 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2c2e6aec-3cbe-49a4-8109-694ed26d1a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:01.783297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e6aec-3cbe-49a4-8109-694ed26d1a2c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:01.788357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a4500-0874-4eaa-9e9d-1a9d2b4c2b6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784d36c16d343cc961a22d956ee30f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:01.789077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a4500-0874-4eaa-9e9d-1a9d2b4c2b6f service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:01.789417 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a4500-0874-4eaa-9e9d-1a9d2b4c2b6f service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:01.789736 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a4500-0874-4eaa-9e9d-1a9d2b4c2b6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:01.792262 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-fc1a4500-0874-4eaa-9e9d-1a9d2b4c2b6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:01.804347 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a4500-0874-4eaa-9e9d-1a9d2b4c2b6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:01.806557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a4500-0874-4eaa-9e9d-1a9d2b4c2b6f service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:01.816895 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1200/2439] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:01.886251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136798a-df69-4527-9700-ba773a02c030 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:01.887753 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6136798a-df69-4527-9700-ba773a02c030 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:01.959709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136798a-df69-4527-9700-ba773a02c030 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:01.964966 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129e68f-2db7-41ad-9b8e-47772ea1880a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:01.965844 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129e68f-2db7-41ad-9b8e-47772ea1880a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:01.966125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129e68f-2db7-41ad-9b8e-47772ea1880a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:01.966399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129e68f-2db7-41ad-9b8e-47772ea1880a admin admin] PATH_INFO: `/v3/users/0d6c9a776e6f4f3ba512a8fe8e9a6cd3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:01.967587 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129e68f-2db7-41ad-9b8e-47772ea1880a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6c9a776e6f4f3ba512a8fe8e9a6cd3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:01.969627 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129e68f-2db7-41ad-9b8e-47772ea1880a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:02.182455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3129e68f-2db7-41ad-9b8e-47772ea1880a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6c9a776e6f4f3ba512a8fe8e9a6cd3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:02.187131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:02.195078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3129e68f-2db7-41ad-9b8e-47772ea1880a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6c9a776e6f4f3ba512a8fe8e9a6cd3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:02.306726 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3129e68f-2db7-41ad-9b8e-47772ea1880a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6c9a776e6f4f3ba512a8fe8e9a6cd3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:02.307355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3129e68f-2db7-41ad-9b8e-47772ea1880a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6c9a776e6f4f3ba512a8fe8e9a6cd3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:02.314494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3129e68f-2db7-41ad-9b8e-47772ea1880a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6c9a776e6f4f3ba512a8fe8e9a6cd3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:02.320593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1240/2440] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:29:01 2022] DELETE /identity/v3/users/0d6c9a776e6f4f3ba512a8fe8e9a6cd3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:02.563494 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a4500-0874-4eaa-9e9d-1a9d2b4c2b6f service placement] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:02.574636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a4500-0874-4eaa-9e9d-1a9d2b4c2b6f service placement] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:02.636749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:02.637620 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:02.637903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:02.638175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] PATH_INFO: `/v3/projects/c8b4ffbbd77f43a08e91ea5062af3b6b` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:02.639386 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b4ffbbd77f43a08e91ea5062af3b6b)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:02.641327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:02.751334 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:02.754220 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b4ffbbd77f43a08e91ea5062af3b6b', 'request_id': 'req-5923351e-e712-44b1-9ad5-3d26d64cd024'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:02.815091 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b4ffbbd77f43a08e91ea5062af3b6b', 'request_id': 'req-5923351e-e712-44b1-9ad5-3d26d64cd024'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:02.821474 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b4ffbbd77f43a08e91ea5062af3b6b', 'request_id': 'req-5923351e-e712-44b1-9ad5-3d26d64cd024'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:02.833118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] The token cache is being invalidate because project c8b4ffbbd77f43a08e91ea5062af3b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:29:02.833401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:02.834080 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:02.835622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1201/2441] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:29:02 2022] DELETE /identity/v3/projects/c8b4ffbbd77f43a08e91ea5062af3b6b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:02.839862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129e68f-2db7-41ad-9b8e-47772ea1880a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:02.841327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3129e68f-2db7-41ad-9b8e-47772ea1880a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:02.855626 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129e68f-2db7-41ad-9b8e-47772ea1880a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:02.911823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ada235-896e-403a-83be-cb61d309fdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:02.912736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ada235-896e-403a-83be-cb61d309fdbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:02.913018 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ada235-896e-403a-83be-cb61d309fdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:02.913291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ada235-896e-403a-83be-cb61d309fdbb admin admin] PATH_INFO: `/v3/users/2b8311bc987444cfab7072584cff292e` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:02.914506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ada235-896e-403a-83be-cb61d309fdbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8311bc987444cfab7072584cff292e)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:02.917035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ada235-896e-403a-83be-cb61d309fdbb admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:03.127420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-57ada235-896e-403a-83be-cb61d309fdbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8311bc987444cfab7072584cff292e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:03.139394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-57ada235-896e-403a-83be-cb61d309fdbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8311bc987444cfab7072584cff292e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:03.208881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-57ada235-896e-403a-83be-cb61d309fdbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8311bc987444cfab7072584cff292e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:03.209508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-57ada235-896e-403a-83be-cb61d309fdbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8311bc987444cfab7072584cff292e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:03.217893 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-57ada235-896e-403a-83be-cb61d309fdbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8311bc987444cfab7072584cff292e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:03.224136 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1241/2442] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:29:02 2022] DELETE /identity/v3/users/2b8311bc987444cfab7072584cff292e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:03.444606 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:03.446567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:03.459871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923351e-e712-44b1-9ad5-3d26d64cd024 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:03.518200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab9efb-eb02-43b4-b112-4e6de9c82109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:03.518981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab9efb-eb02-43b4-b112-4e6de9c82109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:03.519261 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab9efb-eb02-43b4-b112-4e6de9c82109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:03.519532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab9efb-eb02-43b4-b112-4e6de9c82109 admin admin] PATH_INFO: `/v3/projects/faf38a2209ce48b5a4bd78a44040b107` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:03.520748 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab9efb-eb02-43b4-b112-4e6de9c82109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf38a2209ce48b5a4bd78a44040b107)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:03.522645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab9efb-eb02-43b4-b112-4e6de9c82109 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:03.632395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f6ab9efb-eb02-43b4-b112-4e6de9c82109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf38a2209ce48b5a4bd78a44040b107', 'request_id': 'req-f6ab9efb-eb02-43b4-b112-4e6de9c82109'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:03.706053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f6ab9efb-eb02-43b4-b112-4e6de9c82109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf38a2209ce48b5a4bd78a44040b107', 'request_id': 'req-f6ab9efb-eb02-43b4-b112-4e6de9c82109'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:03.720330 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f6ab9efb-eb02-43b4-b112-4e6de9c82109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf38a2209ce48b5a4bd78a44040b107', 'request_id': 'req-f6ab9efb-eb02-43b4-b112-4e6de9c82109'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:03.732686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f6ab9efb-eb02-43b4-b112-4e6de9c82109 admin admin] The token cache is being invalidate because project faf38a2209ce48b5a4bd78a44040b107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:29:03.732983 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f6ab9efb-eb02-43b4-b112-4e6de9c82109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:03.733754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f6ab9efb-eb02-43b4-b112-4e6de9c82109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:03.735357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1202/2443] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:29:03 2022] DELETE /identity/v3/projects/faf38a2209ce48b5a4bd78a44040b107 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:04.473837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ada235-896e-403a-83be-cb61d309fdbb admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:04.475306 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-57ada235-896e-403a-83be-cb61d309fdbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:04.488817 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ada235-896e-403a-83be-cb61d309fdbb admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:04.534178 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:04.546400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cf6df-2a88-44b1-a50c-3579eddced28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:04.547297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cf6df-2a88-44b1-a50c-3579eddced28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:04.547613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cf6df-2a88-44b1-a50c-3579eddced28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:04.547889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cf6df-2a88-44b1-a50c-3579eddced28 admin admin] PATH_INFO: `/v3/users/4e14f6900cb540f687298b09c8fd5f57` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:04.549124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cf6df-2a88-44b1-a50c-3579eddced28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e14f6900cb540f687298b09c8fd5f57)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:04.551060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cf6df-2a88-44b1-a50c-3579eddced28 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:04.702270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3c1cf6df-2a88-44b1-a50c-3579eddced28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e14f6900cb540f687298b09c8fd5f57'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:04.714446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3c1cf6df-2a88-44b1-a50c-3579eddced28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e14f6900cb540f687298b09c8fd5f57'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:04.780098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3c1cf6df-2a88-44b1-a50c-3579eddced28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e14f6900cb540f687298b09c8fd5f57'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:04.780717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3c1cf6df-2a88-44b1-a50c-3579eddced28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e14f6900cb540f687298b09c8fd5f57'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:04.787740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3c1cf6df-2a88-44b1-a50c-3579eddced28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e14f6900cb540f687298b09c8fd5f57'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:04.794346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1242/2444] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:29:04 2022] DELETE /identity/v3/users/4e14f6900cb540f687298b09c8fd5f57 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:04.798936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c2112-1661-452b-99aa-2767536ebd00 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:04.799439 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c2112-1661-452b-99aa-2767536ebd00 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:04.799551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c2112-1661-452b-99aa-2767536ebd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:04.817923 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-270c2112-1661-452b-99aa-2767536ebd00 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:04.819156 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-270c2112-1661-452b-99aa-2767536ebd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:04.884097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1203/2445] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:04.893848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cf6df-2a88-44b1-a50c-3579eddced28 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:04.895228 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3c1cf6df-2a88-44b1-a50c-3579eddced28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:04.952361 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cf6df-2a88-44b1-a50c-3579eddced28 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:04.955938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72ad44-e1ed-4abf-84d5-257f61bdf82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:04.956608 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72ad44-e1ed-4abf-84d5-257f61bdf82b service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:04.956888 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72ad44-e1ed-4abf-84d5-257f61bdf82b service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:04.957159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72ad44-e1ed-4abf-84d5-257f61bdf82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:04.966257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72ad44-e1ed-4abf-84d5-257f61bdf82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:04.967831 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72ad44-e1ed-4abf-84d5-257f61bdf82b service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:04.978072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1243/2446] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:05.110166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c2112-1661-452b-99aa-2767536ebd00 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:05.110166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-270c2112-1661-452b-99aa-2767536ebd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:05.119057 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:05.122966 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c2112-1661-452b-99aa-2767536ebd00 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:05.127884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de702d2-0357-457c-ad97-8943d1fd265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:05.128767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de702d2-0357-457c-ad97-8943d1fd265c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:05.129066 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de702d2-0357-457c-ad97-8943d1fd265c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:05.129334 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de702d2-0357-457c-ad97-8943d1fd265c admin admin] PATH_INFO: `/v3/users/e5fee1877c7e4298ab8214e44e251e33` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:05.130522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de702d2-0357-457c-ad97-8943d1fd265c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5fee1877c7e4298ab8214e44e251e33)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:05.132565 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de702d2-0357-457c-ad97-8943d1fd265c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:05.331058 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7de702d2-0357-457c-ad97-8943d1fd265c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5fee1877c7e4298ab8214e44e251e33'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:05.343268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7de702d2-0357-457c-ad97-8943d1fd265c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5fee1877c7e4298ab8214e44e251e33'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:05.343944 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7de702d2-0357-457c-ad97-8943d1fd265c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5fee1877c7e4298ab8214e44e251e33'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:05.433373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72ad44-e1ed-4abf-84d5-257f61bdf82b service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:05.436289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4f72ad44-e1ed-4abf-84d5-257f61bdf82b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:05.443523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7de702d2-0357-457c-ad97-8943d1fd265c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5fee1877c7e4298ab8214e44e251e33'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:05.444122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7de702d2-0357-457c-ad97-8943d1fd265c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5fee1877c7e4298ab8214e44e251e33'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:05.447697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72ad44-e1ed-4abf-84d5-257f61bdf82b service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:05.454743 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e82da-f6d9-43a3-8532-d6385feb3151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:05.455667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e82da-f6d9-43a3-8532-d6385feb3151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:05.456074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e82da-f6d9-43a3-8532-d6385feb3151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:05.456455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e82da-f6d9-43a3-8532-d6385feb3151 admin admin] PATH_INFO: `/v3/projects/dd8067c5854a4234b06609f4e36ef8e0` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:05.457773 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e82da-f6d9-43a3-8532-d6385feb3151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8067c5854a4234b06609f4e36ef8e0)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:05.457975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1204/2447] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:29:05 2022] DELETE /identity/v3/users/e5fee1877c7e4298ab8214e44e251e33 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:05.460962 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e82da-f6d9-43a3-8532-d6385feb3151 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:05.463669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a9b6-c085-4329-8394-fd6804b4b47b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:05.464023 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a9b6-c085-4329-8394-fd6804b4b47b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:05.464307 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a9b6-c085-4329-8394-fd6804b4b47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:05.481786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a371a9b6-c085-4329-8394-fd6804b4b47b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:05.483004 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a371a9b6-c085-4329-8394-fd6804b4b47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:05.542535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1205/2448] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:05.552203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371a9b6-c085-4329-8394-fd6804b4b47b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:05.553564 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a371a9b6-c085-4329-8394-fd6804b4b47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:05.593929 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-478e82da-f6d9-43a3-8532-d6385feb3151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8067c5854a4234b06609f4e36ef8e0', 'request_id': 'req-478e82da-f6d9-43a3-8532-d6385feb3151'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:05.611249 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371a9b6-c085-4329-8394-fd6804b4b47b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:05.643217 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:05.662472 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85f9ec-003e-4118-a535-4b49694cfc58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:05.663132 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85f9ec-003e-4118-a535-4b49694cfc58 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:05.663401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85f9ec-003e-4118-a535-4b49694cfc58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:05.663674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85f9ec-003e-4118-a535-4b49694cfc58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:05.665742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-478e82da-f6d9-43a3-8532-d6385feb3151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8067c5854a4234b06609f4e36ef8e0', 'request_id': 'req-478e82da-f6d9-43a3-8532-d6385feb3151'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:05.673147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-478e82da-f6d9-43a3-8532-d6385feb3151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8067c5854a4234b06609f4e36ef8e0', 'request_id': 'req-478e82da-f6d9-43a3-8532-d6385feb3151'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:05.680146 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:05.684987 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-478e82da-f6d9-43a3-8532-d6385feb3151 admin admin] The token cache is being invalidate because project dd8067c5854a4234b06609f4e36ef8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:29:05.685276 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-478e82da-f6d9-43a3-8532-d6385feb3151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:05.685925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-478e82da-f6d9-43a3-8532-d6385feb3151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:05.687674 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1244/2449] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:29:05 2022] DELETE /identity/v3/projects/dd8067c5854a4234b06609f4e36ef8e0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:29:05.692536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dc9e2-afa0-405b-90e9-1ddde32364ee None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:05.692830 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dc9e2-afa0-405b-90e9-1ddde32364ee None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:05.693109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dc9e2-afa0-405b-90e9-1ddde32364ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:05.713027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3d2dc9e2-afa0-405b-90e9-1ddde32364ee None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:05.714179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3d2dc9e2-afa0-405b-90e9-1ddde32364ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:05.726383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85f9ec-003e-4118-a535-4b49694cfc58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:05.727879 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85f9ec-003e-4118-a535-4b49694cfc58 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:05.737836 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1206/2450] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:29:05.777632 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1245/2451] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:29:05.785833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa5732-04c4-4ff7-9490-ae32de02e7df None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:05.786501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa5732-04c4-4ff7-9490-ae32de02e7df None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:05.786840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa5732-04c4-4ff7-9490-ae32de02e7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:05.805446 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c7fa5732-04c4-4ff7-9490-ae32de02e7df None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:05.806666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c7fa5732-04c4-4ff7-9490-ae32de02e7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:05.815128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1207/2452] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:29:05.819347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2dc9e2-afa0-405b-90e9-1ddde32364ee None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:05.829818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2dc9e2-afa0-405b-90e9-1ddde32364ee None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:05.834508 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854afefe-65d5-412e-b680-8c01075f461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:05.835246 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854afefe-65d5-412e-b680-8c01075f461a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:05.835588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854afefe-65d5-412e-b680-8c01075f461a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:05.835786 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854afefe-65d5-412e-b680-8c01075f461a admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:05.837188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854afefe-65d5-412e-b680-8c01075f461a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:29:05.837501 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854afefe-65d5-412e-b680-8c01075f461a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:05.839102 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854afefe-65d5-412e-b680-8c01075f461a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:05.850713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1246/2453] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:29:05.855035 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa5732-04c4-4ff7-9490-ae32de02e7df None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:05.864476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa5732-04c4-4ff7-9490-ae32de02e7df None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:05.869936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8d5a5-b900-4e2c-b03b-5a515395c8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:05.870582 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d5a5-b900-4e2c-b03b-5a515395c8bd admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:05.870864 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d5a5-b900-4e2c-b03b-5a515395c8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:05.871168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d5a5-b900-4e2c-b03b-5a515395c8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:05.871860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8d5a5-b900-4e2c-b03b-5a515395c8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:05.873790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8d5a5-b900-4e2c-b03b-5a515395c8bd admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:05.991525 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1208/2454] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:29:05 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:05.993428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854afefe-65d5-412e-b680-8c01075f461a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:06.004972 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854afefe-65d5-412e-b680-8c01075f461a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:06.065261 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47129fb1-b126-4b5f-8007-0b06a1ffce96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:06.066017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47129fb1-b126-4b5f-8007-0b06a1ffce96 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.066320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47129fb1-b126-4b5f-8007-0b06a1ffce96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.066626 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47129fb1-b126-4b5f-8007-0b06a1ffce96 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:06.067301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47129fb1-b126-4b5f-8007-0b06a1ffce96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:06.069331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47129fb1-b126-4b5f-8007-0b06a1ffce96 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:06.163207 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1247/2455] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:29:05 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:06.167441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8d5a5-b900-4e2c-b03b-5a515395c8bd admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:06.177672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8d5a5-b900-4e2c-b03b-5a515395c8bd admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:06.182855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70a4eb-4c0f-4814-ab4a-6d09fb516d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:06.183510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70a4eb-4c0f-4814-ab4a-6d09fb516d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.183794 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70a4eb-4c0f-4814-ab4a-6d09fb516d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.184143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70a4eb-4c0f-4814-ab4a-6d09fb516d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:06.186140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70a4eb-4c0f-4814-ab4a-6d09fb516d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:06.189700 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70a4eb-4c0f-4814-ab4a-6d09fb516d89 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:06.193189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47129fb1-b126-4b5f-8007-0b06a1ffce96 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:06.194780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-47129fb1-b126-4b5f-8007-0b06a1ffce96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:06.202096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1209/2456] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:06.203146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70a4eb-4c0f-4814-ab4a-6d09fb516d89 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:06.211619 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47129fb1-b126-4b5f-8007-0b06a1ffce96 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:06.214569 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70a4eb-4c0f-4814-ab4a-6d09fb516d89 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:06.218167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11602dc9-0fc1-4156-9da1-bb4264647b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:06.220836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11602dc9-0fc1-4156-9da1-bb4264647b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.220836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11602dc9-0fc1-4156-9da1-bb4264647b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.221098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f61c1-c833-4764-a707-eeb786d168fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:06.221329 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11602dc9-0fc1-4156-9da1-bb4264647b71 admin admin] PATH_INFO: `/v3/projects/70c2405d57444083b28ea800b9eb6868` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:06.221426 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f61c1-c833-4764-a707-eeb786d168fe admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.221426 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f61c1-c833-4764-a707-eeb786d168fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.221426 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f61c1-c833-4764-a707-eeb786d168fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:06.221765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f61c1-c833-4764-a707-eeb786d168fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:06.222786 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11602dc9-0fc1-4156-9da1-bb4264647b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c2405d57444083b28ea800b9eb6868)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:06.223507 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f61c1-c833-4764-a707-eeb786d168fe admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:06.225256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11602dc9-0fc1-4156-9da1-bb4264647b71 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:06.235519 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1210/2457] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:29:06.239559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f61c1-c833-4764-a707-eeb786d168fe admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:06.249929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f61c1-c833-4764-a707-eeb786d168fe admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:06.254610 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce022b06-5d92-4d56-adc0-9a112ac857cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:06.255484 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce022b06-5d92-4d56-adc0-9a112ac857cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.255765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce022b06-5d92-4d56-adc0-9a112ac857cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.256074 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce022b06-5d92-4d56-adc0-9a112ac857cb admin admin] PATH_INFO: `/v3/projects/3798c93cad4c478c8dc7f6d02e1d6f4f/users/d48419d5ff5049dc888b0dfbcf371c38/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:06.271407 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce022b06-5d92-4d56-adc0-9a112ac857cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3798c93cad4c478c8dc7f6d02e1d6f4f, user_id=d48419d5ff5049dc888b0dfbcf371c38, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:06.278442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce022b06-5d92-4d56-adc0-9a112ac857cb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:06.340360 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1211/2458] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:06 2022] PUT /identity/v3/projects/3798c93cad4c478c8dc7f6d02e1d6f4f/users/d48419d5ff5049dc888b0dfbcf371c38/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:29:06.351014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d5ff6-cce1-4038-8a60-0fcde30a910f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.351390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d5ff6-cce1-4038-8a60-0fcde30a910f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.351672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d5ff6-cce1-4038-8a60-0fcde30a910f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:06.355353 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-11602dc9-0fc1-4156-9da1-bb4264647b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c2405d57444083b28ea800b9eb6868', 'request_id': 'req-11602dc9-0fc1-4156-9da1-bb4264647b71'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:06.378415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ef3d5ff6-cce1-4038-8a60-0fcde30a910f None None] MFA Rules not processed for user `d48419d5ff5049dc888b0dfbcf371c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:06.379618 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ef3d5ff6-cce1-4038-8a60-0fcde30a910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:06.402644 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-11602dc9-0fc1-4156-9da1-bb4264647b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c2405d57444083b28ea800b9eb6868', 'request_id': 'req-11602dc9-0fc1-4156-9da1-bb4264647b71'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:06.408777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-11602dc9-0fc1-4156-9da1-bb4264647b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c2405d57444083b28ea800b9eb6868', 'request_id': 'req-11602dc9-0fc1-4156-9da1-bb4264647b71'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:06.409888 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:06.421478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-11602dc9-0fc1-4156-9da1-bb4264647b71 admin admin] The token cache is being invalidate because project 70c2405d57444083b28ea800b9eb6868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:29:06.421986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-11602dc9-0fc1-4156-9da1-bb4264647b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:06.422769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-11602dc9-0fc1-4156-9da1-bb4264647b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:06.424574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1248/2459] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:29:06 2022] DELETE /identity/v3/projects/70c2405d57444083b28ea800b9eb6868 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:29:06.431081 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92184f3-c0b0-4a59-ae3e-784b3b0604fb None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.431433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92184f3-c0b0-4a59-ae3e-784b3b0604fb None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.431724 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92184f3-c0b0-4a59-ae3e-784b3b0604fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:06.439785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:06.445316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1212/2460] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:29:06.449088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a92184f3-c0b0-4a59-ae3e-784b3b0604fb None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:06.450312 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a92184f3-c0b0-4a59-ae3e-784b3b0604fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:06.456131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d5ff6-cce1-4038-8a60-0fcde30a910f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:06.457456 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ef3d5ff6-cce1-4038-8a60-0fcde30a910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:06.512326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1249/2461] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:29:06.515741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d5ff6-cce1-4038-8a60-0fcde30a910f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:06.517585 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e62a7-d8b2-4ce3-921a-256b2894f3bd None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.519880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e62a7-d8b2-4ce3-921a-256b2894f3bd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.519880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e62a7-d8b2-4ce3-921a-256b2894f3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:06.520091 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160369ab-d6a8-4fc9-9953-115d24bf2c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:06.520428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160369ab-d6a8-4fc9-9953-115d24bf2c77 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.520714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160369ab-d6a8-4fc9-9953-115d24bf2c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.520993 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160369ab-d6a8-4fc9-9953-115d24bf2c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:06.529865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160369ab-d6a8-4fc9-9953-115d24bf2c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:06.531378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160369ab-d6a8-4fc9-9953-115d24bf2c77 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:06.536415 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-022e62a7-d8b2-4ce3-921a-256b2894f3bd None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:06.537613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-022e62a7-d8b2-4ce3-921a-256b2894f3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:06.541466 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1213/2462] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:29:06.554891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1250/2463] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:29:06.555016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160369ab-d6a8-4fc9-9953-115d24bf2c77 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:06.563799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160369ab-d6a8-4fc9-9953-115d24bf2c77 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:06.568500 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b687d24-5e14-4b09-8da1-8d290060befd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:06.569173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b687d24-5e14-4b09-8da1-8d290060befd admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.569459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b687d24-5e14-4b09-8da1-8d290060befd admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.569737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b687d24-5e14-4b09-8da1-8d290060befd admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:06.570460 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b687d24-5e14-4b09-8da1-8d290060befd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:29:06.570796 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b687d24-5e14-4b09-8da1-8d290060befd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:06.572461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b687d24-5e14-4b09-8da1-8d290060befd admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:06.588158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1214/2464] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:29:06.589618 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e62a7-d8b2-4ce3-921a-256b2894f3bd None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:06.599699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e62a7-d8b2-4ce3-921a-256b2894f3bd None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:06.605717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47a0b3-6e9e-433b-8166-c185768d9346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:06.606400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47a0b3-6e9e-433b-8166-c185768d9346 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.606681 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47a0b3-6e9e-433b-8166-c185768d9346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.606947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47a0b3-6e9e-433b-8166-c185768d9346 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:06.607639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47a0b3-6e9e-433b-8166-c185768d9346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:06.609609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47a0b3-6e9e-433b-8166-c185768d9346 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:06.730944 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1251/2465] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:29:06 2022] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:06.735265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b687d24-5e14-4b09-8da1-8d290060befd admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:06.746075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b687d24-5e14-4b09-8da1-8d290060befd admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:06.802400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04224f08-f117-41a2-b449-5eaf0618a4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:06.802991 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04224f08-f117-41a2-b449-5eaf0618a4be admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.803278 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04224f08-f117-41a2-b449-5eaf0618a4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.803556 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04224f08-f117-41a2-b449-5eaf0618a4be admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:06.804282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04224f08-f117-41a2-b449-5eaf0618a4be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:06.806749 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04224f08-f117-41a2-b449-5eaf0618a4be admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:06.906259 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1215/2466] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:29:06 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:29:06.910422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47a0b3-6e9e-433b-8166-c185768d9346 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:06.920915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47a0b3-6e9e-433b-8166-c185768d9346 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:06.925540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17027b4-6b8b-4f91-94fd-79f7907a6d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:06.926196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17027b4-6b8b-4f91-94fd-79f7907a6d9d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.926485 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17027b4-6b8b-4f91-94fd-79f7907a6d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.926764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17027b4-6b8b-4f91-94fd-79f7907a6d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:06.927496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17027b4-6b8b-4f91-94fd-79f7907a6d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:06.929133 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17027b4-6b8b-4f91-94fd-79f7907a6d9d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:06.940448 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1252/2467] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:06.949259 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04224f08-f117-41a2-b449-5eaf0618a4be admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:06.959579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04224f08-f117-41a2-b449-5eaf0618a4be admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:06.964440 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec213b86-44a7-41b5-86e0-d18f2fa16fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:06.965102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec213b86-44a7-41b5-86e0-d18f2fa16fbc admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.965392 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec213b86-44a7-41b5-86e0-d18f2fa16fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.965672 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec213b86-44a7-41b5-86e0-d18f2fa16fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:06.966401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec213b86-44a7-41b5-86e0-d18f2fa16fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:06.968018 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec213b86-44a7-41b5-86e0-d18f2fa16fbc admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:06.978447 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1216/2468] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:29:06.982577 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17027b4-6b8b-4f91-94fd-79f7907a6d9d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:06.992543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17027b4-6b8b-4f91-94fd-79f7907a6d9d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:06.997801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a3e3b-8e29-4e75-9f5c-c9c3c0a2f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:06.998713 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a3e3b-8e29-4e75-9f5c-c9c3c0a2f579 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:06.998992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a3e3b-8e29-4e75-9f5c-c9c3c0a2f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:06.999263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a3e3b-8e29-4e75-9f5c-c9c3c0a2f579 admin admin] PATH_INFO: `/v3/projects/e90e5ca804cb4db7b304d3815c76838a/users/56dc9cd284d5474aa0ccddc3f60689d9/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:07.013787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a3e3b-8e29-4e75-9f5c-c9c3c0a2f579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90e5ca804cb4db7b304d3815c76838a, user_id=56dc9cd284d5474aa0ccddc3f60689d9, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:07.016427 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a3e3b-8e29-4e75-9f5c-c9c3c0a2f579 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:07.126064 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1253/2469] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:06 2022] PUT /identity/v3/projects/e90e5ca804cb4db7b304d3815c76838a/users/56dc9cd284d5474aa0ccddc3f60689d9/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:07.137791 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df714289-06ca-40a4-9f32-090a59a096fd None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:07.138215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df714289-06ca-40a4-9f32-090a59a096fd None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:07.138363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df714289-06ca-40a4-9f32-090a59a096fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:07.166941 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-df714289-06ca-40a4-9f32-090a59a096fd None None] MFA Rules not processed for user `56dc9cd284d5474aa0ccddc3f60689d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:07.168260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-df714289-06ca-40a4-9f32-090a59a096fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:07.232463 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:07.241331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1217/2470] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:07.246576 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a3e3b-8e29-4e75-9f5c-c9c3c0a2f579 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:07.313924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a3e3b-8e29-4e75-9f5c-c9c3c0a2f579 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:07.318740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5738a4-503e-461a-99cc-13f9f984fa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:07.319403 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5738a4-503e-461a-99cc-13f9f984fa7f admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:07.319689 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5738a4-503e-461a-99cc-13f9f984fa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:07.319962 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5738a4-503e-461a-99cc-13f9f984fa7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:07.320716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5738a4-503e-461a-99cc-13f9f984fa7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:07.322703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5738a4-503e-461a-99cc-13f9f984fa7f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:07.445220 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1254/2471] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:29:07 2022] POST /identity/v3/projects => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:29:07.449732 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df714289-06ca-40a4-9f32-090a59a096fd None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:07.460309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df714289-06ca-40a4-9f32-090a59a096fd None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:07.516368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee9a7f-148c-4f4c-911a-92510bf080e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:07.517044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee9a7f-148c-4f4c-911a-92510bf080e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:07.517332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee9a7f-148c-4f4c-911a-92510bf080e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:07.517614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee9a7f-148c-4f4c-911a-92510bf080e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:07.518300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee9a7f-148c-4f4c-911a-92510bf080e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:07.520277 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee9a7f-148c-4f4c-911a-92510bf080e1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:07.603338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1218/2472] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:29:07 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:07.607542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5738a4-503e-461a-99cc-13f9f984fa7f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:07.618010 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5738a4-503e-461a-99cc-13f9f984fa7f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:07.622826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5acd0d-dde9-4afa-800d-67cfc076141f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:07.623488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5acd0d-dde9-4afa-800d-67cfc076141f admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:07.623770 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5acd0d-dde9-4afa-800d-67cfc076141f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:07.624076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5acd0d-dde9-4afa-800d-67cfc076141f admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:07.625116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5acd0d-dde9-4afa-800d-67cfc076141f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:07.626743 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5acd0d-dde9-4afa-800d-67cfc076141f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:07.637701 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1255/2473] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:07.641977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee9a7f-148c-4f4c-911a-92510bf080e1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:07.652729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee9a7f-148c-4f4c-911a-92510bf080e1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:07.657362 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdf6b0-5095-4f6b-9976-6755e30362f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:07.658238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdf6b0-5095-4f6b-9976-6755e30362f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:07.658523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdf6b0-5095-4f6b-9976-6755e30362f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:07.658825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdf6b0-5095-4f6b-9976-6755e30362f0 admin admin] PATH_INFO: `/v3/projects/232688a97b594d9da47b921e00921eae/users/a2e0af62a8454d9f91b94bffc9b6fb16/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:07.674069 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdf6b0-5095-4f6b-9976-6755e30362f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=232688a97b594d9da47b921e00921eae, user_id=a2e0af62a8454d9f91b94bffc9b6fb16, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:07.676793 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdf6b0-5095-4f6b-9976-6755e30362f0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:07.785883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1219/2474] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:07 2022] PUT /identity/v3/projects/232688a97b594d9da47b921e00921eae/users/a2e0af62a8454d9f91b94bffc9b6fb16/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:29:07.790638 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5acd0d-dde9-4afa-800d-67cfc076141f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:07.797261 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:07.801279 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5acd0d-dde9-4afa-800d-67cfc076141f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:07.857431 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07eb91-e243-471f-9d1b-1bb3edf209b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:07.858033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07eb91-e243-471f-9d1b-1bb3edf209b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:07.858315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07eb91-e243-471f-9d1b-1bb3edf209b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:07.858588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07eb91-e243-471f-9d1b-1bb3edf209b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:07.859302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07eb91-e243-471f-9d1b-1bb3edf209b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:07.860916 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07eb91-e243-471f-9d1b-1bb3edf209b2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:07.870910 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1256/2475] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:07.875152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdf6b0-5095-4f6b-9976-6755e30362f0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:07.885961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdf6b0-5095-4f6b-9976-6755e30362f0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:07.890604 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05b676-9b1e-42dd-880d-8881c6d3060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:07.891478 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05b676-9b1e-42dd-880d-8881c6d3060e admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:07.891764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05b676-9b1e-42dd-880d-8881c6d3060e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:07.892179 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05b676-9b1e-42dd-880d-8881c6d3060e admin admin] PATH_INFO: `/v3/projects/232688a97b594d9da47b921e00921eae/users/a2e0af62a8454d9f91b94bffc9b6fb16/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:07.894179 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05b676-9b1e-42dd-880d-8881c6d3060e admin admin] RBAC: Authorizing `identity:create_grant(project_id=232688a97b594d9da47b921e00921eae, user_id=a2e0af62a8454d9f91b94bffc9b6fb16, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:07.896853 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05b676-9b1e-42dd-880d-8881c6d3060e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:07.907181 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1220/2476] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:07 2022] PUT /identity/v3/projects/232688a97b594d9da47b921e00921eae/users/a2e0af62a8454d9f91b94bffc9b6fb16/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:07.917778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0f57a-5c6b-413e-b1f2-0d23e9025b0d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:07.918069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0f57a-5c6b-413e-b1f2-0d23e9025b0d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:07.918342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0f57a-5c6b-413e-b1f2-0d23e9025b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:07.945691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-45d0f57a-5c6b-413e-b1f2-0d23e9025b0d None None] MFA Rules not processed for user `a2e0af62a8454d9f91b94bffc9b6fb16`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:07.946906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-45d0f57a-5c6b-413e-b1f2-0d23e9025b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:08.015381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1257/2477] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:08.027223 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05b676-9b1e-42dd-880d-8881c6d3060e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:08.083430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05b676-9b1e-42dd-880d-8881c6d3060e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:08.087296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf96c44-a42b-428d-b85e-e8e3cab6ec57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:08.088008 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf96c44-a42b-428d-b85e-e8e3cab6ec57 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:08.088304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf96c44-a42b-428d-b85e-e8e3cab6ec57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:08.088575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf96c44-a42b-428d-b85e-e8e3cab6ec57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:08.097435 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf96c44-a42b-428d-b85e-e8e3cab6ec57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:08.098880 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf96c44-a42b-428d-b85e-e8e3cab6ec57 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:08.108775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1221/2478] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:29:08.310423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748acb6-5f8b-4277-979a-d2f6ed7a1c60 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:08.310725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748acb6-5f8b-4277-979a-d2f6ed7a1c60 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:08.310986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748acb6-5f8b-4277-979a-d2f6ed7a1c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:08.315283 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf96c44-a42b-428d-b85e-e8e3cab6ec57 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:08.316937 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-cdf96c44-a42b-428d-b85e-e8e3cab6ec57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:08.328603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8748acb6-5f8b-4277-979a-d2f6ed7a1c60 None None] MFA Rules not processed for user `d48419d5ff5049dc888b0dfbcf371c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:08.328769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf96c44-a42b-428d-b85e-e8e3cab6ec57 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:08.329768 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8748acb6-5f8b-4277-979a-d2f6ed7a1c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:08.332385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e3fd9-e883-4d97-af81-55cc93c2e728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:08.333126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e3fd9-e883-4d97-af81-55cc93c2e728 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:08.333403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e3fd9-e883-4d97-af81-55cc93c2e728 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:08.333681 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e3fd9-e883-4d97-af81-55cc93c2e728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:08.383275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:08.386380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1258/2479] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:08.393143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e3fd9-e883-4d97-af81-55cc93c2e728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:08.394581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e3fd9-e883-4d97-af81-55cc93c2e728 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:08.404767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1222/2480] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:29:14.890806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748acb6-5f8b-4277-979a-d2f6ed7a1c60 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:14.924787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:14.953433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748acb6-5f8b-4277-979a-d2f6ed7a1c60 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:14.958047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ddd28-e372-4642-8733-7b11de6b8a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:14.958925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ddd28-e372-4642-8733-7b11de6b8a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:14.959213 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ddd28-e372-4642-8733-7b11de6b8a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:14.959486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ddd28-e372-4642-8733-7b11de6b8a1e admin admin] PATH_INFO: `/v3/users/56dc9cd284d5474aa0ccddc3f60689d9` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:14.960720 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ddd28-e372-4642-8733-7b11de6b8a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=56dc9cd284d5474aa0ccddc3f60689d9)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:14.963189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ddd28-e372-4642-8733-7b11de6b8a1e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:15.136034 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-484ddd28-e372-4642-8733-7b11de6b8a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56dc9cd284d5474aa0ccddc3f60689d9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:15.148044 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-484ddd28-e372-4642-8733-7b11de6b8a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56dc9cd284d5474aa0ccddc3f60689d9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:15.213883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-484ddd28-e372-4642-8733-7b11de6b8a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56dc9cd284d5474aa0ccddc3f60689d9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:15.214519 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-484ddd28-e372-4642-8733-7b11de6b8a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56dc9cd284d5474aa0ccddc3f60689d9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:15.222040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-484ddd28-e372-4642-8733-7b11de6b8a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56dc9cd284d5474aa0ccddc3f60689d9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:15.228159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1259/2481] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:29:14 2022] DELETE /identity/v3/users/56dc9cd284d5474aa0ccddc3f60689d9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:15.232776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fef481-45c3-4c0d-ac4f-3a4dd25f5240 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:15.233256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fef481-45c3-4c0d-ac4f-3a4dd25f5240 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:15.233363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fef481-45c3-4c0d-ac4f-3a4dd25f5240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:15.257079 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e4fef481-45c3-4c0d-ac4f-3a4dd25f5240 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:15.258339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e4fef481-45c3-4c0d-ac4f-3a4dd25f5240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:15.317183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1223/2482] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:15.327615 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ddd28-e372-4642-8733-7b11de6b8a1e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:15.329040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-484ddd28-e372-4642-8733-7b11de6b8a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:15.385365 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ddd28-e372-4642-8733-7b11de6b8a1e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:15.389177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf2101-91fe-49c7-9c2e-35b0f64f0fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:15.389763 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf2101-91fe-49c7-9c2e-35b0f64f0fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:15.390050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf2101-91fe-49c7-9c2e-35b0f64f0fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:15.390326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf2101-91fe-49c7-9c2e-35b0f64f0fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:15.399920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf2101-91fe-49c7-9c2e-35b0f64f0fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:15.401397 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf2101-91fe-49c7-9c2e-35b0f64f0fa6 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:15.410913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1260/2483] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:15.798134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fef481-45c3-4c0d-ac4f-3a4dd25f5240 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:15.802166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e4fef481-45c3-4c0d-ac4f-3a4dd25f5240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:15.814381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fef481-45c3-4c0d-ac4f-3a4dd25f5240 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:15.823788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:15.823788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:15.823788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:15.823788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] PATH_INFO: `/v3/projects/e90e5ca804cb4db7b304d3815c76838a` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:15.824637 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e90e5ca804cb4db7b304d3815c76838a)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:15.826686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:15.934692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e90e5ca804cb4db7b304d3815c76838a', 'request_id': 'req-85e808e5-0977-47f4-a923-089ab42c7bee'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:16.007722 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e90e5ca804cb4db7b304d3815c76838a', 'request_id': 'req-85e808e5-0977-47f4-a923-089ab42c7bee'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:16.013835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e90e5ca804cb4db7b304d3815c76838a', 'request_id': 'req-85e808e5-0977-47f4-a923-089ab42c7bee'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:16.025001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] The token cache is being invalidate because project e90e5ca804cb4db7b304d3815c76838a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:29:16.025291 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:16.025919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:16.027611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1224/2484] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:29:15 2022] DELETE /identity/v3/projects/e90e5ca804cb4db7b304d3815c76838a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:16.031637 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf2101-91fe-49c7-9c2e-35b0f64f0fa6 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:16.041987 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf2101-91fe-49c7-9c2e-35b0f64f0fa6 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:16.089186 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:16.098156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800f49b-ea6f-42ac-afbd-273ea4c997fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:16.099033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800f49b-ea6f-42ac-afbd-273ea4c997fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:16.099334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800f49b-ea6f-42ac-afbd-273ea4c997fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:16.099601 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800f49b-ea6f-42ac-afbd-273ea4c997fb admin admin] PATH_INFO: `/v3/users/a2e0af62a8454d9f91b94bffc9b6fb16` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:16.100835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800f49b-ea6f-42ac-afbd-273ea4c997fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e0af62a8454d9f91b94bffc9b6fb16)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:16.103342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800f49b-ea6f-42ac-afbd-273ea4c997fb admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:16.272717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8800f49b-ea6f-42ac-afbd-273ea4c997fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e0af62a8454d9f91b94bffc9b6fb16'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:16.284908 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8800f49b-ea6f-42ac-afbd-273ea4c997fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e0af62a8454d9f91b94bffc9b6fb16'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:16.367942 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8800f49b-ea6f-42ac-afbd-273ea4c997fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e0af62a8454d9f91b94bffc9b6fb16'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:16.368780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8800f49b-ea6f-42ac-afbd-273ea4c997fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e0af62a8454d9f91b94bffc9b6fb16'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:16.376741 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8800f49b-ea6f-42ac-afbd-273ea4c997fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e0af62a8454d9f91b94bffc9b6fb16'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:16.383083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1261/2485] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:29:16 2022] DELETE /identity/v3/users/a2e0af62a8454d9f91b94bffc9b6fb16 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:16.743559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:16.743559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:16.757038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e808e5-0977-47f4-a923-089ab42c7bee admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:16.815346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c926f1-d892-4e9e-ab08-6180b69ed2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:16.816159 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c926f1-d892-4e9e-ab08-6180b69ed2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:16.816452 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c926f1-d892-4e9e-ab08-6180b69ed2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:16.816714 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c926f1-d892-4e9e-ab08-6180b69ed2ec admin admin] PATH_INFO: `/v3/projects/232688a97b594d9da47b921e00921eae` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:16.817960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c926f1-d892-4e9e-ab08-6180b69ed2ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=232688a97b594d9da47b921e00921eae)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:16.819852 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c926f1-d892-4e9e-ab08-6180b69ed2ec admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:16.836446 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:16.990235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-60c926f1-d892-4e9e-ab08-6180b69ed2ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232688a97b594d9da47b921e00921eae', 'request_id': 'req-60c926f1-d892-4e9e-ab08-6180b69ed2ec'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:17.093292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-60c926f1-d892-4e9e-ab08-6180b69ed2ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232688a97b594d9da47b921e00921eae', 'request_id': 'req-60c926f1-d892-4e9e-ab08-6180b69ed2ec'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:17.099401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-60c926f1-d892-4e9e-ab08-6180b69ed2ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232688a97b594d9da47b921e00921eae', 'request_id': 'req-60c926f1-d892-4e9e-ab08-6180b69ed2ec'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:17.110522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-60c926f1-d892-4e9e-ab08-6180b69ed2ec admin admin] The token cache is being invalidate because project 232688a97b594d9da47b921e00921eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:29:17.110813 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-60c926f1-d892-4e9e-ab08-6180b69ed2ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:17.111448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-60c926f1-d892-4e9e-ab08-6180b69ed2ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:17.113024 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1225/2486] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:29:16 2022] DELETE /identity/v3/projects/232688a97b594d9da47b921e00921eae => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:17.117782 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaeb66-adf9-44fa-b6ff-38d7f0921938 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:17.118751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaeb66-adf9-44fa-b6ff-38d7f0921938 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:17.118867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaeb66-adf9-44fa-b6ff-38d7f0921938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:17.138495 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-eefaeb66-adf9-44fa-b6ff-38d7f0921938 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:17.139703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-eefaeb66-adf9-44fa-b6ff-38d7f0921938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:17.198428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1262/2487] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:17.206100 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c0b2c-4fdc-4a02-bc27-afa376b4ae49 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:17.206389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c0b2c-4fdc-4a02-bc27-afa376b4ae49 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:17.206667 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c0b2c-4fdc-4a02-bc27-afa376b4ae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:17.225816 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-409c0b2c-4fdc-4a02-bc27-afa376b4ae49 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:17.227046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-409c0b2c-4fdc-4a02-bc27-afa376b4ae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:17.235091 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1226/2488] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:17.239316 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaeb66-adf9-44fa-b6ff-38d7f0921938 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:17.249446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaeb66-adf9-44fa-b6ff-38d7f0921938 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:17.254270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8f70-5190-47c8-921d-6e9bb93cd331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:17.254915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8f70-5190-47c8-921d-6e9bb93cd331 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:17.255199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8f70-5190-47c8-921d-6e9bb93cd331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:17.255473 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8f70-5190-47c8-921d-6e9bb93cd331 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:17.256227 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8f70-5190-47c8-921d-6e9bb93cd331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:29:17.256529 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8f70-5190-47c8-921d-6e9bb93cd331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:17.258116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8f70-5190-47c8-921d-6e9bb93cd331 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:17.270419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1263/2489] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:29:17.274688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c0b2c-4fdc-4a02-bc27-afa376b4ae49 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:17.283988 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c0b2c-4fdc-4a02-bc27-afa376b4ae49 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:17.288622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788c21e-5595-4913-be00-00ef3e5ec866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:17.289266 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788c21e-5595-4913-be00-00ef3e5ec866 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:17.289547 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788c21e-5595-4913-be00-00ef3e5ec866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:17.289821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788c21e-5595-4913-be00-00ef3e5ec866 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:17.290501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788c21e-5595-4913-be00-00ef3e5ec866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:17.292445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788c21e-5595-4913-be00-00ef3e5ec866 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:17.367539 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1227/2490] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:29:17 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:17.372125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8f70-5190-47c8-921d-6e9bb93cd331 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:17.382311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8f70-5190-47c8-921d-6e9bb93cd331 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:17.439734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2cc7b-fee1-47ac-a23f-3544071f94ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:17.440450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2cc7b-fee1-47ac-a23f-3544071f94ef admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:17.440757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2cc7b-fee1-47ac-a23f-3544071f94ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:17.441039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2cc7b-fee1-47ac-a23f-3544071f94ef admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:17.441752 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2cc7b-fee1-47ac-a23f-3544071f94ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:17.443816 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2cc7b-fee1-47ac-a23f-3544071f94ef admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:17.450711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:17.515455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1264/2491] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:29:17 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:29:17.519595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788c21e-5595-4913-be00-00ef3e5ec866 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:17.530333 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788c21e-5595-4913-be00-00ef3e5ec866 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:17.535141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccc5b1-5b74-47bd-8d99-bdccc5ee598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:17.535814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccc5b1-5b74-47bd-8d99-bdccc5ee598c admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:17.536128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccc5b1-5b74-47bd-8d99-bdccc5ee598c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:17.536409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccc5b1-5b74-47bd-8d99-bdccc5ee598c admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:17.537144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccc5b1-5b74-47bd-8d99-bdccc5ee598c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:17.538790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccc5b1-5b74-47bd-8d99-bdccc5ee598c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:17.550351 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1228/2492] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:17.554589 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2cc7b-fee1-47ac-a23f-3544071f94ef admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:17.565243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2cc7b-fee1-47ac-a23f-3544071f94ef admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:17.570004 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e299c-ff08-42be-bc2a-fd490e16d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:17.570668 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e299c-ff08-42be-bc2a-fd490e16d3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:17.570954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e299c-ff08-42be-bc2a-fd490e16d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:17.571232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e299c-ff08-42be-bc2a-fd490e16d3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:17.572058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e299c-ff08-42be-bc2a-fd490e16d3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:17.574180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e299c-ff08-42be-bc2a-fd490e16d3b6 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:17.585116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1265/2493] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:17.589331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccc5b1-5b74-47bd-8d99-bdccc5ee598c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:17.599220 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccc5b1-5b74-47bd-8d99-bdccc5ee598c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:17.604437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3a7ff-9eec-4d37-9cb5-d8375b8c86f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:17.605304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3a7ff-9eec-4d37-9cb5-d8375b8c86f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:17.605589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3a7ff-9eec-4d37-9cb5-d8375b8c86f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:17.605866 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3a7ff-9eec-4d37-9cb5-d8375b8c86f1 admin admin] PATH_INFO: `/v3/projects/fa273cbb77314d3aaedee55fad8206fc/users/59a2d47ce1da49bea3946ef367389ae8/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:17.620995 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3a7ff-9eec-4d37-9cb5-d8375b8c86f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa273cbb77314d3aaedee55fad8206fc, user_id=59a2d47ce1da49bea3946ef367389ae8, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:17.623580 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3a7ff-9eec-4d37-9cb5-d8375b8c86f1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:17.699615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1229/2494] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:17 2022] PUT /identity/v3/projects/fa273cbb77314d3aaedee55fad8206fc/users/59a2d47ce1da49bea3946ef367389ae8/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:17.710909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a49089-36dd-4600-9d3d-85619d7b9aed None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:17.711205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a49089-36dd-4600-9d3d-85619d7b9aed None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:17.711488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a49089-36dd-4600-9d3d-85619d7b9aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:17.738266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d2a49089-36dd-4600-9d3d-85619d7b9aed None None] MFA Rules not processed for user `59a2d47ce1da49bea3946ef367389ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:17.739522 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d2a49089-36dd-4600-9d3d-85619d7b9aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:17.803264 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1266/2495] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:17.814764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3a7ff-9eec-4d37-9cb5-d8375b8c86f1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:17.816639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e4f3a7ff-9eec-4d37-9cb5-d8375b8c86f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:17.873864 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3a7ff-9eec-4d37-9cb5-d8375b8c86f1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:17.877455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfc70f-c5d1-4d59-a02a-b6e0a0e29bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:17.878094 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc70f-c5d1-4d59-a02a-b6e0a0e29bcd service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:17.878384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc70f-c5d1-4d59-a02a-b6e0a0e29bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:17.878659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc70f-c5d1-4d59-a02a-b6e0a0e29bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:17.887056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfc70f-c5d1-4d59-a02a-b6e0a0e29bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:17.888521 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfc70f-c5d1-4d59-a02a-b6e0a0e29bcd service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:17.897254 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1230/2496] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:17.917267 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a49089-36dd-4600-9d3d-85619d7b9aed None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:17.979611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a49089-36dd-4600-9d3d-85619d7b9aed None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:17.984289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3347f6c-a7f9-4dbb-93f0-2db5ff5384ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:17.985172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3347f6c-a7f9-4dbb-93f0-2db5ff5384ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:17.985455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3347f6c-a7f9-4dbb-93f0-2db5ff5384ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:17.985729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3347f6c-a7f9-4dbb-93f0-2db5ff5384ae admin admin] PATH_INFO: `/v3/users/59a2d47ce1da49bea3946ef367389ae8` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:17.987347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3347f6c-a7f9-4dbb-93f0-2db5ff5384ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a2d47ce1da49bea3946ef367389ae8)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:17.988918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3347f6c-a7f9-4dbb-93f0-2db5ff5384ae admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:18.188028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a3347f6c-a7f9-4dbb-93f0-2db5ff5384ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a2d47ce1da49bea3946ef367389ae8'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:18.201036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a3347f6c-a7f9-4dbb-93f0-2db5ff5384ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a2d47ce1da49bea3946ef367389ae8'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:18.209298 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:18.299241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a3347f6c-a7f9-4dbb-93f0-2db5ff5384ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a2d47ce1da49bea3946ef367389ae8'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:18.299944 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a3347f6c-a7f9-4dbb-93f0-2db5ff5384ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a2d47ce1da49bea3946ef367389ae8'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:18.307871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a3347f6c-a7f9-4dbb-93f0-2db5ff5384ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a2d47ce1da49bea3946ef367389ae8'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:18.313866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1267/2497] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:29:17 2022] DELETE /identity/v3/users/59a2d47ce1da49bea3946ef367389ae8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:18.318546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5456990-6772-41e1-97de-19b5f68ac75f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:18.327902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5456990-6772-41e1-97de-19b5f68ac75f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:18.327902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5456990-6772-41e1-97de-19b5f68ac75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:18.336231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f5456990-6772-41e1-97de-19b5f68ac75f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:18.337456 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f5456990-6772-41e1-97de-19b5f68ac75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:18.376123 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:18.396108 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1231/2498] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:18.405962 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3347f6c-a7f9-4dbb-93f0-2db5ff5384ae admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:18.407822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a3347f6c-a7f9-4dbb-93f0-2db5ff5384ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:18.465632 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3347f6c-a7f9-4dbb-93f0-2db5ff5384ae admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:18.469307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdfa87-4611-41f2-8838-267158c6b98a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:18.469947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdfa87-4611-41f2-8838-267158c6b98a service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:18.470229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdfa87-4611-41f2-8838-267158c6b98a service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:18.470506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdfa87-4611-41f2-8838-267158c6b98a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:18.480028 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdfa87-4611-41f2-8838-267158c6b98a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:18.481584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdfa87-4611-41f2-8838-267158c6b98a service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:18.491013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1268/2499] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:18.973520 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5456990-6772-41e1-97de-19b5f68ac75f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:18.976982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f5456990-6772-41e1-97de-19b5f68ac75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:18.993102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5456990-6772-41e1-97de-19b5f68ac75f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:18.998607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9a504-7d74-49c6-b0be-193a26d2e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:18.999861 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9a504-7d74-49c6-b0be-193a26d2e287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:18.999861 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9a504-7d74-49c6-b0be-193a26d2e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:19.000203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9a504-7d74-49c6-b0be-193a26d2e287 admin admin] PATH_INFO: `/v3/projects/fa273cbb77314d3aaedee55fad8206fc` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:19.001463 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9a504-7d74-49c6-b0be-193a26d2e287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa273cbb77314d3aaedee55fad8206fc)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:19.003321 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9a504-7d74-49c6-b0be-193a26d2e287 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:19.106047 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8be9a504-7d74-49c6-b0be-193a26d2e287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa273cbb77314d3aaedee55fad8206fc', 'request_id': 'req-8be9a504-7d74-49c6-b0be-193a26d2e287'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:19.156070 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8be9a504-7d74-49c6-b0be-193a26d2e287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa273cbb77314d3aaedee55fad8206fc', 'request_id': 'req-8be9a504-7d74-49c6-b0be-193a26d2e287'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:19.162037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8be9a504-7d74-49c6-b0be-193a26d2e287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa273cbb77314d3aaedee55fad8206fc', 'request_id': 'req-8be9a504-7d74-49c6-b0be-193a26d2e287'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:19.173255 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8be9a504-7d74-49c6-b0be-193a26d2e287 admin admin] The token cache is being invalidate because project fa273cbb77314d3aaedee55fad8206fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:29:19.173542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8be9a504-7d74-49c6-b0be-193a26d2e287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:19.174197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8be9a504-7d74-49c6-b0be-193a26d2e287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:19.175784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1232/2500] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:29:18 2022] DELETE /identity/v3/projects/fa273cbb77314d3aaedee55fad8206fc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:19.181819 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5333c94-9926-41a8-bf1b-cda64ead77fa None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:19.182197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5333c94-9926-41a8-bf1b-cda64ead77fa None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:19.182559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5333c94-9926-41a8-bf1b-cda64ead77fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:19.201228 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e5333c94-9926-41a8-bf1b-cda64ead77fa None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:19.202495 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e5333c94-9926-41a8-bf1b-cda64ead77fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:19.278305 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1269/2501] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:19.285915 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c06fc4-528e-4cf8-b307-83d2cb5404d5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:19.286275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c06fc4-528e-4cf8-b307-83d2cb5404d5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:19.286626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c06fc4-528e-4cf8-b307-83d2cb5404d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:19.305551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a1c06fc4-528e-4cf8-b307-83d2cb5404d5 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:19.307379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a1c06fc4-528e-4cf8-b307-83d2cb5404d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:19.315454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1233/2502] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:19.319859 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5333c94-9926-41a8-bf1b-cda64ead77fa None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:19.331026 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5333c94-9926-41a8-bf1b-cda64ead77fa None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:19.335757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdd690-1db1-4f03-9798-c08e9697df61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:19.336444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdd690-1db1-4f03-9798-c08e9697df61 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:19.336734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdd690-1db1-4f03-9798-c08e9697df61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:19.337021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdd690-1db1-4f03-9798-c08e9697df61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:19.337752 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfdd690-1db1-4f03-9798-c08e9697df61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:29:19.338066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfdd690-1db1-4f03-9798-c08e9697df61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:19.339688 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfdd690-1db1-4f03-9798-c08e9697df61 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:19.352345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1270/2503] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:29:19.356635 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c06fc4-528e-4cf8-b307-83d2cb5404d5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:19.365875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c06fc4-528e-4cf8-b307-83d2cb5404d5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:19.371643 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca1446-2841-4c6e-a147-782fe8aeba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:19.372329 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca1446-2841-4c6e-a147-782fe8aeba8b admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:19.372614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca1446-2841-4c6e-a147-782fe8aeba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:19.372887 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca1446-2841-4c6e-a147-782fe8aeba8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:19.373585 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca1446-2841-4c6e-a147-782fe8aeba8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:19.375491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca1446-2841-4c6e-a147-782fe8aeba8b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:19.465581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1234/2504] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:29:19 2022] POST /identity/v3/projects => generated 359 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:19.469790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdd690-1db1-4f03-9798-c08e9697df61 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:19.479919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdd690-1db1-4f03-9798-c08e9697df61 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:19.537541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8417e-3e22-4b1b-a7f1-d6a4fff2acbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:19.539191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8417e-3e22-4b1b-a7f1-d6a4fff2acbc admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:19.539191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8417e-3e22-4b1b-a7f1-d6a4fff2acbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:19.539191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8417e-3e22-4b1b-a7f1-d6a4fff2acbc admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:19.539565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8417e-3e22-4b1b-a7f1-d6a4fff2acbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:19.541550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8417e-3e22-4b1b-a7f1-d6a4fff2acbc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:19.613669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1271/2505] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:29:19 2022] POST /identity/v3/users => generated 280 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:19.617832 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca1446-2841-4c6e-a147-782fe8aeba8b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:19.628932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca1446-2841-4c6e-a147-782fe8aeba8b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:19.634001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c7f1f-b2f3-4c41-849a-c7561a1f6c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:19.635675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c7f1f-b2f3-4c41-849a-c7561a1f6c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:19.635797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c7f1f-b2f3-4c41-849a-c7561a1f6c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:19.636101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c7f1f-b2f3-4c41-849a-c7561a1f6c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:19.636943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c7f1f-b2f3-4c41-849a-c7561a1f6c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:19.638625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c7f1f-b2f3-4c41-849a-c7561a1f6c43 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:19.649668 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1235/2506] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:29:19.653916 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8417e-3e22-4b1b-a7f1-d6a4fff2acbc admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:19.664133 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8417e-3e22-4b1b-a7f1-d6a4fff2acbc admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:19.669341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e633b07-4ae1-4a0a-a61a-5493769c0a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:19.670012 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633b07-4ae1-4a0a-a61a-5493769c0a0d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:19.670300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633b07-4ae1-4a0a-a61a-5493769c0a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:19.670579 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633b07-4ae1-4a0a-a61a-5493769c0a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:19.671311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e633b07-4ae1-4a0a-a61a-5493769c0a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:19.672959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e633b07-4ae1-4a0a-a61a-5493769c0a0d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:19.674320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:19.684803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1272/2507] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:19.688913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c7f1f-b2f3-4c41-849a-c7561a1f6c43 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:19.699214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c7f1f-b2f3-4c41-849a-c7561a1f6c43 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:19.704936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8295c-42fe-488d-8fba-d0287b4a1fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:19.705826 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8295c-42fe-488d-8fba-d0287b4a1fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:19.706111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8295c-42fe-488d-8fba-d0287b4a1fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:19.706412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8295c-42fe-488d-8fba-d0287b4a1fa1 admin admin] PATH_INFO: `/v3/projects/5fb8d9beeb8d48cdb70d486b0bb4a1af/users/4bb943767c574a379ecfec222ff58a78/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:19.722190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8295c-42fe-488d-8fba-d0287b4a1fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb8d9beeb8d48cdb70d486b0bb4a1af, user_id=4bb943767c574a379ecfec222ff58a78, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:19.724872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8295c-42fe-488d-8fba-d0287b4a1fa1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:19.819327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1236/2508] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:19 2022] PUT /identity/v3/projects/5fb8d9beeb8d48cdb70d486b0bb4a1af/users/4bb943767c574a379ecfec222ff58a78/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:19.830989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de58b9e-c9fd-4a73-8c53-6108d22a9653 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:19.831278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de58b9e-c9fd-4a73-8c53-6108d22a9653 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:19.831556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de58b9e-c9fd-4a73-8c53-6108d22a9653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:19.860105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-6de58b9e-c9fd-4a73-8c53-6108d22a9653 None None] MFA Rules not processed for user `4bb943767c574a379ecfec222ff58a78`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:19.861339 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6de58b9e-c9fd-4a73-8c53-6108d22a9653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:19.925393 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1273/2509] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:19 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:19.937273 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8295c-42fe-488d-8fba-d0287b4a1fa1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:19.939008 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9df8295c-42fe-488d-8fba-d0287b4a1fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:19.998117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8295c-42fe-488d-8fba-d0287b4a1fa1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:20.002259 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7ad4c-7619-45dc-8c07-86dfc1bb273c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:20.002920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7ad4c-7619-45dc-8c07-86dfc1bb273c service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:20.003205 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7ad4c-7619-45dc-8c07-86dfc1bb273c service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:20.003614 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7ad4c-7619-45dc-8c07-86dfc1bb273c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:20.012760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7ad4c-7619-45dc-8c07-86dfc1bb273c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:20.014226 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7ad4c-7619-45dc-8c07-86dfc1bb273c service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:20.023494 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1237/2510] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:19 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:28.051079 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830a6f-c86f-47d8-b2ed-6b7b69f7812e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:28.051616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830a6f-c86f-47d8-b2ed-6b7b69f7812e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:28.051616 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830a6f-c86f-47d8-b2ed-6b7b69f7812e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:28.070848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ad830a6f-c86f-47d8-b2ed-6b7b69f7812e None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:28.072382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ad830a6f-c86f-47d8-b2ed-6b7b69f7812e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:28.141146 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1274/2511] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:29:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:28.166045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7ad4c-7619-45dc-8c07-86dfc1bb273c service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:28.167519 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-46c7ad4c-7619-45dc-8c07-86dfc1bb273c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:28.177650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:28.248684 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7ad4c-7619-45dc-8c07-86dfc1bb273c service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:28.250273 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10e0e7-cd7b-4682-ae9c-aeee7fd33861 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:28.250968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10e0e7-cd7b-4682-ae9c-aeee7fd33861 service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:28.251205 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10e0e7-cd7b-4682-ae9c-aeee7fd33861 service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:28.251440 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10e0e7-cd7b-4682-ae9c-aeee7fd33861 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:28.263408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10e0e7-cd7b-4682-ae9c-aeee7fd33861 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:28.265929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10e0e7-cd7b-4682-ae9c-aeee7fd33861 service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:28.274600 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1238/2512] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:29:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:29:29.294571 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110cf8-5b87-4cd7-8d45-860f86cbdfff None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:29.295035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110cf8-5b87-4cd7-8d45-860f86cbdfff None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:29.295130 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110cf8-5b87-4cd7-8d45-860f86cbdfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:29.315633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-af110cf8-5b87-4cd7-8d45-860f86cbdfff None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:29.316919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-af110cf8-5b87-4cd7-8d45-860f86cbdfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:29.326170 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1275/2513] 10.222.0.74 () {58 vars in 967 bytes} [Thu Jul 14 10:29:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:29.342154 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10e0e7-cd7b-4682-ae9c-aeee7fd33861 service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:29.354293 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10e0e7-cd7b-4682-ae9c-aeee7fd33861 service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:29.361270 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea45aa-80d4-4756-aa33-b7d416e41c56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:29.361897 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea45aa-80d4-4756-aa33-b7d416e41c56 service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:29.362183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea45aa-80d4-4756-aa33-b7d416e41c56 service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:29.362464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea45aa-80d4-4756-aa33-b7d416e41c56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:29.374015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea45aa-80d4-4756-aa33-b7d416e41c56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:29.376042 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea45aa-80d4-4756-aa33-b7d416e41c56 service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:29.385559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1239/2514] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:29:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:29:30.045410 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35fbd-e0aa-4f0e-956f-f9785391c7f8 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:30.046071 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35fbd-e0aa-4f0e-956f-f9785391c7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:30.046506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35fbd-e0aa-4f0e-956f-f9785391c7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:30.081925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d9c35fbd-e0aa-4f0e-956f-f9785391c7f8 None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:30.083180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d9c35fbd-e0aa-4f0e-956f-f9785391c7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:30.090851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1276/2515] 10.222.0.74 () {58 vars in 1009 bytes} [Thu Jul 14 10:29:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:30.105162 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea45aa-80d4-4756-aa33-b7d416e41c56 service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:30.116390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea45aa-80d4-4756-aa33-b7d416e41c56 service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:30.122133 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8ff2d-3a98-418e-94db-c23bea96cd78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:30.122908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8ff2d-3a98-418e-94db-c23bea96cd78 service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:30.123200 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8ff2d-3a98-418e-94db-c23bea96cd78 service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:30.123481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8ff2d-3a98-418e-94db-c23bea96cd78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:30.132458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8ff2d-3a98-418e-94db-c23bea96cd78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:30.134168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8ff2d-3a98-418e-94db-c23bea96cd78 service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:30.142772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1240/2516] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:29:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:29:30.718518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bbf50-c5e7-4079-8443-4168743f9f3b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:30.718969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bbf50-c5e7-4079-8443-4168743f9f3b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:30.719078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bbf50-c5e7-4079-8443-4168743f9f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:30.737710 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-eb9bbf50-c5e7-4079-8443-4168743f9f3b None None] MFA Rules not processed for user `75710267bbf04b629f1fd96ca761b89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:30.738927 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-eb9bbf50-c5e7-4079-8443-4168743f9f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:30.746889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1277/2517] 10.222.0.74 () {58 vars in 967 bytes} [Thu Jul 14 10:29:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:30.759955 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8ff2d-3a98-418e-94db-c23bea96cd78 service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:30.770767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8ff2d-3a98-418e-94db-c23bea96cd78 service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:30.776177 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fc6e8-d3b3-4e8c-85e7-3dbe5b7d4e6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323279b7ad0c418b848d6d7ae26ec5d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:30.777407 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fc6e8-d3b3-4e8c-85e7-3dbe5b7d4e6c service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:30.777697 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fc6e8-d3b3-4e8c-85e7-3dbe5b7d4e6c service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:30.777976 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fc6e8-d3b3-4e8c-85e7-3dbe5b7d4e6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:30.786706 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fc6e8-d3b3-4e8c-85e7-3dbe5b7d4e6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:30.788326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fc6e8-d3b3-4e8c-85e7-3dbe5b7d4e6c service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:30.796495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1241/2518] 10.222.0.74 () {60 vars in 1384 bytes} [Thu Jul 14 10:29:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 10:29:33.093556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bbf50-c5e7-4079-8443-4168743f9f3b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:33.095018 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-eb9bbf50-c5e7-4079-8443-4168743f9f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:33.169632 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bbf50-c5e7-4079-8443-4168743f9f3b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:33.175356 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148a5da-e152-4563-a095-b6bfb1806761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:33.176087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148a5da-e152-4563-a095-b6bfb1806761 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:33.176380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148a5da-e152-4563-a095-b6bfb1806761 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:33.176662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148a5da-e152-4563-a095-b6bfb1806761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:33.178455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2148a5da-e152-4563-a095-b6bfb1806761 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:33.185070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:33.236744 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148a5da-e152-4563-a095-b6bfb1806761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:33.238365 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148a5da-e152-4563-a095-b6bfb1806761 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:33.247857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1278/2519] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:33.368935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fc6e8-d3b3-4e8c-85e7-3dbe5b7d4e6c service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:33.370332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9a6fc6e8-d3b3-4e8c-85e7-3dbe5b7d4e6c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:33.430326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fc6e8-d3b3-4e8c-85e7-3dbe5b7d4e6c service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:33.434644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad90d9d-ec58-452b-81e6-d479417e0261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:33.435282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad90d9d-ec58-452b-81e6-d479417e0261 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:33.435567 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad90d9d-ec58-452b-81e6-d479417e0261 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:33.435842 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad90d9d-ec58-452b-81e6-d479417e0261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:33.437665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-fad90d9d-ec58-452b-81e6-d479417e0261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:33.500888 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad90d9d-ec58-452b-81e6-d479417e0261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:33.502425 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad90d9d-ec58-452b-81e6-d479417e0261 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:33.512424 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1242/2520] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:33.519077 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148a5da-e152-4563-a095-b6bfb1806761 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:33.520637 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2148a5da-e152-4563-a095-b6bfb1806761 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:33.534800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148a5da-e152-4563-a095-b6bfb1806761 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:33.539491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0693b4-60e4-4709-a1f5-a81edbd5d337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:33.540411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0693b4-60e4-4709-a1f5-a81edbd5d337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:33.540697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0693b4-60e4-4709-a1f5-a81edbd5d337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:33.540978 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0693b4-60e4-4709-a1f5-a81edbd5d337 admin admin] PATH_INFO: `/v3/users/d48419d5ff5049dc888b0dfbcf371c38` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:33.542223 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0693b4-60e4-4709-a1f5-a81edbd5d337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48419d5ff5049dc888b0dfbcf371c38)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:33.544841 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0693b4-60e4-4709-a1f5-a81edbd5d337 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:33.766095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5d0693b4-60e4-4709-a1f5-a81edbd5d337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48419d5ff5049dc888b0dfbcf371c38'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:33.781017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5d0693b4-60e4-4709-a1f5-a81edbd5d337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48419d5ff5049dc888b0dfbcf371c38'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:33.841100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5d0693b4-60e4-4709-a1f5-a81edbd5d337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48419d5ff5049dc888b0dfbcf371c38'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:33.845471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5d0693b4-60e4-4709-a1f5-a81edbd5d337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48419d5ff5049dc888b0dfbcf371c38'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:33.853159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5d0693b4-60e4-4709-a1f5-a81edbd5d337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48419d5ff5049dc888b0dfbcf371c38'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:33.860563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1279/2521] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:29:33 2022] DELETE /identity/v3/users/d48419d5ff5049dc888b0dfbcf371c38 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:33.865038 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40238190-a43e-4b3f-9c03-7fc555137f98 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:33.865328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40238190-a43e-4b3f-9c03-7fc555137f98 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:33.865628 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40238190-a43e-4b3f-9c03-7fc555137f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:33.874536 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:33.885488 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-40238190-a43e-4b3f-9c03-7fc555137f98 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:33.887669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-40238190-a43e-4b3f-9c03-7fc555137f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:33.948089 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1243/2522] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:33.958428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0693b4-60e4-4709-a1f5-a81edbd5d337 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:33.959915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5d0693b4-60e4-4709-a1f5-a81edbd5d337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:34.041623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0693b4-60e4-4709-a1f5-a81edbd5d337 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:34.046225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ed2f-00be-4110-a2b1-1689d7f13d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:34.053619 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ed2f-00be-4110-a2b1-1689d7f13d96 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:34.053619 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ed2f-00be-4110-a2b1-1689d7f13d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:34.053619 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ed2f-00be-4110-a2b1-1689d7f13d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:34.068952 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ed2f-00be-4110-a2b1-1689d7f13d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:34.070404 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ed2f-00be-4110-a2b1-1689d7f13d96 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:34.087771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1280/2523] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:29:34.513223 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40238190-a43e-4b3f-9c03-7fc555137f98 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:34.513223 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-40238190-a43e-4b3f-9c03-7fc555137f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:34.513223 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40238190-a43e-4b3f-9c03-7fc555137f98 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:34.514754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7735d2-61e8-4439-968f-bf17da1449f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:34.514754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7735d2-61e8-4439-968f-bf17da1449f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:34.514754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7735d2-61e8-4439-968f-bf17da1449f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:34.514754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7735d2-61e8-4439-968f-bf17da1449f1 admin admin] PATH_INFO: `/v3/projects/3798c93cad4c478c8dc7f6d02e1d6f4f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:34.515595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7735d2-61e8-4439-968f-bf17da1449f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3798c93cad4c478c8dc7f6d02e1d6f4f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:34.515595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7735d2-61e8-4439-968f-bf17da1449f1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:34.597562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ad7735d2-61e8-4439-968f-bf17da1449f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3798c93cad4c478c8dc7f6d02e1d6f4f', 'request_id': 'req-ad7735d2-61e8-4439-968f-bf17da1449f1'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:34.697445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ad7735d2-61e8-4439-968f-bf17da1449f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3798c93cad4c478c8dc7f6d02e1d6f4f', 'request_id': 'req-ad7735d2-61e8-4439-968f-bf17da1449f1'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:34.704785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ad7735d2-61e8-4439-968f-bf17da1449f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3798c93cad4c478c8dc7f6d02e1d6f4f', 'request_id': 'req-ad7735d2-61e8-4439-968f-bf17da1449f1'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:34.717316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ad7735d2-61e8-4439-968f-bf17da1449f1 admin admin] The token cache is being invalidate because project 3798c93cad4c478c8dc7f6d02e1d6f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:29:34.717930 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ad7735d2-61e8-4439-968f-bf17da1449f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:34.718918 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ad7735d2-61e8-4439-968f-bf17da1449f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:34.720731 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1244/2524] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:29:34 2022] DELETE /identity/v3/projects/3798c93cad4c478c8dc7f6d02e1d6f4f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:34.726021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951909-30bb-4219-89ba-41f1357df259 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:34.726563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951909-30bb-4219-89ba-41f1357df259 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:34.726563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951909-30bb-4219-89ba-41f1357df259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:34.747965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3e951909-30bb-4219-89ba-41f1357df259 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:34.749265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3e951909-30bb-4219-89ba-41f1357df259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:34.776932 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:34.827043 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1281/2525] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:34.835798 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6e5bd-3f98-45b5-a570-219d138534af None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:34.836187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6e5bd-3f98-45b5-a570-219d138534af None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:34.836469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6e5bd-3f98-45b5-a570-219d138534af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:34.883253 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f8a6e5bd-3f98-45b5-a570-219d138534af None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:34.884812 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f8a6e5bd-3f98-45b5-a570-219d138534af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:34.894480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1245/2526] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:34.901068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e951909-30bb-4219-89ba-41f1357df259 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:34.912531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e951909-30bb-4219-89ba-41f1357df259 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:34.922307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34a291-13ca-4db2-8612-69c64a756d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:34.923098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34a291-13ca-4db2-8612-69c64a756d02 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:34.923391 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34a291-13ca-4db2-8612-69c64a756d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:34.923874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34a291-13ca-4db2-8612-69c64a756d02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:34.924914 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34a291-13ca-4db2-8612-69c64a756d02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:29:34.925251 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34a291-13ca-4db2-8612-69c64a756d02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:34.927194 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34a291-13ca-4db2-8612-69c64a756d02 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:34.941972 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1282/2527] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:29:34.946999 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6e5bd-3f98-45b5-a570-219d138534af None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:34.956744 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6e5bd-3f98-45b5-a570-219d138534af None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:34.968390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b96fc9-b4f2-491e-b4db-ccad498212af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:34.968390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b96fc9-b4f2-491e-b4db-ccad498212af admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:34.968390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b96fc9-b4f2-491e-b4db-ccad498212af admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:34.968390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b96fc9-b4f2-491e-b4db-ccad498212af admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:34.968770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b96fc9-b4f2-491e-b4db-ccad498212af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:34.968770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b96fc9-b4f2-491e-b4db-ccad498212af admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:35.121453 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1246/2528] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:29:34 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:29:35.122370 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34a291-13ca-4db2-8612-69c64a756d02 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:35.133286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34a291-13ca-4db2-8612-69c64a756d02 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:35.200641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94add428-0dd5-456f-ab58-759e569d111d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:35.201436 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94add428-0dd5-456f-ab58-759e569d111d admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:35.202223 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94add428-0dd5-456f-ab58-759e569d111d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:35.202223 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94add428-0dd5-456f-ab58-759e569d111d admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:35.202671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94add428-0dd5-456f-ab58-759e569d111d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:35.205409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94add428-0dd5-456f-ab58-759e569d111d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:35.361566 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1283/2529] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:29:35 2022] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:35.365919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b96fc9-b4f2-491e-b4db-ccad498212af admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:35.378444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b96fc9-b4f2-491e-b4db-ccad498212af admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:35.393181 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44437e-3fbb-4672-9a07-3aaf57e9380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:35.393869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44437e-3fbb-4672-9a07-3aaf57e9380e admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:35.394150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44437e-3fbb-4672-9a07-3aaf57e9380e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:35.394420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44437e-3fbb-4672-9a07-3aaf57e9380e admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:35.395422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44437e-3fbb-4672-9a07-3aaf57e9380e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:35.397593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44437e-3fbb-4672-9a07-3aaf57e9380e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:35.413509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1247/2530] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:35.417818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94add428-0dd5-456f-ab58-759e569d111d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:35.439828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94add428-0dd5-456f-ab58-759e569d111d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:35.453221 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecb99c-620f-448a-b7a5-22afefbd2a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:35.454759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecb99c-620f-448a-b7a5-22afefbd2a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:35.455057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecb99c-620f-448a-b7a5-22afefbd2a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:35.455342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecb99c-620f-448a-b7a5-22afefbd2a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:35.456244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecb99c-620f-448a-b7a5-22afefbd2a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:35.458012 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecb99c-620f-448a-b7a5-22afefbd2a46 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:35.472891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1284/2531] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:35.480816 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44437e-3fbb-4672-9a07-3aaf57e9380e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:35.485134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44437e-3fbb-4672-9a07-3aaf57e9380e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:35.490219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207a498-1cfe-405c-afff-0397c68b218b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:35.491662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207a498-1cfe-405c-afff-0397c68b218b admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:35.492219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207a498-1cfe-405c-afff-0397c68b218b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:35.492716 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207a498-1cfe-405c-afff-0397c68b218b admin admin] PATH_INFO: `/v3/projects/96528d56cafa4de5aa4e6d4ddc77c1b8/users/594b7245d5e7439db9f1e7d117e0586a/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:35.511134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207a498-1cfe-405c-afff-0397c68b218b admin admin] RBAC: Authorizing `identity:create_grant(project_id=96528d56cafa4de5aa4e6d4ddc77c1b8, user_id=594b7245d5e7439db9f1e7d117e0586a, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:35.514448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207a498-1cfe-405c-afff-0397c68b218b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:35.616416 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1248/2532] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:35 2022] PUT /identity/v3/projects/96528d56cafa4de5aa4e6d4ddc77c1b8/users/594b7245d5e7439db9f1e7d117e0586a/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:35.621091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf42647-0bab-4b1a-b675-9095393d3323 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:35.622555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf42647-0bab-4b1a-b675-9095393d3323 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:35.623349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf42647-0bab-4b1a-b675-9095393d3323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:35.653527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-acf42647-0bab-4b1a-b675-9095393d3323 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:35.655488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-acf42647-0bab-4b1a-b675-9095393d3323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:35.736385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1285/2533] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:35.743625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207a498-1cfe-405c-afff-0397c68b218b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:35.745808 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a207a498-1cfe-405c-afff-0397c68b218b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:35.775868 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:35.809380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207a498-1cfe-405c-afff-0397c68b218b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:35.813710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0082fb-b505-4803-ae51-266f00716335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:35.814419 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0082fb-b505-4803-ae51-266f00716335 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:35.814784 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0082fb-b505-4803-ae51-266f00716335 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:35.815066 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0082fb-b505-4803-ae51-266f00716335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:35.826046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0082fb-b505-4803-ae51-266f00716335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:35.829216 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0082fb-b505-4803-ae51-266f00716335 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:35.843370 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1249/2534] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:37.810318 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022ab5f-331e-4655-b9e9-26b2c18299ff None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:37.810856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022ab5f-331e-4655-b9e9-26b2c18299ff None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:37.810959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022ab5f-331e-4655-b9e9-26b2c18299ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:37.843625 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7022ab5f-331e-4655-b9e9-26b2c18299ff None None] MFA Rules not processed for user `594b7245d5e7439db9f1e7d117e0586a`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:37.844944 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7022ab5f-331e-4655-b9e9-26b2c18299ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:37.862897 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:37.919509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1286/2535] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:37.927841 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0082fb-b505-4803-ae51-266f00716335 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:37.930248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-be0082fb-b505-4803-ae51-266f00716335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:37.967600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022ab5f-331e-4655-b9e9-26b2c18299ff None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:37.972188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7022ab5f-331e-4655-b9e9-26b2c18299ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:37.988935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022ab5f-331e-4655-b9e9-26b2c18299ff None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:37.998764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64153f65-7e70-4fcc-a6fc-9bcc19e7819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:37.999669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64153f65-7e70-4fcc-a6fc-9bcc19e7819a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:37.999954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64153f65-7e70-4fcc-a6fc-9bcc19e7819a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:38.000303 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64153f65-7e70-4fcc-a6fc-9bcc19e7819a admin admin] PATH_INFO: `/v3/users/69e33c07f0844f228bef34d242d3be11` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:38.001623 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64153f65-7e70-4fcc-a6fc-9bcc19e7819a admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e33c07f0844f228bef34d242d3be11)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:38.005365 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64153f65-7e70-4fcc-a6fc-9bcc19e7819a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:38.015478 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0082fb-b505-4803-ae51-266f00716335 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:38.020016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18773f58-d72b-492d-a6cc-b8f1873e73a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:38.020817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18773f58-d72b-492d-a6cc-b8f1873e73a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:38.021105 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18773f58-d72b-492d-a6cc-b8f1873e73a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:38.021387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18773f58-d72b-492d-a6cc-b8f1873e73a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:38.036303 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18773f58-d72b-492d-a6cc-b8f1873e73a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:38.037925 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18773f58-d72b-492d-a6cc-b8f1873e73a9 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:38.053559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1250/2536] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:29:38.209246 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-64153f65-7e70-4fcc-a6fc-9bcc19e7819a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e33c07f0844f228bef34d242d3be11'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:38.225219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-64153f65-7e70-4fcc-a6fc-9bcc19e7819a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e33c07f0844f228bef34d242d3be11'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:38.319973 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-64153f65-7e70-4fcc-a6fc-9bcc19e7819a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e33c07f0844f228bef34d242d3be11'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:38.320728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-64153f65-7e70-4fcc-a6fc-9bcc19e7819a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e33c07f0844f228bef34d242d3be11'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:38.329767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-64153f65-7e70-4fcc-a6fc-9bcc19e7819a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e33c07f0844f228bef34d242d3be11'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:38.339255 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1287/2537] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:29:37 2022] DELETE /identity/v3/users/69e33c07f0844f228bef34d242d3be11 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:38.601859 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18773f58-d72b-492d-a6cc-b8f1873e73a9 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:38.623634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18773f58-d72b-492d-a6cc-b8f1873e73a9 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:38.682248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a18d76-0e54-4a88-8368-8bc3f739c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:38.683112 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a18d76-0e54-4a88-8368-8bc3f739c182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:38.683909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a18d76-0e54-4a88-8368-8bc3f739c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:38.684212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a18d76-0e54-4a88-8368-8bc3f739c182 admin admin] PATH_INFO: `/v3/projects/f6a35ed4d1dc4870924884d706f5bc95` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:38.685388 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a18d76-0e54-4a88-8368-8bc3f739c182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a35ed4d1dc4870924884d706f5bc95)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:38.687429 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a18d76-0e54-4a88-8368-8bc3f739c182 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:38.810263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-86a18d76-0e54-4a88-8368-8bc3f739c182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a35ed4d1dc4870924884d706f5bc95', 'request_id': 'req-86a18d76-0e54-4a88-8368-8bc3f739c182'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:38.908654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-86a18d76-0e54-4a88-8368-8bc3f739c182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a35ed4d1dc4870924884d706f5bc95', 'request_id': 'req-86a18d76-0e54-4a88-8368-8bc3f739c182'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:38.915751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-86a18d76-0e54-4a88-8368-8bc3f739c182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a35ed4d1dc4870924884d706f5bc95', 'request_id': 'req-86a18d76-0e54-4a88-8368-8bc3f739c182'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:38.923865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:38.927847 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-86a18d76-0e54-4a88-8368-8bc3f739c182 admin admin] The token cache is being invalidate because project f6a35ed4d1dc4870924884d706f5bc95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:29:38.928250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-86a18d76-0e54-4a88-8368-8bc3f739c182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:38.934365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-86a18d76-0e54-4a88-8368-8bc3f739c182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:38.934365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1251/2538] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:29:38 2022] DELETE /identity/v3/projects/f6a35ed4d1dc4870924884d706f5bc95 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:38.936468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cdf7b-6b77-4aab-8fe9-42b1acaba93a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:38.936897 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cdf7b-6b77-4aab-8fe9-42b1acaba93a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:38.937049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cdf7b-6b77-4aab-8fe9-42b1acaba93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:38.956194 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-123cdf7b-6b77-4aab-8fe9-42b1acaba93a None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:38.957580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-123cdf7b-6b77-4aab-8fe9-42b1acaba93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:39.019424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1288/2539] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:39.028234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b7d27-3817-4c38-8aeb-5a059765fd3a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:39.028556 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b7d27-3817-4c38-8aeb-5a059765fd3a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:39.028844 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b7d27-3817-4c38-8aeb-5a059765fd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:39.047535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-407b7d27-3817-4c38-8aeb-5a059765fd3a None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:39.048808 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-407b7d27-3817-4c38-8aeb-5a059765fd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:39.061166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1252/2540] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:39.062117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cdf7b-6b77-4aab-8fe9-42b1acaba93a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:39.072354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cdf7b-6b77-4aab-8fe9-42b1acaba93a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:39.077509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067a9cb-d7fb-4bb1-b95b-5aa687c84d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:39.078259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067a9cb-d7fb-4bb1-b95b-5aa687c84d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:39.078543 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067a9cb-d7fb-4bb1-b95b-5aa687c84d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:39.078818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067a9cb-d7fb-4bb1-b95b-5aa687c84d49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:39.079542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067a9cb-d7fb-4bb1-b95b-5aa687c84d49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:29:39.079847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067a9cb-d7fb-4bb1-b95b-5aa687c84d49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:39.081468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067a9cb-d7fb-4bb1-b95b-5aa687c84d49 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:39.093392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1289/2541] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:29:39.097720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b7d27-3817-4c38-8aeb-5a059765fd3a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:39.107524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b7d27-3817-4c38-8aeb-5a059765fd3a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:39.112145 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d0d78-9d71-495f-9598-d36ff263496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:39.112829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d0d78-9d71-495f-9598-d36ff263496b admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:39.113115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d0d78-9d71-495f-9598-d36ff263496b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:39.113386 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d0d78-9d71-495f-9598-d36ff263496b admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:39.114090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d0d78-9d71-495f-9598-d36ff263496b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:39.116020 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d0d78-9d71-495f-9598-d36ff263496b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:39.236393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1253/2542] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:29:39 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:39.240568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067a9cb-d7fb-4bb1-b95b-5aa687c84d49 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:39.251363 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067a9cb-d7fb-4bb1-b95b-5aa687c84d49 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:39.263950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:39.309767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcf3b9-13b6-442f-bc19-388452ed18de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:39.310447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf3b9-13b6-442f-bc19-388452ed18de admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:39.310735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf3b9-13b6-442f-bc19-388452ed18de admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:39.311017 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf3b9-13b6-442f-bc19-388452ed18de admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:39.311902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcf3b9-13b6-442f-bc19-388452ed18de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:39.313771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcf3b9-13b6-442f-bc19-388452ed18de admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:39.438488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1290/2543] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:29:39 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:39.439791 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d0d78-9d71-495f-9598-d36ff263496b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:39.451150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d0d78-9d71-495f-9598-d36ff263496b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:39.455856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d16b7-fcab-493f-8c8a-43e814dcc858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:39.456550 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d16b7-fcab-493f-8c8a-43e814dcc858 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:39.456834 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d16b7-fcab-493f-8c8a-43e814dcc858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:39.457111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d16b7-fcab-493f-8c8a-43e814dcc858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:39.457840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d16b7-fcab-493f-8c8a-43e814dcc858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:39.459432 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d16b7-fcab-493f-8c8a-43e814dcc858 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:39.472206 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1254/2544] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:39.476228 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcf3b9-13b6-442f-bc19-388452ed18de admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:39.488571 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcf3b9-13b6-442f-bc19-388452ed18de admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:39.494148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930b68d-4c04-4b66-a900-290cd859327f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:39.494856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930b68d-4c04-4b66-a900-290cd859327f admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:39.495144 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930b68d-4c04-4b66-a900-290cd859327f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:39.495698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930b68d-4c04-4b66-a900-290cd859327f admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:39.496584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930b68d-4c04-4b66-a900-290cd859327f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:39.498787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930b68d-4c04-4b66-a900-290cd859327f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:39.513108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1291/2545] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:39.517574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d16b7-fcab-493f-8c8a-43e814dcc858 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:39.528513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d16b7-fcab-493f-8c8a-43e814dcc858 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:39.533322 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a0fdc-142b-4cdb-872d-cbd10a45359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:39.534235 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a0fdc-142b-4cdb-872d-cbd10a45359a admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:39.534522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a0fdc-142b-4cdb-872d-cbd10a45359a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:39.534825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a0fdc-142b-4cdb-872d-cbd10a45359a admin admin] PATH_INFO: `/v3/projects/748e224dbf6a4998a1f50603091344e4/users/5911ec8267224bbaa32200ea267ae997/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:39.550804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a0fdc-142b-4cdb-872d-cbd10a45359a admin admin] RBAC: Authorizing `identity:create_grant(project_id=748e224dbf6a4998a1f50603091344e4, user_id=5911ec8267224bbaa32200ea267ae997, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:39.553605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a0fdc-142b-4cdb-872d-cbd10a45359a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:39.608755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1255/2546] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:39 2022] PUT /identity/v3/projects/748e224dbf6a4998a1f50603091344e4/users/5911ec8267224bbaa32200ea267ae997/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:39.619366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31735b-4dbf-436d-b2a2-b63e64479df7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:39.619681 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31735b-4dbf-436d-b2a2-b63e64479df7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:39.619946 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31735b-4dbf-436d-b2a2-b63e64479df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:39.648799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-df31735b-4dbf-436d-b2a2-b63e64479df7 None None] MFA Rules not processed for user `5911ec8267224bbaa32200ea267ae997`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:39.650101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-df31735b-4dbf-436d-b2a2-b63e64479df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:39.716530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1292/2547] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:39.728069 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a0fdc-142b-4cdb-872d-cbd10a45359a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:39.729822 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a72a0fdc-142b-4cdb-872d-cbd10a45359a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:39.796101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a0fdc-142b-4cdb-872d-cbd10a45359a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:39.800326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b8040-41a3-44e5-b8b3-c15e761e7eae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:39.801051 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b8040-41a3-44e5-b8b3-c15e761e7eae service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:39.801410 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b8040-41a3-44e5-b8b3-c15e761e7eae service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:39.801759 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b8040-41a3-44e5-b8b3-c15e761e7eae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:39.813226 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b8040-41a3-44e5-b8b3-c15e761e7eae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:39.814852 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b8040-41a3-44e5-b8b3-c15e761e7eae service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:39.831286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1256/2548] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:39.833073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb58b12-855a-473a-989d-32e13b44649c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:39.834093 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb58b12-855a-473a-989d-32e13b44649c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:39.834093 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb58b12-855a-473a-989d-32e13b44649c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:39.858714 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-bcb58b12-855a-473a-989d-32e13b44649c None None] MFA Rules not processed for user `594b7245d5e7439db9f1e7d117e0586a`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:39.860302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bcb58b12-855a-473a-989d-32e13b44649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:39.950394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1293/2549] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:49.820423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:49.942399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:50.225152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b8040-41a3-44e5-b8b3-c15e761e7eae service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:50.300867 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b8040-41a3-44e5-b8b3-c15e761e7eae service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:50.305702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701c020-4bf2-494d-89e4-e9d43c0da014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:50.306620 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701c020-4bf2-494d-89e4-e9d43c0da014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:50.306904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701c020-4bf2-494d-89e4-e9d43c0da014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:50.307181 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701c020-4bf2-494d-89e4-e9d43c0da014 admin admin] PATH_INFO: `/v3/users/5911ec8267224bbaa32200ea267ae997` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:50.309260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701c020-4bf2-494d-89e4-e9d43c0da014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5911ec8267224bbaa32200ea267ae997)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:50.311308 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701c020-4bf2-494d-89e4-e9d43c0da014 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:50.326383 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb58b12-855a-473a-989d-32e13b44649c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:50.328109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bcb58b12-855a-473a-989d-32e13b44649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:50.390898 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb58b12-855a-473a-989d-32e13b44649c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:50.394471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fcd78-0976-4b60-aa2c-b985d7429bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:50.395122 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fcd78-0976-4b60-aa2c-b985d7429bae service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:50.395405 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fcd78-0976-4b60-aa2c-b985d7429bae service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:50.395684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fcd78-0976-4b60-aa2c-b985d7429bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:50.397572 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-624fcd78-0976-4b60-aa2c-b985d7429bae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:50.409573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fcd78-0976-4b60-aa2c-b985d7429bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:50.411053 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fcd78-0976-4b60-aa2c-b985d7429bae service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:50.422154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1294/2550] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:29:50.447128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2701c020-4bf2-494d-89e4-e9d43c0da014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5911ec8267224bbaa32200ea267ae997'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:50.459336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2701c020-4bf2-494d-89e4-e9d43c0da014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5911ec8267224bbaa32200ea267ae997'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:50.460120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2701c020-4bf2-494d-89e4-e9d43c0da014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5911ec8267224bbaa32200ea267ae997'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:50.523891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2701c020-4bf2-494d-89e4-e9d43c0da014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5911ec8267224bbaa32200ea267ae997'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:50.524674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2701c020-4bf2-494d-89e4-e9d43c0da014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5911ec8267224bbaa32200ea267ae997'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:50.538875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1257/2551] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:29:50 2022] DELETE /identity/v3/users/5911ec8267224bbaa32200ea267ae997 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:50.543913 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dca7cb-848e-43ca-8c43-c6cc0c82e094 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:50.544240 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dca7cb-848e-43ca-8c43-c6cc0c82e094 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:50.544520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dca7cb-848e-43ca-8c43-c6cc0c82e094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:50.562325 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-02dca7cb-848e-43ca-8c43-c6cc0c82e094 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:50.563555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-02dca7cb-848e-43ca-8c43-c6cc0c82e094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:50.632178 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1295/2552] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:50.641469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701c020-4bf2-494d-89e4-e9d43c0da014 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:50.643032 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2701c020-4bf2-494d-89e4-e9d43c0da014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:50.703289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701c020-4bf2-494d-89e4-e9d43c0da014 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:50.706985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc73d82-2316-45f5-abb5-f1479c0292e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:50.707630 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc73d82-2316-45f5-abb5-f1479c0292e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:50.707914 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc73d82-2316-45f5-abb5-f1479c0292e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:50.708237 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc73d82-2316-45f5-abb5-f1479c0292e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:50.718090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc73d82-2316-45f5-abb5-f1479c0292e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:50.719532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc73d82-2316-45f5-abb5-f1479c0292e5 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:50.729150 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1258/2553] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:51.178049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dca7cb-848e-43ca-8c43-c6cc0c82e094 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:51.180106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-02dca7cb-848e-43ca-8c43-c6cc0c82e094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:51.209461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dca7cb-848e-43ca-8c43-c6cc0c82e094 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:51.214344 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b0e03-b0a4-4204-854a-4acebae08d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:51.225818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b0e03-b0a4-4204-854a-4acebae08d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:51.225818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b0e03-b0a4-4204-854a-4acebae08d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:51.225818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b0e03-b0a4-4204-854a-4acebae08d07 admin admin] PATH_INFO: `/v3/projects/748e224dbf6a4998a1f50603091344e4` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:51.225818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b0e03-b0a4-4204-854a-4acebae08d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=748e224dbf6a4998a1f50603091344e4)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:51.225818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b0e03-b0a4-4204-854a-4acebae08d07 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:51.392787 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-fb6b0e03-b0a4-4204-854a-4acebae08d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748e224dbf6a4998a1f50603091344e4', 'request_id': 'req-fb6b0e03-b0a4-4204-854a-4acebae08d07'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:51.465507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-fb6b0e03-b0a4-4204-854a-4acebae08d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748e224dbf6a4998a1f50603091344e4', 'request_id': 'req-fb6b0e03-b0a4-4204-854a-4acebae08d07'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:51.476698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-fb6b0e03-b0a4-4204-854a-4acebae08d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748e224dbf6a4998a1f50603091344e4', 'request_id': 'req-fb6b0e03-b0a4-4204-854a-4acebae08d07'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:51.489241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-fb6b0e03-b0a4-4204-854a-4acebae08d07 admin admin] The token cache is being invalidate because project 748e224dbf6a4998a1f50603091344e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:29:51.489900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-fb6b0e03-b0a4-4204-854a-4acebae08d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:51.490852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-fb6b0e03-b0a4-4204-854a-4acebae08d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:51.492592 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1296/2554] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:29:51 2022] DELETE /identity/v3/projects/748e224dbf6a4998a1f50603091344e4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:51.498198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a546f7-3b6d-4640-b3e3-39348540110e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:51.500268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a546f7-3b6d-4640-b3e3-39348540110e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:51.500268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a546f7-3b6d-4640-b3e3-39348540110e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:51.521064 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-78a546f7-3b6d-4640-b3e3-39348540110e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:51.522862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-78a546f7-3b6d-4640-b3e3-39348540110e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:51.543304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:51.607562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1259/2555] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:29:51.614977 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec1b0e-c370-447f-a445-8acb5b873e96 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:51.615469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec1b0e-c370-447f-a445-8acb5b873e96 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:51.615870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec1b0e-c370-447f-a445-8acb5b873e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:51.640605 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f8ec1b0e-c370-447f-a445-8acb5b873e96 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:51.642177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f8ec1b0e-c370-447f-a445-8acb5b873e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:51.652334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1297/2556] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:51.655633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a546f7-3b6d-4640-b3e3-39348540110e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:51.671496 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a546f7-3b6d-4640-b3e3-39348540110e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:51.677624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1159c-94b0-45fc-9a6f-d831c359bb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:51.678454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1159c-94b0-45fc-9a6f-d831c359bb4f admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:51.679030 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1159c-94b0-45fc-9a6f-d831c359bb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:51.679316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1159c-94b0-45fc-9a6f-d831c359bb4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:51.680139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1159c-94b0-45fc-9a6f-d831c359bb4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:29:51.680449 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1159c-94b0-45fc-9a6f-d831c359bb4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:51.682077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1159c-94b0-45fc-9a6f-d831c359bb4f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:51.695986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1260/2557] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:29:51.700286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec1b0e-c370-447f-a445-8acb5b873e96 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:51.710346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec1b0e-c370-447f-a445-8acb5b873e96 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:51.716128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8a098-308a-4b0e-9f38-e510994e89db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:51.716990 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8a098-308a-4b0e-9f38-e510994e89db admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:51.717281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8a098-308a-4b0e-9f38-e510994e89db admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:51.717562 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8a098-308a-4b0e-9f38-e510994e89db admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:51.718253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8a098-308a-4b0e-9f38-e510994e89db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:51.720183 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8a098-308a-4b0e-9f38-e510994e89db admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:51.840364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:51.848993 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1298/2558] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:29:51 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:29:51.853097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1159c-94b0-45fc-9a6f-d831c359bb4f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:51.863381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1159c-94b0-45fc-9a6f-d831c359bb4f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:51.929839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3d223-269a-46f7-9f4a-6959744612ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:51.930761 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3d223-269a-46f7-9f4a-6959744612ab admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:51.931111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3d223-269a-46f7-9f4a-6959744612ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:51.931474 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3d223-269a-46f7-9f4a-6959744612ab admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:51.932459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3d223-269a-46f7-9f4a-6959744612ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:51.934817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3d223-269a-46f7-9f4a-6959744612ab admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:52.081215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1261/2559] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:29:51 2022] POST /identity/v3/users => generated 290 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:29:52.086275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8a098-308a-4b0e-9f38-e510994e89db admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:52.097489 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8a098-308a-4b0e-9f38-e510994e89db admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:52.102542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022abaa6-a1a6-40e3-a51d-659a37e79765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:52.103225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022abaa6-a1a6-40e3-a51d-659a37e79765 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:52.103513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022abaa6-a1a6-40e3-a51d-659a37e79765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:52.103790 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022abaa6-a1a6-40e3-a51d-659a37e79765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:52.104732 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022abaa6-a1a6-40e3-a51d-659a37e79765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:52.106471 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022abaa6-a1a6-40e3-a51d-659a37e79765 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:52.117905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1299/2560] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:52.121886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3d223-269a-46f7-9f4a-6959744612ab admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:52.135295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3d223-269a-46f7-9f4a-6959744612ab admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:52.141382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4f56d-8975-47b6-8509-ce4e762cb76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:52.142283 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4f56d-8975-47b6-8509-ce4e762cb76e admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:52.142756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4f56d-8975-47b6-8509-ce4e762cb76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:52.143188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4f56d-8975-47b6-8509-ce4e762cb76e admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:52.144160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4f56d-8975-47b6-8509-ce4e762cb76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:52.147884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4f56d-8975-47b6-8509-ce4e762cb76e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:52.160485 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1262/2561] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:52.164916 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022abaa6-a1a6-40e3-a51d-659a37e79765 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:52.175826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022abaa6-a1a6-40e3-a51d-659a37e79765 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:52.180574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6806eb-36a1-4b24-8af8-7c9f16f695a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:52.181466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6806eb-36a1-4b24-8af8-7c9f16f695a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:52.181768 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6806eb-36a1-4b24-8af8-7c9f16f695a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:52.182015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6806eb-36a1-4b24-8af8-7c9f16f695a8 admin admin] PATH_INFO: `/v3/projects/01f5e9a875024ac0aef3caf61a88f360/users/c0ba7804839d4307b7039bd25d3be24e/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:52.198066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6806eb-36a1-4b24-8af8-7c9f16f695a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f5e9a875024ac0aef3caf61a88f360, user_id=c0ba7804839d4307b7039bd25d3be24e, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:52.201568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6806eb-36a1-4b24-8af8-7c9f16f695a8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:52.301347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1300/2562] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:52 2022] PUT /identity/v3/projects/01f5e9a875024ac0aef3caf61a88f360/users/c0ba7804839d4307b7039bd25d3be24e/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:52.312229 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a2765-b57e-47d9-aee4-e9ea0527a016 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:52.312595 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a2765-b57e-47d9-aee4-e9ea0527a016 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:52.312943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a2765-b57e-47d9-aee4-e9ea0527a016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:52.345680 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1c5a2765-b57e-47d9-aee4-e9ea0527a016 None None] MFA Rules not processed for user `c0ba7804839d4307b7039bd25d3be24e`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:52.346894 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1c5a2765-b57e-47d9-aee4-e9ea0527a016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:52.434332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1263/2563] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:52.435834 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6806eb-36a1-4b24-8af8-7c9f16f695a8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:52.521817 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6806eb-36a1-4b24-8af8-7c9f16f695a8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:52.532445 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080918f-dfc5-41fb-85b1-9e1647dfb9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:52.533392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080918f-dfc5-41fb-85b1-9e1647dfb9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:52.534206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080918f-dfc5-41fb-85b1-9e1647dfb9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:52.534506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080918f-dfc5-41fb-85b1-9e1647dfb9d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:52.536021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080918f-dfc5-41fb-85b1-9e1647dfb9d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:52.538347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080918f-dfc5-41fb-85b1-9e1647dfb9d9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:52.610594 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1301/2564] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:29:52 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:52.611962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a2765-b57e-47d9-aee4-e9ea0527a016 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:52.624502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a2765-b57e-47d9-aee4-e9ea0527a016 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:52.639521 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:52.691570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7dc87-82c7-4358-8c61-73ae60ab1870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:52.692387 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7dc87-82c7-4358-8c61-73ae60ab1870 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:52.692737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7dc87-82c7-4358-8c61-73ae60ab1870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:52.693079 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7dc87-82c7-4358-8c61-73ae60ab1870 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:52.693956 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7dc87-82c7-4358-8c61-73ae60ab1870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:52.696300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7dc87-82c7-4358-8c61-73ae60ab1870 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:52.818376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1264/2565] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:29:52 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:52.822728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080918f-dfc5-41fb-85b1-9e1647dfb9d9 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:52.833424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080918f-dfc5-41fb-85b1-9e1647dfb9d9 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:52.841182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97360df5-dcf5-4929-9d33-eafa202f739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:52.841943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97360df5-dcf5-4929-9d33-eafa202f739a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:52.842272 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97360df5-dcf5-4929-9d33-eafa202f739a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:52.842671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97360df5-dcf5-4929-9d33-eafa202f739a admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:52.843488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97360df5-dcf5-4929-9d33-eafa202f739a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:52.845241 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97360df5-dcf5-4929-9d33-eafa202f739a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:52.858068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1302/2566] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:52.862391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7dc87-82c7-4358-8c61-73ae60ab1870 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:52.877420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7dc87-82c7-4358-8c61-73ae60ab1870 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:52.883338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcde16-6df7-472f-9628-d3721caa552f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:52.884627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcde16-6df7-472f-9628-d3721caa552f admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:52.885130 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcde16-6df7-472f-9628-d3721caa552f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:52.885716 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcde16-6df7-472f-9628-d3721caa552f admin admin] PATH_INFO: `/v3/projects/de5eeb0729f54c1ba940c9dcbd3b9f3e/users/d516aad7ecb94d5ebd8335fadb7276d3/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:52.904100 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcde16-6df7-472f-9628-d3721caa552f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5eeb0729f54c1ba940c9dcbd3b9f3e, user_id=d516aad7ecb94d5ebd8335fadb7276d3, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:52.908394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcde16-6df7-472f-9628-d3721caa552f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:53.038195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1265/2567] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:52 2022] PUT /identity/v3/projects/de5eeb0729f54c1ba940c9dcbd3b9f3e/users/d516aad7ecb94d5ebd8335fadb7276d3/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:53.043225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97360df5-dcf5-4929-9d33-eafa202f739a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:53.066558 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97360df5-dcf5-4929-9d33-eafa202f739a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:53.177074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e9b9b-aae6-4d1f-b0f7-212f473b07e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:53.178030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e9b9b-aae6-4d1f-b0f7-212f473b07e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:53.178030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e9b9b-aae6-4d1f-b0f7-212f473b07e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:53.178239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e9b9b-aae6-4d1f-b0f7-212f473b07e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:53.178943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e9b9b-aae6-4d1f-b0f7-212f473b07e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:53.180615 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e9b9b-aae6-4d1f-b0f7-212f473b07e9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:53.194411 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1303/2568] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:53.195725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcde16-6df7-472f-9628-d3721caa552f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:53.211462 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcde16-6df7-472f-9628-d3721caa552f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:53.219598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda10be7-d4ef-49b5-b19a-837a450d618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:53.221506 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda10be7-d4ef-49b5-b19a-837a450d618c admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:53.222208 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda10be7-d4ef-49b5-b19a-837a450d618c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:53.223693 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda10be7-d4ef-49b5-b19a-837a450d618c admin admin] PATH_INFO: `/v3/projects/de5eeb0729f54c1ba940c9dcbd3b9f3e/users/d516aad7ecb94d5ebd8335fadb7276d3/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:53.224690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda10be7-d4ef-49b5-b19a-837a450d618c admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5eeb0729f54c1ba940c9dcbd3b9f3e, user_id=d516aad7ecb94d5ebd8335fadb7276d3, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:53.228777 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda10be7-d4ef-49b5-b19a-837a450d618c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:53.240429 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1266/2569] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:53 2022] PUT /identity/v3/projects/de5eeb0729f54c1ba940c9dcbd3b9f3e/users/d516aad7ecb94d5ebd8335fadb7276d3/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:53.252090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5866ef-3023-4a78-954b-12a2f0f1ca82 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:53.252390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5866ef-3023-4a78-954b-12a2f0f1ca82 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:53.252671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5866ef-3023-4a78-954b-12a2f0f1ca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:53.280214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-6e5866ef-3023-4a78-954b-12a2f0f1ca82 None None] MFA Rules not processed for user `d516aad7ecb94d5ebd8335fadb7276d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:53.281496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6e5866ef-3023-4a78-954b-12a2f0f1ca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:53.356532 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1304/2570] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:53.367593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda10be7-d4ef-49b5-b19a-837a450d618c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:53.369347 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-dda10be7-d4ef-49b5-b19a-837a450d618c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:53.458398 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda10be7-d4ef-49b5-b19a-837a450d618c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:53.469919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf5489-08ca-4a9b-aaff-8db7719ee589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:53.470795 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf5489-08ca-4a9b-aaff-8db7719ee589 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:53.471199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf5489-08ca-4a9b-aaff-8db7719ee589 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:53.471583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf5489-08ca-4a9b-aaff-8db7719ee589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:53.487430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf5489-08ca-4a9b-aaff-8db7719ee589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:53.489633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf5489-08ca-4a9b-aaff-8db7719ee589 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:53.516117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1267/2571] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:53.593323 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:53.778087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5866ef-3023-4a78-954b-12a2f0f1ca82 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:53.788435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5866ef-3023-4a78-954b-12a2f0f1ca82 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:53.795106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52c457-90e6-40c9-9d7c-580cf7806184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:53.795106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52c457-90e6-40c9-9d7c-580cf7806184 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:53.795106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52c457-90e6-40c9-9d7c-580cf7806184 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:53.795106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52c457-90e6-40c9-9d7c-580cf7806184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:53.851608 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52c457-90e6-40c9-9d7c-580cf7806184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:53.853115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52c457-90e6-40c9-9d7c-580cf7806184 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:53.862322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1305/2572] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:54.639779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf5489-08ca-4a9b-aaff-8db7719ee589 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:54.641268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2dbf5489-08ca-4a9b-aaff-8db7719ee589 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:54.712920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf5489-08ca-4a9b-aaff-8db7719ee589 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:54.717466 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f8bfd-d776-4522-b743-dad6a4734971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:54.718361 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f8bfd-d776-4522-b743-dad6a4734971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:54.718642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f8bfd-d776-4522-b743-dad6a4734971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:54.718916 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f8bfd-d776-4522-b743-dad6a4734971 admin admin] PATH_INFO: `/v3/users/3af2be9c1e9a4f0c8f4bdaa04769756c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:54.720151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f8bfd-d776-4522-b743-dad6a4734971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3af2be9c1e9a4f0c8f4bdaa04769756c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:54.722090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f8bfd-d776-4522-b743-dad6a4734971 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:54.740526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:54.921466 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-751f8bfd-d776-4522-b743-dad6a4734971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3af2be9c1e9a4f0c8f4bdaa04769756c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:54.934108 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-751f8bfd-d776-4522-b743-dad6a4734971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3af2be9c1e9a4f0c8f4bdaa04769756c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:54.934796 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-751f8bfd-d776-4522-b743-dad6a4734971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3af2be9c1e9a4f0c8f4bdaa04769756c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:55.014621 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-751f8bfd-d776-4522-b743-dad6a4734971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3af2be9c1e9a4f0c8f4bdaa04769756c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:55.015175 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-751f8bfd-d776-4522-b743-dad6a4734971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3af2be9c1e9a4f0c8f4bdaa04769756c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:55.028092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1268/2573] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:29:54 2022] DELETE /identity/v3/users/3af2be9c1e9a4f0c8f4bdaa04769756c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:55.318326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52c457-90e6-40c9-9d7c-580cf7806184 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:55.335743 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52c457-90e6-40c9-9d7c-580cf7806184 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:55.396615 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2198da-29eb-474d-803f-1c7b5e349d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:55.397476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2198da-29eb-474d-803f-1c7b5e349d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:55.397758 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2198da-29eb-474d-803f-1c7b5e349d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:55.398033 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2198da-29eb-474d-803f-1c7b5e349d22 admin admin] PATH_INFO: `/v3/projects/8c94fadce7d54958a58c5a0f31ee7341` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:55.399212 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2198da-29eb-474d-803f-1c7b5e349d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c94fadce7d54958a58c5a0f31ee7341)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:55.402048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2198da-29eb-474d-803f-1c7b5e349d22 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:55.495194 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f2198da-29eb-474d-803f-1c7b5e349d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c94fadce7d54958a58c5a0f31ee7341', 'request_id': 'req-0f2198da-29eb-474d-803f-1c7b5e349d22'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:55.559556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f2198da-29eb-474d-803f-1c7b5e349d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c94fadce7d54958a58c5a0f31ee7341', 'request_id': 'req-0f2198da-29eb-474d-803f-1c7b5e349d22'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:55.561154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:55.567698 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f2198da-29eb-474d-803f-1c7b5e349d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c94fadce7d54958a58c5a0f31ee7341', 'request_id': 'req-0f2198da-29eb-474d-803f-1c7b5e349d22'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:55.581867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f2198da-29eb-474d-803f-1c7b5e349d22 admin admin] The token cache is being invalidate because project 8c94fadce7d54958a58c5a0f31ee7341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:29:55.582617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f2198da-29eb-474d-803f-1c7b5e349d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:55.582949 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f2198da-29eb-474d-803f-1c7b5e349d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:55.584986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1306/2574] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:29:55 2022] DELETE /identity/v3/projects/8c94fadce7d54958a58c5a0f31ee7341 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:55.591513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b326e3-2943-4f93-a8ab-66b4a9f4e58d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:55.591513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b326e3-2943-4f93-a8ab-66b4a9f4e58d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:55.591513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b326e3-2943-4f93-a8ab-66b4a9f4e58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:55.621804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-31b326e3-2943-4f93-a8ab-66b4a9f4e58d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:55.623045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-31b326e3-2943-4f93-a8ab-66b4a9f4e58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:55.692154 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1269/2575] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:55.701150 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d4b4-0dda-4b0a-9a3d-9996f9aa4372 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:55.701700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d4b4-0dda-4b0a-9a3d-9996f9aa4372 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:55.702256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d4b4-0dda-4b0a-9a3d-9996f9aa4372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:55.722839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-41e4d4b4-0dda-4b0a-9a3d-9996f9aa4372 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:55.724210 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-41e4d4b4-0dda-4b0a-9a3d-9996f9aa4372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:55.736117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1307/2576] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:55.737389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b326e3-2943-4f93-a8ab-66b4a9f4e58d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:55.749481 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b326e3-2943-4f93-a8ab-66b4a9f4e58d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:55.754402 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af0f9f-32da-4433-8632-3ead8c3735ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:55.755166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af0f9f-32da-4433-8632-3ead8c3735ec admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:55.755449 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af0f9f-32da-4433-8632-3ead8c3735ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:55.755726 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af0f9f-32da-4433-8632-3ead8c3735ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:55.756527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af0f9f-32da-4433-8632-3ead8c3735ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:29:55.756857 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af0f9f-32da-4433-8632-3ead8c3735ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:55.758458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af0f9f-32da-4433-8632-3ead8c3735ec admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:55.771026 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1270/2577] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:29:55.775545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4d4b4-0dda-4b0a-9a3d-9996f9aa4372 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:55.785799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4d4b4-0dda-4b0a-9a3d-9996f9aa4372 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:55.790891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37387a54-d506-4fee-b6e9-760645267140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:55.791611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37387a54-d506-4fee-b6e9-760645267140 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:55.793496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37387a54-d506-4fee-b6e9-760645267140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:55.793496 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37387a54-d506-4fee-b6e9-760645267140 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:55.793717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37387a54-d506-4fee-b6e9-760645267140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:55.795664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37387a54-d506-4fee-b6e9-760645267140 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:55.811117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af0f9f-32da-4433-8632-3ead8c3735ec admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:55.813585 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-16af0f9f-32da-4433-8632-3ead8c3735ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:55.827499 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af0f9f-32da-4433-8632-3ead8c3735ec admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:55.832544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbead2e-ca84-4f53-ae3a-cb6cb2b028d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:55.833463 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbead2e-ca84-4f53-ae3a-cb6cb2b028d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:55.833815 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbead2e-ca84-4f53-ae3a-cb6cb2b028d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:55.834049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbead2e-ca84-4f53-ae3a-cb6cb2b028d8 admin admin] PATH_INFO: `/v3/users/4bb943767c574a379ecfec222ff58a78` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:55.835245 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbead2e-ca84-4f53-ae3a-cb6cb2b028d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb943767c574a379ecfec222ff58a78)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:55.837247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbead2e-ca84-4f53-ae3a-cb6cb2b028d8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:55.892641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1308/2578] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:29:55 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:55.898384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37387a54-d506-4fee-b6e9-760645267140 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:55.969026 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37387a54-d506-4fee-b6e9-760645267140 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:55.973673 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014f73f-5c49-4ace-a9d3-005131c0b73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:55.975929 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014f73f-5c49-4ace-a9d3-005131c0b73c admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:55.975929 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014f73f-5c49-4ace-a9d3-005131c0b73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:55.975929 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014f73f-5c49-4ace-a9d3-005131c0b73c admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:55.975929 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014f73f-5c49-4ace-a9d3-005131c0b73c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:55.977453 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014f73f-5c49-4ace-a9d3-005131c0b73c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:56.024973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5cbead2e-ca84-4f53-ae3a-cb6cb2b028d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb943767c574a379ecfec222ff58a78'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:56.037122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5cbead2e-ca84-4f53-ae3a-cb6cb2b028d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb943767c574a379ecfec222ff58a78'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:56.039327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5cbead2e-ca84-4f53-ae3a-cb6cb2b028d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb943767c574a379ecfec222ff58a78'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:56.064060 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1309/2579] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:29:55 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:29:56.068253 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014f73f-5c49-4ace-a9d3-005131c0b73c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:56.070127 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c014f73f-5c49-4ace-a9d3-005131c0b73c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:56.083139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014f73f-5c49-4ace-a9d3-005131c0b73c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:56.088574 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875001c0-81b7-4384-877a-260c8863caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:56.089290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875001c0-81b7-4384-877a-260c8863caf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:56.089619 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875001c0-81b7-4384-877a-260c8863caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:56.089902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875001c0-81b7-4384-877a-260c8863caf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:56.090851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875001c0-81b7-4384-877a-260c8863caf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:56.092373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875001c0-81b7-4384-877a-260c8863caf1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:56.105599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1310/2580] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:29:56.111156 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875001c0-81b7-4384-877a-260c8863caf1 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:56.122824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875001c0-81b7-4384-877a-260c8863caf1 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:56.127593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c6614-25bc-4483-a2b0-72d1050ea5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:56.128486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c6614-25bc-4483-a2b0-72d1050ea5df admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:56.128772 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c6614-25bc-4483-a2b0-72d1050ea5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:56.132656 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c6614-25bc-4483-a2b0-72d1050ea5df admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:56.132940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5cbead2e-ca84-4f53-ae3a-cb6cb2b028d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb943767c574a379ecfec222ff58a78'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:56.133057 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c6614-25bc-4483-a2b0-72d1050ea5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:56.133148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5cbead2e-ca84-4f53-ae3a-cb6cb2b028d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb943767c574a379ecfec222ff58a78'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:56.133236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c6614-25bc-4483-a2b0-72d1050ea5df admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:56.133323 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:56.144638 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1311/2581] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:56.148829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c6614-25bc-4483-a2b0-72d1050ea5df admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:56.150114 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1271/2582] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:29:55 2022] DELETE /identity/v3/users/4bb943767c574a379ecfec222ff58a78 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:56.155045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4209-b316-4be9-9865-252a4f2abccb None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:56.155341 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4209-b316-4be9-9865-252a4f2abccb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:56.158145 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4209-b316-4be9-9865-252a4f2abccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:56.166374 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c6614-25bc-4483-a2b0-72d1050ea5df admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:56.178814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7f1a4209-b316-4be9-9865-252a4f2abccb None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:56.180076 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7f1a4209-b316-4be9-9865-252a4f2abccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:56.246784 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa9b07-6ea9-46f3-8433-33f000ec9790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:56.247822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa9b07-6ea9-46f3-8433-33f000ec9790 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:56.248221 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa9b07-6ea9-46f3-8433-33f000ec9790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:56.248504 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa9b07-6ea9-46f3-8433-33f000ec9790 admin admin] PATH_INFO: `/v3/projects/18276a4e9b824e6a9e25a313e1102f0e/users/966fcc3a4f2c42069c41746dd4ad85c0/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:56.265453 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1272/2583] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:56.275324 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a4209-b316-4be9-9865-252a4f2abccb None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:56.277644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7f1a4209-b316-4be9-9865-252a4f2abccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:56.278507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa9b07-6ea9-46f3-8433-33f000ec9790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18276a4e9b824e6a9e25a313e1102f0e, user_id=966fcc3a4f2c42069c41746dd4ad85c0, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:56.281357 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa9b07-6ea9-46f3-8433-33f000ec9790 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:56.340361 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a4209-b316-4be9-9865-252a4f2abccb None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:56.344012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47086b3e-4f68-4ee1-a757-100d54c9140b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:56.344666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086b3e-4f68-4ee1-a757-100d54c9140b service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:56.344960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086b3e-4f68-4ee1-a757-100d54c9140b service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:56.345228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086b3e-4f68-4ee1-a757-100d54c9140b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:56.355014 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47086b3e-4f68-4ee1-a757-100d54c9140b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:56.356518 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47086b3e-4f68-4ee1-a757-100d54c9140b service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:56.366183 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1273/2584] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:29:56.382316 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1312/2585] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:56 2022] PUT /identity/v3/projects/18276a4e9b824e6a9e25a313e1102f0e/users/966fcc3a4f2c42069c41746dd4ad85c0/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:29:56.392940 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0541cd1-f175-49cc-85ab-3f655c4456dc None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:56.393234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0541cd1-f175-49cc-85ab-3f655c4456dc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:56.393544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0541cd1-f175-49cc-85ab-3f655c4456dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:56.421117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a0541cd1-f175-49cc-85ab-3f655c4456dc None None] MFA Rules not processed for user `966fcc3a4f2c42069c41746dd4ad85c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:56.422610 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a0541cd1-f175-49cc-85ab-3f655c4456dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:56.494746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1274/2586] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:56.506275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa9b07-6ea9-46f3-8433-33f000ec9790 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:56.508015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-61aa9b07-6ea9-46f3-8433-33f000ec9790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:56.519625 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:56.583099 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa9b07-6ea9-46f3-8433-33f000ec9790 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:56.591052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbac484-445c-43f2-91b4-e016b080a38a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:56.591667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbac484-445c-43f2-91b4-e016b080a38a service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:56.591954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbac484-445c-43f2-91b4-e016b080a38a service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:56.592421 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbac484-445c-43f2-91b4-e016b080a38a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:56.603375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbac484-445c-43f2-91b4-e016b080a38a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:56.604993 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbac484-445c-43f2-91b4-e016b080a38a service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:56.614414 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1313/2587] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:56.778403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0541cd1-f175-49cc-85ab-3f655c4456dc None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:56.780228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a0541cd1-f175-49cc-85ab-3f655c4456dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:56.826048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:56.864983 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbac484-445c-43f2-91b4-e016b080a38a service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:56.869166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0541cd1-f175-49cc-85ab-3f655c4456dc None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:56.871697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbac484-445c-43f2-91b4-e016b080a38a service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:56.875020 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c31c4e-676d-463a-ae58-c6fae207d9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:56.876182 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c31c4e-676d-463a-ae58-c6fae207d9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:56.876533 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c31c4e-676d-463a-ae58-c6fae207d9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:56.876661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee0ba1-1a22-4f13-a89c-d1c992668eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:56.876932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c31c4e-676d-463a-ae58-c6fae207d9d9 admin admin] PATH_INFO: `/v3/projects/5fb8d9beeb8d48cdb70d486b0bb4a1af` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:56.877438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee0ba1-1a22-4f13-a89c-d1c992668eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:56.877967 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee0ba1-1a22-4f13-a89c-d1c992668eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:56.878257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee0ba1-1a22-4f13-a89c-d1c992668eb7 admin admin] PATH_INFO: `/v3/users/966fcc3a4f2c42069c41746dd4ad85c0` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:56.879541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee0ba1-1a22-4f13-a89c-d1c992668eb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966fcc3a4f2c42069c41746dd4ad85c0)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:56.881561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee0ba1-1a22-4f13-a89c-d1c992668eb7 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:56.881960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c31c4e-676d-463a-ae58-c6fae207d9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb8d9beeb8d48cdb70d486b0bb4a1af)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:56.884121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c31c4e-676d-463a-ae58-c6fae207d9d9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:57.097994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86ee0ba1-1a22-4f13-a89c-d1c992668eb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966fcc3a4f2c42069c41746dd4ad85c0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:57.098557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c4c31c4e-676d-463a-ae58-c6fae207d9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb8d9beeb8d48cdb70d486b0bb4a1af', 'request_id': 'req-c4c31c4e-676d-463a-ae58-c6fae207d9d9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:57.112708 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86ee0ba1-1a22-4f13-a89c-d1c992668eb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966fcc3a4f2c42069c41746dd4ad85c0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:57.175318 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c4c31c4e-676d-463a-ae58-c6fae207d9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb8d9beeb8d48cdb70d486b0bb4a1af', 'request_id': 'req-c4c31c4e-676d-463a-ae58-c6fae207d9d9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:57.181399 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c4c31c4e-676d-463a-ae58-c6fae207d9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb8d9beeb8d48cdb70d486b0bb4a1af', 'request_id': 'req-c4c31c4e-676d-463a-ae58-c6fae207d9d9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:57.193450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c4c31c4e-676d-463a-ae58-c6fae207d9d9 admin admin] The token cache is being invalidate because project 5fb8d9beeb8d48cdb70d486b0bb4a1af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:29:57.193741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c4c31c4e-676d-463a-ae58-c6fae207d9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:57.194634 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c4c31c4e-676d-463a-ae58-c6fae207d9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:57.196206 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1275/2588] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:29:56 2022] DELETE /identity/v3/projects/5fb8d9beeb8d48cdb70d486b0bb4a1af => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:57.200816 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755a70f-5cc3-4dfd-bb44-d890a344833b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:57.201103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755a70f-5cc3-4dfd-bb44-d890a344833b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:57.201381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755a70f-5cc3-4dfd-bb44-d890a344833b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:57.220059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5755a70f-5cc3-4dfd-bb44-d890a344833b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:57.221321 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5755a70f-5cc3-4dfd-bb44-d890a344833b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:57.266878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86ee0ba1-1a22-4f13-a89c-d1c992668eb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966fcc3a4f2c42069c41746dd4ad85c0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:57.267550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86ee0ba1-1a22-4f13-a89c-d1c992668eb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966fcc3a4f2c42069c41746dd4ad85c0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:57.282877 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86ee0ba1-1a22-4f13-a89c-d1c992668eb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966fcc3a4f2c42069c41746dd4ad85c0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:57.289478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1314/2589] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:29:56 2022] DELETE /identity/v3/users/966fcc3a4f2c42069c41746dd4ad85c0 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:29:57.290310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1276/2590] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:29:57.297029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817176a3-67a7-4877-8301-6fb3aa7d75ae None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:57.297029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817176a3-67a7-4877-8301-6fb3aa7d75ae None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:57.297029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817176a3-67a7-4877-8301-6fb3aa7d75ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:57.298478 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042ef96-89c2-4b7e-a3c5-af1004d6e449 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:57.298630 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042ef96-89c2-4b7e-a3c5-af1004d6e449 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:57.298941 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042ef96-89c2-4b7e-a3c5-af1004d6e449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:57.314058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-817176a3-67a7-4877-8301-6fb3aa7d75ae None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:57.315283 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-817176a3-67a7-4877-8301-6fb3aa7d75ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:57.320202 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c042ef96-89c2-4b7e-a3c5-af1004d6e449 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:57.322560 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c042ef96-89c2-4b7e-a3c5-af1004d6e449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:57.382765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:57.390020 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1315/2591] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:57.394594 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1277/2592] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:57.398837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817176a3-67a7-4877-8301-6fb3aa7d75ae None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:57.403286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042ef96-89c2-4b7e-a3c5-af1004d6e449 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:57.405802 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c042ef96-89c2-4b7e-a3c5-af1004d6e449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:57.411027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817176a3-67a7-4877-8301-6fb3aa7d75ae None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:57.416488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5f95e-4d59-4106-9e3a-5a1e6fb2766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:57.417867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5f95e-4d59-4106-9e3a-5a1e6fb2766f admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:57.418160 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5f95e-4d59-4106-9e3a-5a1e6fb2766f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:57.418522 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5f95e-4d59-4106-9e3a-5a1e6fb2766f admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:57.419154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5f95e-4d59-4106-9e3a-5a1e6fb2766f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:29:57.419461 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5f95e-4d59-4106-9e3a-5a1e6fb2766f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:57.421388 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5f95e-4d59-4106-9e3a-5a1e6fb2766f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:57.424202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:57.440644 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1316/2593] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:29:57.441672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5f95e-4d59-4106-9e3a-5a1e6fb2766f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:57.451933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5f95e-4d59-4106-9e3a-5a1e6fb2766f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:57.457132 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24985b09-cc25-4ecd-9d44-684201b93c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:57.457961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24985b09-cc25-4ecd-9d44-684201b93c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:57.458320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24985b09-cc25-4ecd-9d44-684201b93c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:57.458666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24985b09-cc25-4ecd-9d44-684201b93c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:57.459429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24985b09-cc25-4ecd-9d44-684201b93c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:57.461516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24985b09-cc25-4ecd-9d44-684201b93c7b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:57.473633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042ef96-89c2-4b7e-a3c5-af1004d6e449 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:57.477729 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be110d09-04a2-4e08-afdf-f3aea2ecb63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:57.478377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be110d09-04a2-4e08-afdf-f3aea2ecb63b service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:57.478863 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be110d09-04a2-4e08-afdf-f3aea2ecb63b service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:57.479149 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be110d09-04a2-4e08-afdf-f3aea2ecb63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:57.490225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be110d09-04a2-4e08-afdf-f3aea2ecb63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:57.491705 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be110d09-04a2-4e08-afdf-f3aea2ecb63b service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:57.501607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1278/2594] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:29:57.551954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1317/2595] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:29:57 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:29:57.553189 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be110d09-04a2-4e08-afdf-f3aea2ecb63b service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:57.564159 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be110d09-04a2-4e08-afdf-f3aea2ecb63b service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:57.625662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97105731-bb7e-4af1-9d12-493c5eadf47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:57.626336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97105731-bb7e-4af1-9d12-493c5eadf47f admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:57.626623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97105731-bb7e-4af1-9d12-493c5eadf47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:57.626899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97105731-bb7e-4af1-9d12-493c5eadf47f admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:57.627596 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97105731-bb7e-4af1-9d12-493c5eadf47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:57.629557 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97105731-bb7e-4af1-9d12-493c5eadf47f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:57.752026 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1279/2596] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:29:57 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:29:57.752745 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24985b09-cc25-4ecd-9d44-684201b93c7b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:57.762906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24985b09-cc25-4ecd-9d44-684201b93c7b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:57.768898 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa742d0c-3699-4b2e-8b7c-8c3c00dafaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:57.769662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa742d0c-3699-4b2e-8b7c-8c3c00dafaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:57.770022 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa742d0c-3699-4b2e-8b7c-8c3c00dafaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:57.770396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa742d0c-3699-4b2e-8b7c-8c3c00dafaa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:57.771360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa742d0c-3699-4b2e-8b7c-8c3c00dafaa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:57.773111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa742d0c-3699-4b2e-8b7c-8c3c00dafaa0 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:57.784675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1318/2597] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:57.788845 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97105731-bb7e-4af1-9d12-493c5eadf47f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:57.800159 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97105731-bb7e-4af1-9d12-493c5eadf47f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:57.805875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c38f5f-b4b3-44b3-8dba-6e0262b40683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:57.806572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c38f5f-b4b3-44b3-8dba-6e0262b40683 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:57.806859 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c38f5f-b4b3-44b3-8dba-6e0262b40683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:57.807141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c38f5f-b4b3-44b3-8dba-6e0262b40683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:57.807989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c38f5f-b4b3-44b3-8dba-6e0262b40683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:57.809646 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c38f5f-b4b3-44b3-8dba-6e0262b40683 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:57.824918 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1280/2598] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:57.826479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa742d0c-3699-4b2e-8b7c-8c3c00dafaa0 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:57.836578 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa742d0c-3699-4b2e-8b7c-8c3c00dafaa0 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:57.841910 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7da50-cf02-4e53-bdcb-b5412c5da68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:57.842828 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7da50-cf02-4e53-bdcb-b5412c5da68a admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:57.843312 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7da50-cf02-4e53-bdcb-b5412c5da68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:57.843595 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7da50-cf02-4e53-bdcb-b5412c5da68a admin admin] PATH_INFO: `/v3/projects/15835916927248f78c942aa08eeca533/users/884062c855394418a1be82ea201a1448/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:57.866174 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7da50-cf02-4e53-bdcb-b5412c5da68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15835916927248f78c942aa08eeca533, user_id=884062c855394418a1be82ea201a1448, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:57.868996 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7da50-cf02-4e53-bdcb-b5412c5da68a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:57.936907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c38f5f-b4b3-44b3-8dba-6e0262b40683 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:57.938808 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-77c38f5f-b4b3-44b3-8dba-6e0262b40683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:57.954089 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c38f5f-b4b3-44b3-8dba-6e0262b40683 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:57.954799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1319/2599] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:57 2022] PUT /identity/v3/projects/15835916927248f78c942aa08eeca533/users/884062c855394418a1be82ea201a1448/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:57.966054 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bbe27-99b5-4399-b14e-a129a4432e6b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:57.966380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bbe27-99b5-4399-b14e-a129a4432e6b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:57.966667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bbe27-99b5-4399-b14e-a129a4432e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:57.997730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2f3bbe27-99b5-4399-b14e-a129a4432e6b None None] MFA Rules not processed for user `884062c855394418a1be82ea201a1448`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:57.999169 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2f3bbe27-99b5-4399-b14e-a129a4432e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:58.024962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5861f-6be1-48c4-9751-74446868b755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:58.025924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5861f-6be1-48c4-9751-74446868b755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:58.027230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5861f-6be1-48c4-9751-74446868b755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:58.027230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5861f-6be1-48c4-9751-74446868b755 admin admin] PATH_INFO: `/v3/projects/18276a4e9b824e6a9e25a313e1102f0e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:58.028584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5861f-6be1-48c4-9751-74446868b755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18276a4e9b824e6a9e25a313e1102f0e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:58.030531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5861f-6be1-48c4-9751-74446868b755 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:58.052194 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:58.081564 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1320/2600] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:29:58.093300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bbe27-99b5-4399-b14e-a129a4432e6b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:58.094682 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2f3bbe27-99b5-4399-b14e-a129a4432e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:58.131092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ded5861f-6be1-48c4-9751-74446868b755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18276a4e9b824e6a9e25a313e1102f0e', 'request_id': 'req-ded5861f-6be1-48c4-9751-74446868b755'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:58.158869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bbe27-99b5-4399-b14e-a129a4432e6b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:58.197619 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ded5861f-6be1-48c4-9751-74446868b755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18276a4e9b824e6a9e25a313e1102f0e', 'request_id': 'req-ded5861f-6be1-48c4-9751-74446868b755'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:58.198979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:58.204944 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ded5861f-6be1-48c4-9751-74446868b755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18276a4e9b824e6a9e25a313e1102f0e', 'request_id': 'req-ded5861f-6be1-48c4-9751-74446868b755'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:58.207904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e33de9-c85d-4f6f-a74d-989212a69264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:58.208568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e33de9-c85d-4f6f-a74d-989212a69264 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:58.208851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e33de9-c85d-4f6f-a74d-989212a69264 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:58.209125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e33de9-c85d-4f6f-a74d-989212a69264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:58.218389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ded5861f-6be1-48c4-9751-74446868b755 admin admin] The token cache is being invalidate because project 18276a4e9b824e6a9e25a313e1102f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:29:58.218689 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ded5861f-6be1-48c4-9751-74446868b755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:58.219385 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ded5861f-6be1-48c4-9751-74446868b755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:29:58.221045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1281/2601] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:29:57 2022] DELETE /identity/v3/projects/18276a4e9b824e6a9e25a313e1102f0e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:29:58.226149 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c00ae6-1659-4fe5-8d65-5bd8ed96837d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:58.226430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c00ae6-1659-4fe5-8d65-5bd8ed96837d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:58.226711 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c00ae6-1659-4fe5-8d65-5bd8ed96837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:58.244722 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-44c00ae6-1659-4fe5-8d65-5bd8ed96837d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:58.246668 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-44c00ae6-1659-4fe5-8d65-5bd8ed96837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:58.275236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e33de9-c85d-4f6f-a74d-989212a69264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:58.276756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e33de9-c85d-4f6f-a74d-989212a69264 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:58.286341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1321/2602] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:29:58.314452 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1282/2603] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:29:58.322734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97aa0-afbf-48b0-984b-fc8941de18c0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:58.323801 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97aa0-afbf-48b0-984b-fc8941de18c0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:58.324117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97aa0-afbf-48b0-984b-fc8941de18c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:58.342733 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1ec97aa0-afbf-48b0-984b-fc8941de18c0 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:58.343961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1ec97aa0-afbf-48b0-984b-fc8941de18c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:58.356696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1322/2604] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:58.358087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c00ae6-1659-4fe5-8d65-5bd8ed96837d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:58.368127 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c00ae6-1659-4fe5-8d65-5bd8ed96837d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:58.373759 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eb472-de5d-448e-a219-dd74c9b311a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:58.374441 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eb472-de5d-448e-a219-dd74c9b311a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:58.374718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eb472-de5d-448e-a219-dd74c9b311a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:58.374991 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eb472-de5d-448e-a219-dd74c9b311a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:58.375717 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304eb472-de5d-448e-a219-dd74c9b311a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:29:58.376059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304eb472-de5d-448e-a219-dd74c9b311a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:58.377654 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304eb472-de5d-448e-a219-dd74c9b311a0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:58.390706 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1283/2605] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:29:58.395106 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec97aa0-afbf-48b0-984b-fc8941de18c0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:58.404741 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec97aa0-afbf-48b0-984b-fc8941de18c0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:58.410001 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc02d9-2b6c-4f36-a8a7-32e230995649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:58.410657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc02d9-2b6c-4f36-a8a7-32e230995649 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:58.410942 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc02d9-2b6c-4f36-a8a7-32e230995649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:58.411219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc02d9-2b6c-4f36-a8a7-32e230995649 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:58.411908 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc02d9-2b6c-4f36-a8a7-32e230995649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:58.413832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc02d9-2b6c-4f36-a8a7-32e230995649 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:58.493011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1323/2606] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:29:58 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:58.497835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eb472-de5d-448e-a219-dd74c9b311a0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:58.508922 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eb472-de5d-448e-a219-dd74c9b311a0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:58.575902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400eeb7-26b4-40a2-9264-e6e646873a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:58.576629 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400eeb7-26b4-40a2-9264-e6e646873a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:58.576918 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400eeb7-26b4-40a2-9264-e6e646873a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:58.577422 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400eeb7-26b4-40a2-9264-e6e646873a8f admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:58.578420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400eeb7-26b4-40a2-9264-e6e646873a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:58.580436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400eeb7-26b4-40a2-9264-e6e646873a8f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:58.657353 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1284/2607] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:29:58 2022] POST /identity/v3/users => generated 301 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:29:58.661278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc02d9-2b6c-4f36-a8a7-32e230995649 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:58.672733 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc02d9-2b6c-4f36-a8a7-32e230995649 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:58.677524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95a4da-64c2-483f-9efa-c2f21f4c148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:58.678188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95a4da-64c2-483f-9efa-c2f21f4c148f admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:58.678479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95a4da-64c2-483f-9efa-c2f21f4c148f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:58.678753 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95a4da-64c2-483f-9efa-c2f21f4c148f admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:58.679482 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95a4da-64c2-483f-9efa-c2f21f4c148f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:58.681120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95a4da-64c2-483f-9efa-c2f21f4c148f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:58.692220 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1324/2608] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:58.696509 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400eeb7-26b4-40a2-9264-e6e646873a8f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:58.707371 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400eeb7-26b4-40a2-9264-e6e646873a8f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:58.717507 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abc8ea-8058-4b2a-982d-ac3e30a7079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:58.718192 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abc8ea-8058-4b2a-982d-ac3e30a7079d admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:58.720166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abc8ea-8058-4b2a-982d-ac3e30a7079d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:58.720166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abc8ea-8058-4b2a-982d-ac3e30a7079d admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:58.720166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abc8ea-8058-4b2a-982d-ac3e30a7079d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:58.721076 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abc8ea-8058-4b2a-982d-ac3e30a7079d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:58.734552 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1285/2609] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:58.738779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95a4da-64c2-483f-9efa-c2f21f4c148f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:58.752808 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95a4da-64c2-483f-9efa-c2f21f4c148f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:58.754770 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674836f-0e5b-4343-b7fa-3a34bbb801d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:58.755685 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674836f-0e5b-4343-b7fa-3a34bbb801d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:58.755973 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674836f-0e5b-4343-b7fa-3a34bbb801d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:58.756281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674836f-0e5b-4343-b7fa-3a34bbb801d2 admin admin] PATH_INFO: `/v3/projects/d19635974d764197b7c0a69782efee07/users/5b53bb2f04f04235bae33aa81cb7a5a2/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:58.773795 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674836f-0e5b-4343-b7fa-3a34bbb801d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19635974d764197b7c0a69782efee07, user_id=5b53bb2f04f04235bae33aa81cb7a5a2, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:58.776625 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674836f-0e5b-4343-b7fa-3a34bbb801d2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:58.874267 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1325/2610] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:58 2022] PUT /identity/v3/projects/d19635974d764197b7c0a69782efee07/users/5b53bb2f04f04235bae33aa81cb7a5a2/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:58.886301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab1423-94c3-495c-a908-6ed5cc9fb161 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:58.886301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab1423-94c3-495c-a908-6ed5cc9fb161 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:58.886301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab1423-94c3-495c-a908-6ed5cc9fb161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:58.911516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:58.915031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-64ab1423-94c3-495c-a908-6ed5cc9fb161 None None] MFA Rules not processed for user `5b53bb2f04f04235bae33aa81cb7a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:58.916524 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-64ab1423-94c3-495c-a908-6ed5cc9fb161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:59.001248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1286/2611] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:59.010087 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674836f-0e5b-4343-b7fa-3a34bbb801d2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:59.078809 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674836f-0e5b-4343-b7fa-3a34bbb801d2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:59.083633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ddf3e-b151-4e54-be85-090570cbf37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:59.084568 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ddf3e-b151-4e54-be85-090570cbf37e admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:59.084802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ddf3e-b151-4e54-be85-090570cbf37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:59.085079 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ddf3e-b151-4e54-be85-090570cbf37e admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:59.085883 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ddf3e-b151-4e54-be85-090570cbf37e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:59.088494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ddf3e-b151-4e54-be85-090570cbf37e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:59.214846 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1326/2612] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:29:59 2022] POST /identity/v3/projects => generated 397 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:59.216510 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab1423-94c3-495c-a908-6ed5cc9fb161 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:59.242212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab1423-94c3-495c-a908-6ed5cc9fb161 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:59.312401 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11f04c-c4bc-4860-9187-7234dcc0f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:59.313083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11f04c-c4bc-4860-9187-7234dcc0f42d admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:59.313367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11f04c-c4bc-4860-9187-7234dcc0f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:59.313671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11f04c-c4bc-4860-9187-7234dcc0f42d admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:59.314460 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11f04c-c4bc-4860-9187-7234dcc0f42d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:59.316429 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11f04c-c4bc-4860-9187-7234dcc0f42d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:59.428814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1287/2613] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:29:59 2022] POST /identity/v3/users => generated 305 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:29:59.430337 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ddf3e-b151-4e54-be85-090570cbf37e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:59.440882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ddf3e-b151-4e54-be85-090570cbf37e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:59.445792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bfee9-6ba3-46ff-8b0c-52bc91aec50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:59.455199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bfee9-6ba3-46ff-8b0c-52bc91aec50e admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:59.455199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bfee9-6ba3-46ff-8b0c-52bc91aec50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:59.455199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bfee9-6ba3-46ff-8b0c-52bc91aec50e admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:59.455199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bfee9-6ba3-46ff-8b0c-52bc91aec50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:59.455199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bfee9-6ba3-46ff-8b0c-52bc91aec50e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:59.460447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1327/2614] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:59.465261 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11f04c-c4bc-4860-9187-7234dcc0f42d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:59.475268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11f04c-c4bc-4860-9187-7234dcc0f42d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:59.479942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76fcb0-eb2b-48b6-816a-34302357d538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:59.482569 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76fcb0-eb2b-48b6-816a-34302357d538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:59.482569 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76fcb0-eb2b-48b6-816a-34302357d538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:59.482569 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76fcb0-eb2b-48b6-816a-34302357d538 admin admin] PATH_INFO: `/v3/projects/f17052dfd4f44f0f95973ed0f614bd8e/users/94bd94233cef493289f04437b6b176c9/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:59.496603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76fcb0-eb2b-48b6-816a-34302357d538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17052dfd4f44f0f95973ed0f614bd8e, user_id=94bd94233cef493289f04437b6b176c9, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:59.499250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76fcb0-eb2b-48b6-816a-34302357d538 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:59.576298 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1288/2615] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:59 2022] PUT /identity/v3/projects/f17052dfd4f44f0f95973ed0f614bd8e/users/94bd94233cef493289f04437b6b176c9/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:59.580394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bfee9-6ba3-46ff-8b0c-52bc91aec50e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:59.591438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bfee9-6ba3-46ff-8b0c-52bc91aec50e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:59.595072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:59.651038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fa2a0-50c0-49fc-af0a-a2d15573609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:59.652248 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fa2a0-50c0-49fc-af0a-a2d15573609a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:59.652536 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fa2a0-50c0-49fc-af0a-a2d15573609a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:59.652812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fa2a0-50c0-49fc-af0a-a2d15573609a admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:59.653660 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fa2a0-50c0-49fc-af0a-a2d15573609a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:59.655261 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fa2a0-50c0-49fc-af0a-a2d15573609a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:59.665703 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1328/2616] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:29:59.669885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76fcb0-eb2b-48b6-816a-34302357d538 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:59.680531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76fcb0-eb2b-48b6-816a-34302357d538 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:59.685740 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcebed4-2586-4a9f-ae33-62ca217d186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:59.686609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcebed4-2586-4a9f-ae33-62ca217d186f admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:59.686891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcebed4-2586-4a9f-ae33-62ca217d186f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:59.687172 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcebed4-2586-4a9f-ae33-62ca217d186f admin admin] PATH_INFO: `/v3/projects/f17052dfd4f44f0f95973ed0f614bd8e/users/94bd94233cef493289f04437b6b176c9/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:59.689244 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcebed4-2586-4a9f-ae33-62ca217d186f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17052dfd4f44f0f95973ed0f614bd8e, user_id=94bd94233cef493289f04437b6b176c9, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:59.691807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcebed4-2586-4a9f-ae33-62ca217d186f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:59.702869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1289/2617] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:29:59 2022] PUT /identity/v3/projects/f17052dfd4f44f0f95973ed0f614bd8e/users/94bd94233cef493289f04437b6b176c9/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:29:59.712904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978c99a-36f9-40f8-8b1b-c5cef1cde971 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:59.713332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978c99a-36f9-40f8-8b1b-c5cef1cde971 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:59.713605 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978c99a-36f9-40f8-8b1b-c5cef1cde971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:59.741147 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c978c99a-36f9-40f8-8b1b-c5cef1cde971 None None] MFA Rules not processed for user `94bd94233cef493289f04437b6b176c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:29:59.742371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c978c99a-36f9-40f8-8b1b-c5cef1cde971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:59.831143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1329/2618] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:29:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:29:59.843190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcebed4-2586-4a9f-ae33-62ca217d186f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:59.845095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bdcebed4-2586-4a9f-ae33-62ca217d186f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:59.904280 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcebed4-2586-4a9f-ae33-62ca217d186f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:59.908017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8463e86-705b-41f9-8bac-ba46fcabbacb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:59.908669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463e86-705b-41f9-8bac-ba46fcabbacb service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:59.908953 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463e86-705b-41f9-8bac-ba46fcabbacb service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:59.909229 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463e86-705b-41f9-8bac-ba46fcabbacb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:59.918309 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8463e86-705b-41f9-8bac-ba46fcabbacb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:59.919792 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8463e86-705b-41f9-8bac-ba46fcabbacb service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:59.923748 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:59.929836 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1290/2619] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:00.142867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978c99a-36f9-40f8-8b1b-c5cef1cde971 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:00.152635 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978c99a-36f9-40f8-8b1b-c5cef1cde971 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:00.156328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4f872-5211-494a-b0ee-9264b286a988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:00.156975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4f872-5211-494a-b0ee-9264b286a988 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:00.157259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4f872-5211-494a-b0ee-9264b286a988 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:00.157537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4f872-5211-494a-b0ee-9264b286a988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:00.217901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4f872-5211-494a-b0ee-9264b286a988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:00.219346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4f872-5211-494a-b0ee-9264b286a988 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:00.228367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1330/2620] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:03.831702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8463e86-705b-41f9-8bac-ba46fcabbacb service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:03.833265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a8463e86-705b-41f9-8bac-ba46fcabbacb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:03.911775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8463e86-705b-41f9-8bac-ba46fcabbacb service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:03.916541 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa5864-a2cd-4142-94aa-275a8a9ddf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:03.917425 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5864-a2cd-4142-94aa-275a8a9ddf2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:03.917713 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5864-a2cd-4142-94aa-275a8a9ddf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:03.917991 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5864-a2cd-4142-94aa-275a8a9ddf2b admin admin] PATH_INFO: `/v3/users/c0ba7804839d4307b7039bd25d3be24e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:03.919250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa5864-a2cd-4142-94aa-275a8a9ddf2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ba7804839d4307b7039bd25d3be24e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:03.921374 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa5864-a2cd-4142-94aa-275a8a9ddf2b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:04.112471 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2dfa5864-a2cd-4142-94aa-275a8a9ddf2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ba7804839d4307b7039bd25d3be24e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:04.130779 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2dfa5864-a2cd-4142-94aa-275a8a9ddf2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ba7804839d4307b7039bd25d3be24e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:04.131573 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2dfa5864-a2cd-4142-94aa-275a8a9ddf2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ba7804839d4307b7039bd25d3be24e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:04.203297 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2dfa5864-a2cd-4142-94aa-275a8a9ddf2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ba7804839d4307b7039bd25d3be24e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:04.204090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2dfa5864-a2cd-4142-94aa-275a8a9ddf2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ba7804839d4307b7039bd25d3be24e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:04.224849 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1291/2621] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:03 2022] DELETE /identity/v3/users/c0ba7804839d4307b7039bd25d3be24e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:04.228324 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c12c7-257d-4b93-9bf9-794b9546ae3f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:04.228774 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c12c7-257d-4b93-9bf9-794b9546ae3f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:04.228908 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c12c7-257d-4b93-9bf9-794b9546ae3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:04.246969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c59c12c7-257d-4b93-9bf9-794b9546ae3f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:04.253762 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c59c12c7-257d-4b93-9bf9-794b9546ae3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:04.272453 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:04.316555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1331/2622] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:04.323369 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa5864-a2cd-4142-94aa-275a8a9ddf2b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:04.325574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2dfa5864-a2cd-4142-94aa-275a8a9ddf2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:04.387797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa5864-a2cd-4142-94aa-275a8a9ddf2b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:04.391584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43984721-dd7a-4a81-9125-709dca00cb07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:04.392250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43984721-dd7a-4a81-9125-709dca00cb07 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:04.392535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43984721-dd7a-4a81-9125-709dca00cb07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:04.392809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43984721-dd7a-4a81-9125-709dca00cb07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:04.404234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43984721-dd7a-4a81-9125-709dca00cb07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:04.405947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43984721-dd7a-4a81-9125-709dca00cb07 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:04.416026 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1292/2623] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:04.858761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c12c7-257d-4b93-9bf9-794b9546ae3f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:04.860465 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c59c12c7-257d-4b93-9bf9-794b9546ae3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:04.875662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c12c7-257d-4b93-9bf9-794b9546ae3f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:04.881091 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:04.882157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:04.882826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:04.883120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] PATH_INFO: `/v3/projects/01f5e9a875024ac0aef3caf61a88f360` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:04.884611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f5e9a875024ac0aef3caf61a88f360)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:04.886910 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:05.018915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f5e9a875024ac0aef3caf61a88f360', 'request_id': 'req-cfd488ba-a818-4170-aba6-f4b15ab12e52'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:05.096648 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f5e9a875024ac0aef3caf61a88f360', 'request_id': 'req-cfd488ba-a818-4170-aba6-f4b15ab12e52'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:05.103385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f5e9a875024ac0aef3caf61a88f360', 'request_id': 'req-cfd488ba-a818-4170-aba6-f4b15ab12e52'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:05.115457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] The token cache is being invalidate because project 01f5e9a875024ac0aef3caf61a88f360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:05.115749 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:05.116433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:05.117997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1332/2624] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:04 2022] DELETE /identity/v3/projects/01f5e9a875024ac0aef3caf61a88f360 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:05.122260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43984721-dd7a-4a81-9125-709dca00cb07 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:05.132485 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43984721-dd7a-4a81-9125-709dca00cb07 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:05.156062 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:05.212534 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c82c1-c6bf-4515-a638-1db9fbe50c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:05.213773 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c82c1-c6bf-4515-a638-1db9fbe50c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:05.214605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c82c1-c6bf-4515-a638-1db9fbe50c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:05.214894 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c82c1-c6bf-4515-a638-1db9fbe50c45 admin admin] PATH_INFO: `/v3/users/d516aad7ecb94d5ebd8335fadb7276d3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:05.216188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c82c1-c6bf-4515-a638-1db9fbe50c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d516aad7ecb94d5ebd8335fadb7276d3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:05.218166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c82c1-c6bf-4515-a638-1db9fbe50c45 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:05.441330 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e8c82c1-c6bf-4515-a638-1db9fbe50c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd516aad7ecb94d5ebd8335fadb7276d3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:05.454449 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e8c82c1-c6bf-4515-a638-1db9fbe50c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd516aad7ecb94d5ebd8335fadb7276d3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:05.455195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e8c82c1-c6bf-4515-a638-1db9fbe50c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd516aad7ecb94d5ebd8335fadb7276d3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:05.522249 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e8c82c1-c6bf-4515-a638-1db9fbe50c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd516aad7ecb94d5ebd8335fadb7276d3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:05.522920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e8c82c1-c6bf-4515-a638-1db9fbe50c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd516aad7ecb94d5ebd8335fadb7276d3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:05.537139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1293/2625] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:05 2022] DELETE /identity/v3/users/d516aad7ecb94d5ebd8335fadb7276d3 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:05.979122 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:05.980611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:05.994890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd488ba-a818-4170-aba6-f4b15ab12e52 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:06.062549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1808d-8c76-460a-868a-922b1740eb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:06.062549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1808d-8c76-460a-868a-922b1740eb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:06.062549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1808d-8c76-460a-868a-922b1740eb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:06.062909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1808d-8c76-460a-868a-922b1740eb08 admin admin] PATH_INFO: `/v3/projects/de5eeb0729f54c1ba940c9dcbd3b9f3e` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:06.064021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1808d-8c76-460a-868a-922b1740eb08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5eeb0729f54c1ba940c9dcbd3b9f3e)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:06.065970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1808d-8c76-460a-868a-922b1740eb08 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:06.213962 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-41c1808d-8c76-460a-868a-922b1740eb08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5eeb0729f54c1ba940c9dcbd3b9f3e', 'request_id': 'req-41c1808d-8c76-460a-868a-922b1740eb08'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:06.221737 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:06.283296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-41c1808d-8c76-460a-868a-922b1740eb08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5eeb0729f54c1ba940c9dcbd3b9f3e', 'request_id': 'req-41c1808d-8c76-460a-868a-922b1740eb08'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:06.289475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-41c1808d-8c76-460a-868a-922b1740eb08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5eeb0729f54c1ba940c9dcbd3b9f3e', 'request_id': 'req-41c1808d-8c76-460a-868a-922b1740eb08'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:06.301373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-41c1808d-8c76-460a-868a-922b1740eb08 admin admin] The token cache is being invalidate because project de5eeb0729f54c1ba940c9dcbd3b9f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:06.301669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-41c1808d-8c76-460a-868a-922b1740eb08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:06.302345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-41c1808d-8c76-460a-868a-922b1740eb08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:06.303934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1333/2626] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:05 2022] DELETE /identity/v3/projects/de5eeb0729f54c1ba940c9dcbd3b9f3e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:06.309829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a2fd4-37e4-468d-9b5d-edb7a13f3ef0 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:06.310320 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a2fd4-37e4-468d-9b5d-edb7a13f3ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:06.310415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a2fd4-37e4-468d-9b5d-edb7a13f3ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:06.328090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b68a2fd4-37e4-468d-9b5d-edb7a13f3ef0 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:06.329250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b68a2fd4-37e4-468d-9b5d-edb7a13f3ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:06.392712 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1294/2627] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:06.400326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e225a8b-bf77-4333-afbe-85eebecbe757 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:06.400612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e225a8b-bf77-4333-afbe-85eebecbe757 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:06.400886 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e225a8b-bf77-4333-afbe-85eebecbe757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:06.420736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1e225a8b-bf77-4333-afbe-85eebecbe757 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:06.421944 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1e225a8b-bf77-4333-afbe-85eebecbe757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:06.430257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1334/2628] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:06.434586 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a2fd4-37e4-468d-9b5d-edb7a13f3ef0 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:06.444591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a2fd4-37e4-468d-9b5d-edb7a13f3ef0 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:06.449329 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef6c43-de3f-4003-abf9-db56bc68fbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:06.449822 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef6c43-de3f-4003-abf9-db56bc68fbad admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:06.450106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef6c43-de3f-4003-abf9-db56bc68fbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:06.450380 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef6c43-de3f-4003-abf9-db56bc68fbad admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:06.451137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef6c43-de3f-4003-abf9-db56bc68fbad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:30:06.451477 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef6c43-de3f-4003-abf9-db56bc68fbad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:06.453212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef6c43-de3f-4003-abf9-db56bc68fbad admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:06.466001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1295/2629] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:30:06.470409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e225a8b-bf77-4333-afbe-85eebecbe757 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:06.480479 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e225a8b-bf77-4333-afbe-85eebecbe757 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:06.485480 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e740371-0bc6-46a6-b550-92c4613a0d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:06.486130 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e740371-0bc6-46a6-b550-92c4613a0d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:06.486416 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e740371-0bc6-46a6-b550-92c4613a0d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:06.486756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e740371-0bc6-46a6-b550-92c4613a0d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:06.487526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e740371-0bc6-46a6-b550-92c4613a0d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:06.492349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e740371-0bc6-46a6-b550-92c4613a0d08 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:06.509265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef6c43-de3f-4003-abf9-db56bc68fbad admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:06.511377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d8ef6c43-de3f-4003-abf9-db56bc68fbad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:06.524213 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef6c43-de3f-4003-abf9-db56bc68fbad admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:06.529433 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e848dca-9564-4b14-ad6c-05a7c6fdbdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:06.530294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e848dca-9564-4b14-ad6c-05a7c6fdbdbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:06.530578 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e848dca-9564-4b14-ad6c-05a7c6fdbdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:06.530853 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e848dca-9564-4b14-ad6c-05a7c6fdbdbc admin admin] PATH_INFO: `/v3/users/5b53bb2f04f04235bae33aa81cb7a5a2` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:06.532080 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e848dca-9564-4b14-ad6c-05a7c6fdbdbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b53bb2f04f04235bae33aa81cb7a5a2)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:06.534026 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e848dca-9564-4b14-ad6c-05a7c6fdbdbc admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:06.558409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:06.570369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1335/2630] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:06 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:06.574560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e740371-0bc6-46a6-b550-92c4613a0d08 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:06.636904 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e740371-0bc6-46a6-b550-92c4613a0d08 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:06.641895 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd619c-3937-41d8-9ed3-d03a40aa2a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:06.642624 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd619c-3937-41d8-9ed3-d03a40aa2a01 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:06.642915 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd619c-3937-41d8-9ed3-d03a40aa2a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:06.643192 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd619c-3937-41d8-9ed3-d03a40aa2a01 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:06.643879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd619c-3937-41d8-9ed3-d03a40aa2a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:06.645902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd619c-3937-41d8-9ed3-d03a40aa2a01 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:06.725480 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8e848dca-9564-4b14-ad6c-05a7c6fdbdbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b53bb2f04f04235bae33aa81cb7a5a2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:06.738021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8e848dca-9564-4b14-ad6c-05a7c6fdbdbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b53bb2f04f04235bae33aa81cb7a5a2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:06.738808 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8e848dca-9564-4b14-ad6c-05a7c6fdbdbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b53bb2f04f04235bae33aa81cb7a5a2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:06.752047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1336/2631] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:06 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:30:06.755923 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd619c-3937-41d8-9ed3-d03a40aa2a01 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:06.758164 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-18fd619c-3937-41d8-9ed3-d03a40aa2a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:06.771554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd619c-3937-41d8-9ed3-d03a40aa2a01 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:06.778292 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf30da-21aa-446e-a7c3-32cb4d96f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:06.779016 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf30da-21aa-446e-a7c3-32cb4d96f5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:06.779332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf30da-21aa-446e-a7c3-32cb4d96f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:06.779613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf30da-21aa-446e-a7c3-32cb4d96f5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:06.780447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf30da-21aa-446e-a7c3-32cb4d96f5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:06.784759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf30da-21aa-446e-a7c3-32cb4d96f5a3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:06.792867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1337/2632] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:06.796919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf30da-21aa-446e-a7c3-32cb4d96f5a3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:06.797425 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8e848dca-9564-4b14-ad6c-05a7c6fdbdbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b53bb2f04f04235bae33aa81cb7a5a2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:06.798079 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8e848dca-9564-4b14-ad6c-05a7c6fdbdbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b53bb2f04f04235bae33aa81cb7a5a2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:06.806612 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf30da-21aa-446e-a7c3-32cb4d96f5a3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:06.810760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1296/2633] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:06 2022] DELETE /identity/v3/users/5b53bb2f04f04235bae33aa81cb7a5a2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:30:06.811555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91653880-6282-41a3-8b57-481479e31852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:06.812301 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91653880-6282-41a3-8b57-481479e31852 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:06.812583 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91653880-6282-41a3-8b57-481479e31852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:06.812861 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91653880-6282-41a3-8b57-481479e31852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:06.813834 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91653880-6282-41a3-8b57-481479e31852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:06.815080 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff99ef-19ac-4f73-87d2-0bfccad1707f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:06.815423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91653880-6282-41a3-8b57-481479e31852 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:06.815575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff99ef-19ac-4f73-87d2-0bfccad1707f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:06.815867 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff99ef-19ac-4f73-87d2-0bfccad1707f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:06.827170 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1338/2634] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:06.833655 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91653880-6282-41a3-8b57-481479e31852 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:06.833953 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-dfff99ef-19ac-4f73-87d2-0bfccad1707f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:06.835177 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-dfff99ef-19ac-4f73-87d2-0bfccad1707f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:06.844491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91653880-6282-41a3-8b57-481479e31852 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:06.897461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1297/2635] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:06.902667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d563d-e996-41ae-8682-9758686fca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:06.903570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d563d-e996-41ae-8682-9758686fca29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:06.903849 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d563d-e996-41ae-8682-9758686fca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:06.904153 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d563d-e996-41ae-8682-9758686fca29 admin admin] PATH_INFO: `/v3/projects/222fcfe6f8c447fa9522f102cdeb2d6f/users/fac99f5fe4cb4a2883692e3bf8e37439/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:06.907807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff99ef-19ac-4f73-87d2-0bfccad1707f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:06.909288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-dfff99ef-19ac-4f73-87d2-0bfccad1707f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:06.919792 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d563d-e996-41ae-8682-9758686fca29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=222fcfe6f8c447fa9522f102cdeb2d6f, user_id=fac99f5fe4cb4a2883692e3bf8e37439, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:06.922498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d563d-e996-41ae-8682-9758686fca29 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:06.966152 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff99ef-19ac-4f73-87d2-0bfccad1707f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:06.969794 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7a992-aff5-4d88-b6db-dc751af96b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:06.970436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7a992-aff5-4d88-b6db-dc751af96b14 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:06.970747 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7a992-aff5-4d88-b6db-dc751af96b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:06.971017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7a992-aff5-4d88-b6db-dc751af96b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:06.980479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7a992-aff5-4d88-b6db-dc751af96b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:06.981902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7a992-aff5-4d88-b6db-dc751af96b14 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:06.991294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1298/2636] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:07.013675 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1339/2637] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:06 2022] PUT /identity/v3/projects/222fcfe6f8c447fa9522f102cdeb2d6f/users/fac99f5fe4cb4a2883692e3bf8e37439/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:30:07.024149 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86760310-b92e-424e-85a4-cc74ad4f987f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:07.024448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86760310-b92e-424e-85a4-cc74ad4f987f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:07.024735 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86760310-b92e-424e-85a4-cc74ad4f987f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:07.053260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-86760310-b92e-424e-85a4-cc74ad4f987f None None] MFA Rules not processed for user `fac99f5fe4cb4a2883692e3bf8e37439`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:07.054489 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-86760310-b92e-424e-85a4-cc74ad4f987f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:07.090593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:07.124840 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1299/2638] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:07.129347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d563d-e996-41ae-8682-9758686fca29 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:07.133905 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:07.198104 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d563d-e996-41ae-8682-9758686fca29 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:07.203391 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54bdcf-c1fe-4b53-8cd9-69071cc15c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:07.204009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54bdcf-c1fe-4b53-8cd9-69071cc15c7f admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:07.204486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54bdcf-c1fe-4b53-8cd9-69071cc15c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:07.204732 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54bdcf-c1fe-4b53-8cd9-69071cc15c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:07.205451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54bdcf-c1fe-4b53-8cd9-69071cc15c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:07.208362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54bdcf-c1fe-4b53-8cd9-69071cc15c7f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:07.303009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1340/2639] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:07 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:07.306363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86760310-b92e-424e-85a4-cc74ad4f987f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:07.318602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86760310-b92e-424e-85a4-cc74ad4f987f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:07.375703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d5bb1-2c8f-4278-918d-70bd60dc8e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:07.376414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d5bb1-2c8f-4278-918d-70bd60dc8e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:07.376703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d5bb1-2c8f-4278-918d-70bd60dc8e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:07.377017 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d5bb1-2c8f-4278-918d-70bd60dc8e55 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:07.377719 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d5bb1-2c8f-4278-918d-70bd60dc8e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:07.379675 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d5bb1-2c8f-4278-918d-70bd60dc8e55 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:07.439834 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54bdcf-c1fe-4b53-8cd9-69071cc15c7f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:07.441648 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ec54bdcf-c1fe-4b53-8cd9-69071cc15c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:07.455267 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54bdcf-c1fe-4b53-8cd9-69071cc15c7f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:07.460506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:07.461384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:07.461820 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:07.462108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] PATH_INFO: `/v3/projects/d19635974d764197b7c0a69782efee07` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:07.463340 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d19635974d764197b7c0a69782efee07)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:07.469607 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:07.494178 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1300/2640] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:07 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:07.498751 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d5bb1-2c8f-4278-918d-70bd60dc8e55 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:07.508666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d5bb1-2c8f-4278-918d-70bd60dc8e55 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:07.513788 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c488f3a-3e1e-49cf-bd0f-c80cb9152e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:07.514443 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c488f3a-3e1e-49cf-bd0f-c80cb9152e70 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:07.514723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c488f3a-3e1e-49cf-bd0f-c80cb9152e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:07.514995 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c488f3a-3e1e-49cf-bd0f-c80cb9152e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:07.515841 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c488f3a-3e1e-49cf-bd0f-c80cb9152e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:07.517459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c488f3a-3e1e-49cf-bd0f-c80cb9152e70 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:07.531112 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1301/2641] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:30:07.532067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c488f3a-3e1e-49cf-bd0f-c80cb9152e70 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:07.543262 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c488f3a-3e1e-49cf-bd0f-c80cb9152e70 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:07.549185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056c5e0-6876-4fb8-b9f1-9d4727082d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:07.550033 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056c5e0-6876-4fb8-b9f1-9d4727082d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:07.550334 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056c5e0-6876-4fb8-b9f1-9d4727082d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:07.550827 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056c5e0-6876-4fb8-b9f1-9d4727082d94 admin admin] PATH_INFO: `/v3/projects/a65d3f0d0413404b8ab55ddfc0d95c7f/users/a1fdca74d4c24a91977d798bda61bff2/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:07.567526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056c5e0-6876-4fb8-b9f1-9d4727082d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65d3f0d0413404b8ab55ddfc0d95c7f, user_id=a1fdca74d4c24a91977d798bda61bff2, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:07.567730 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd19635974d764197b7c0a69782efee07', 'request_id': 'req-8972cdb6-19b6-4029-b1e5-f72b67add871'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:07.570853 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056c5e0-6876-4fb8-b9f1-9d4727082d94 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:07.660924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd19635974d764197b7c0a69782efee07', 'request_id': 'req-8972cdb6-19b6-4029-b1e5-f72b67add871'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:07.666119 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1302/2642] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:07 2022] PUT /identity/v3/projects/a65d3f0d0413404b8ab55ddfc0d95c7f/users/a1fdca74d4c24a91977d798bda61bff2/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:30:07.670752 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056c5e0-6876-4fb8-b9f1-9d4727082d94 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:07.670939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd19635974d764197b7c0a69782efee07', 'request_id': 'req-8972cdb6-19b6-4029-b1e5-f72b67add871'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:07.684639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] The token cache is being invalidate because project d19635974d764197b7c0a69782efee07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:07.684861 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:07.685530 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:07.687328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1341/2643] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:07 2022] DELETE /identity/v3/projects/d19635974d764197b7c0a69782efee07 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:30:07.695928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:07.697933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:07.737854 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056c5e0-6876-4fb8-b9f1-9d4727082d94 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:07.742829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92993c1-1170-4cca-ae7f-cdc7d4dde30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:07.743529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92993c1-1170-4cca-ae7f-cdc7d4dde30f admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:07.743810 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92993c1-1170-4cca-ae7f-cdc7d4dde30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:07.744115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92993c1-1170-4cca-ae7f-cdc7d4dde30f admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:07.744895 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92993c1-1170-4cca-ae7f-cdc7d4dde30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:07.747188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92993c1-1170-4cca-ae7f-cdc7d4dde30f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:07.761095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1303/2644] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:30:07.767877 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92993c1-1170-4cca-ae7f-cdc7d4dde30f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:07.768051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972cdb6-19b6-4029-b1e5-f72b67add871 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:07.768201 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c92993c1-1170-4cca-ae7f-cdc7d4dde30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:07.768307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5b90d-25dd-40d1-ad4a-83dfa969c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:07.768753 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5b90d-25dd-40d1-ad4a-83dfa969c892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:07.769109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5b90d-25dd-40d1-ad4a-83dfa969c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:07.769458 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5b90d-25dd-40d1-ad4a-83dfa969c892 admin admin] PATH_INFO: `/v3/users/94bd94233cef493289f04437b6b176c9` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:07.770800 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5b90d-25dd-40d1-ad4a-83dfa969c892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94bd94233cef493289f04437b6b176c9)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:07.772949 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5b90d-25dd-40d1-ad4a-83dfa969c892 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:07.776603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92993c1-1170-4cca-ae7f-cdc7d4dde30f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:07.781219 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666d5b2-82df-4867-85a4-e3d9e1fb457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:07.782146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666d5b2-82df-4867-85a4-e3d9e1fb457c admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:07.782411 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666d5b2-82df-4867-85a4-e3d9e1fb457c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:07.782690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666d5b2-82df-4867-85a4-e3d9e1fb457c admin admin] PATH_INFO: `/v3/projects/a65d3f0d0413404b8ab55ddfc0d95c7f/users/a1fdca74d4c24a91977d798bda61bff2/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:07.784770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666d5b2-82df-4867-85a4-e3d9e1fb457c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65d3f0d0413404b8ab55ddfc0d95c7f, user_id=a1fdca74d4c24a91977d798bda61bff2, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:07.787797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666d5b2-82df-4867-85a4-e3d9e1fb457c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:07.800959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1304/2645] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:07 2022] PUT /identity/v3/projects/a65d3f0d0413404b8ab55ddfc0d95c7f/users/a1fdca74d4c24a91977d798bda61bff2/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:07.813187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6aaaf-3438-40f7-9713-be0f66ddbf84 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:07.813479 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6aaaf-3438-40f7-9713-be0f66ddbf84 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:07.813760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6aaaf-3438-40f7-9713-be0f66ddbf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:07.832100 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:07.840371 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-84d6aaaf-3438-40f7-9713-be0f66ddbf84 None None] MFA Rules not processed for user `a1fdca74d4c24a91977d798bda61bff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:07.841667 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-84d6aaaf-3438-40f7-9713-be0f66ddbf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:07.909148 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1305/2646] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:07.922024 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6aaaf-3438-40f7-9713-be0f66ddbf84 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:07.923581 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-84d6aaaf-3438-40f7-9713-be0f66ddbf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:07.934441 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:07.979400 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6aaaf-3438-40f7-9713-be0f66ddbf84 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:07.983559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab2cac-28ed-4451-b90e-57ff459d9f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:07.984245 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab2cac-28ed-4451-b90e-57ff459d9f88 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:07.984579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab2cac-28ed-4451-b90e-57ff459d9f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:07.995281 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab2cac-28ed-4451-b90e-57ff459d9f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:07.995409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-afb5b90d-25dd-40d1-ad4a-83dfa969c892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94bd94233cef493289f04437b6b176c9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:07.995503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab2cac-28ed-4451-b90e-57ff459d9f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:07.995606 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab2cac-28ed-4451-b90e-57ff459d9f88 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:08.005058 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1306/2647] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:30:08.006001 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-afb5b90d-25dd-40d1-ad4a-83dfa969c892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94bd94233cef493289f04437b6b176c9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:08.110183 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-afb5b90d-25dd-40d1-ad4a-83dfa969c892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94bd94233cef493289f04437b6b176c9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:08.110870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-afb5b90d-25dd-40d1-ad4a-83dfa969c892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94bd94233cef493289f04437b6b176c9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:08.118278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-afb5b90d-25dd-40d1-ad4a-83dfa969c892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94bd94233cef493289f04437b6b176c9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:08.124256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1342/2648] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:07 2022] DELETE /identity/v3/users/94bd94233cef493289f04437b6b176c9 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:30:08.523123 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab2cac-28ed-4451-b90e-57ff459d9f88 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:08.595888 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab2cac-28ed-4451-b90e-57ff459d9f88 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:08.641797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:08.656770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d64d9-77f4-4745-a358-2ae3877ab9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:08.657627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d64d9-77f4-4745-a358-2ae3877ab9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:08.657910 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d64d9-77f4-4745-a358-2ae3877ab9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:08.658186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d64d9-77f4-4745-a358-2ae3877ab9f0 admin admin] PATH_INFO: `/v3/projects/f17052dfd4f44f0f95973ed0f614bd8e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:08.659358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d64d9-77f4-4745-a358-2ae3877ab9f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17052dfd4f44f0f95973ed0f614bd8e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:08.661304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d64d9-77f4-4745-a358-2ae3877ab9f0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:08.803319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a86d64d9-77f4-4745-a358-2ae3877ab9f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17052dfd4f44f0f95973ed0f614bd8e', 'request_id': 'req-a86d64d9-77f4-4745-a358-2ae3877ab9f0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:08.872930 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a86d64d9-77f4-4745-a358-2ae3877ab9f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17052dfd4f44f0f95973ed0f614bd8e', 'request_id': 'req-a86d64d9-77f4-4745-a358-2ae3877ab9f0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:08.881483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a86d64d9-77f4-4745-a358-2ae3877ab9f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17052dfd4f44f0f95973ed0f614bd8e', 'request_id': 'req-a86d64d9-77f4-4745-a358-2ae3877ab9f0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:08.893103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a86d64d9-77f4-4745-a358-2ae3877ab9f0 admin admin] The token cache is being invalidate because project f17052dfd4f44f0f95973ed0f614bd8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:08.893395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a86d64d9-77f4-4745-a358-2ae3877ab9f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:08.894661 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a86d64d9-77f4-4745-a358-2ae3877ab9f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:08.896507 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1307/2649] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:08 2022] DELETE /identity/v3/projects/f17052dfd4f44f0f95973ed0f614bd8e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:08.901943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf5503-7f67-40ce-b488-40445e55968a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:08.902242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf5503-7f67-40ce-b488-40445e55968a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:08.903297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf5503-7f67-40ce-b488-40445e55968a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:08.921494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2adf5503-7f67-40ce-b488-40445e55968a None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:08.922714 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2adf5503-7f67-40ce-b488-40445e55968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:08.982271 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1343/2650] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:08.991650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62bb3f-8e3a-4a6e-9d3e-25e7ccf5f05e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:08.991946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62bb3f-8e3a-4a6e-9d3e-25e7ccf5f05e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:08.992268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62bb3f-8e3a-4a6e-9d3e-25e7ccf5f05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:09.010590 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-de62bb3f-8e3a-4a6e-9d3e-25e7ccf5f05e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:09.012414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-de62bb3f-8e3a-4a6e-9d3e-25e7ccf5f05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:09.020452 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1308/2651] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:09.024639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf5503-7f67-40ce-b488-40445e55968a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:09.035047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf5503-7f67-40ce-b488-40445e55968a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:09.039822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d4e8a-cfd1-4a77-8a3c-e8f5ca2a249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:09.040630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d4e8a-cfd1-4a77-8a3c-e8f5ca2a249b admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:09.040945 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d4e8a-cfd1-4a77-8a3c-e8f5ca2a249b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:09.041270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d4e8a-cfd1-4a77-8a3c-e8f5ca2a249b admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:09.042072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d4e8a-cfd1-4a77-8a3c-e8f5ca2a249b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:30:09.042382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d4e8a-cfd1-4a77-8a3c-e8f5ca2a249b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:09.043971 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d4e8a-cfd1-4a77-8a3c-e8f5ca2a249b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:09.057039 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1344/2652] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:30:09.061191 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62bb3f-8e3a-4a6e-9d3e-25e7ccf5f05e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:09.070910 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62bb3f-8e3a-4a6e-9d3e-25e7ccf5f05e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:09.077118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a921a9-238a-4395-a176-6bbb9a70d885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:09.077789 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a921a9-238a-4395-a176-6bbb9a70d885 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:09.078078 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a921a9-238a-4395-a176-6bbb9a70d885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:09.078356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a921a9-238a-4395-a176-6bbb9a70d885 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:09.079059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a921a9-238a-4395-a176-6bbb9a70d885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:09.081010 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a921a9-238a-4395-a176-6bbb9a70d885 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:09.139338 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d4e8a-cfd1-4a77-8a3c-e8f5ca2a249b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:09.141175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-437d4e8a-cfd1-4a77-8a3c-e8f5ca2a249b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:09.207292 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d4e8a-cfd1-4a77-8a3c-e8f5ca2a249b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:09.209929 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1309/2653] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:09 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:09.214633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a921a9-238a-4395-a176-6bbb9a70d885 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:09.215042 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bb282-5b6f-46fb-becf-d42fd0594ffe tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1fdca74d4c24a91977d798bda61bff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65d3f0d0413404b8ab55ddfc0d95c7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:09.215716 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bb282-5b6f-46fb-becf-d42fd0594ffe tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:09.216024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bb282-5b6f-46fb-becf-d42fd0594ffe tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:09.216313 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bb282-5b6f-46fb-becf-d42fd0594ffe tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:09.217043 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bb282-5b6f-46fb-becf-d42fd0594ffe tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:30:09.217351 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bb282-5b6f-46fb-becf-d42fd0594ffe tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:09.218969 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bb282-5b6f-46fb-becf-d42fd0594ffe tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:09.231023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1345/2654] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:30:09.238328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bb282-5b6f-46fb-becf-d42fd0594ffe tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:09.249117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bb282-5b6f-46fb-becf-d42fd0594ffe tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:09.256989 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:09.281645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a921a9-238a-4395-a176-6bbb9a70d885 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:09.287005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21b87e-b76e-4272-bf42-c23d2a8e7a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:09.287819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b87e-b76e-4272-bf42-c23d2a8e7a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:09.288267 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b87e-b76e-4272-bf42-c23d2a8e7a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:09.288684 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b87e-b76e-4272-bf42-c23d2a8e7a8b admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:09.289529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21b87e-b76e-4272-bf42-c23d2a8e7a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:09.291642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21b87e-b76e-4272-bf42-c23d2a8e7a8b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:09.308475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa66be-5abb-4500-8509-c85d35f2a350 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1fdca74d4c24a91977d798bda61bff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65d3f0d0413404b8ab55ddfc0d95c7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:09.309220 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa66be-5abb-4500-8509-c85d35f2a350 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:09.309586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa66be-5abb-4500-8509-c85d35f2a350 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:09.309869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa66be-5abb-4500-8509-c85d35f2a350 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:09.310620 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa66be-5abb-4500-8509-c85d35f2a350 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:09.312546 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa66be-5abb-4500-8509-c85d35f2a350 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:09.378202 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1310/2655] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:09 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:30:09.379272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21b87e-b76e-4272-bf42-c23d2a8e7a8b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:09.390698 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21b87e-b76e-4272-bf42-c23d2a8e7a8b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:09.395559 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6d595-fd2c-4f30-a1d8-00947dd4406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:09.396377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6d595-fd2c-4f30-a1d8-00947dd4406b admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:09.396750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6d595-fd2c-4f30-a1d8-00947dd4406b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:09.397087 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6d595-fd2c-4f30-a1d8-00947dd4406b admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:09.397948 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6d595-fd2c-4f30-a1d8-00947dd4406b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:09.399720 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6d595-fd2c-4f30-a1d8-00947dd4406b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:09.405965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1346/2656] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:09 2022] POST /identity/v3/projects => generated 355 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:30:09.410179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa66be-5abb-4500-8509-c85d35f2a350 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:09.412651 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1311/2657] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:09.416451 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6d595-fd2c-4f30-a1d8-00947dd4406b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:09.427871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6d595-fd2c-4f30-a1d8-00947dd4406b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:09.453077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:09.480360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa66be-5abb-4500-8509-c85d35f2a350 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:09.485198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae129ae-2cc0-4c5c-adba-eac6463c3af4 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1fdca74d4c24a91977d798bda61bff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65d3f0d0413404b8ab55ddfc0d95c7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:09.485871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae129ae-2cc0-4c5c-adba-eac6463c3af4 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:09.486163 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae129ae-2cc0-4c5c-adba-eac6463c3af4 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:09.486550 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae129ae-2cc0-4c5c-adba-eac6463c3af4 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:09.487404 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae129ae-2cc0-4c5c-adba-eac6463c3af4 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:30:09.487719 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae129ae-2cc0-4c5c-adba-eac6463c3af4 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:09.489381 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae129ae-2cc0-4c5c-adba-eac6463c3af4 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:09.490829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245c3a-aa44-4c24-9e1e-f814ad991a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:09.491508 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245c3a-aa44-4c24-9e1e-f814ad991a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:09.491799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245c3a-aa44-4c24-9e1e-f814ad991a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:09.492113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245c3a-aa44-4c24-9e1e-f814ad991a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:09.492913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22245c3a-aa44-4c24-9e1e-f814ad991a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:09.498396 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22245c3a-aa44-4c24-9e1e-f814ad991a65 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:09.507118 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1347/2658] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:30:09.515850 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1312/2659] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:30:09.519849 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae129ae-2cc0-4c5c-adba-eac6463c3af4 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:09.533449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae129ae-2cc0-4c5c-adba-eac6463c3af4 tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:09.535862 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f849ac-40a8-4648-abd3-88b50a057748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:09.536791 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f849ac-40a8-4648-abd3-88b50a057748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:09.537078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f849ac-40a8-4648-abd3-88b50a057748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:09.537355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f849ac-40a8-4648-abd3-88b50a057748 admin admin] PATH_INFO: `/v3/projects/8d217cee544c4c8ab80abcfa48bbb848/users/dd7be528375f43a99a217e60855ed7c2/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:09.549858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245c3a-aa44-4c24-9e1e-f814ad991a65 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:09.554132 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f849ac-40a8-4648-abd3-88b50a057748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d217cee544c4c8ab80abcfa48bbb848, user_id=dd7be528375f43a99a217e60855ed7c2, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:09.560822 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f849ac-40a8-4648-abd3-88b50a057748 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:09.562083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245c3a-aa44-4c24-9e1e-f814ad991a65 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:09.566821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1fdca74d4c24a91977d798bda61bff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65d3f0d0413404b8ab55ddfc0d95c7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:09.567658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:09.567942 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:09.568513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] PATH_INFO: `/v3/projects/2112c0cae2444d32aab5a00658e10538` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:09.569871 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2112c0cae2444d32aab5a00658e10538)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:09.571755 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:09.665955 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1348/2660] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:09 2022] PUT /identity/v3/projects/8d217cee544c4c8ab80abcfa48bbb848/users/dd7be528375f43a99a217e60855ed7c2/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:09.676808 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da26617-4cc6-4409-b818-a0d139b6f4d8 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:09.677110 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da26617-4cc6-4409-b818-a0d139b6f4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:09.677395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da26617-4cc6-4409-b818-a0d139b6f4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:09.702833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2112c0cae2444d32aab5a00658e10538', 'request_id': 'req-d2799f98-9597-4c37-9c8e-fbeaccfb806d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:09.704753 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2da26617-4cc6-4409-b818-a0d139b6f4d8 None None] MFA Rules not processed for user `dd7be528375f43a99a217e60855ed7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:09.705981 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2da26617-4cc6-4409-b818-a0d139b6f4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:09.770978 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1349/2661] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:09.773900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2112c0cae2444d32aab5a00658e10538', 'request_id': 'req-d2799f98-9597-4c37-9c8e-fbeaccfb806d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:09.775373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da26617-4cc6-4409-b818-a0d139b6f4d8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:09.781532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2112c0cae2444d32aab5a00658e10538', 'request_id': 'req-d2799f98-9597-4c37-9c8e-fbeaccfb806d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:09.793428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] The token cache is being invalidate because project 2112c0cae2444d32aab5a00658e10538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:09.793719 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:09.794393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:09.796059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1313/2662] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:09 2022] DELETE /identity/v3/projects/2112c0cae2444d32aab5a00658e10538 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:30:09.845729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da26617-4cc6-4409-b818-a0d139b6f4d8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:09.850757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3509de-3e93-4c89-8ed4-e37c1603d5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:09.851442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3509de-3e93-4c89-8ed4-e37c1603d5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:09.851731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3509de-3e93-4c89-8ed4-e37c1603d5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:09.852037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3509de-3e93-4c89-8ed4-e37c1603d5c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:09.852762 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3509de-3e93-4c89-8ed4-e37c1603d5c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:09.854699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3509de-3e93-4c89-8ed4-e37c1603d5c3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:10.004678 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1350/2663] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:09 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:30:10.008861 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:10.011792 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:10.025710 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2799f98-9597-4c37-9c8e-fbeaccfb806d tempest-VolumeQuotaClassesTest-1015150857 tempest-VolumeQuotaClassesTest-1015150857-project-admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:10.081658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f12b12-b098-4ffa-b64c-4d27354bbba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:10.082333 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f12b12-b098-4ffa-b64c-4d27354bbba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:10.082615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f12b12-b098-4ffa-b64c-4d27354bbba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:10.082889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f12b12-b098-4ffa-b64c-4d27354bbba6 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:10.083579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f12b12-b098-4ffa-b64c-4d27354bbba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:10.085512 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f12b12-b098-4ffa-b64c-4d27354bbba6 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:10.163757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3509de-3e93-4c89-8ed4-e37c1603d5c3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:10.165555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6b3509de-3e93-4c89-8ed4-e37c1603d5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:10.178116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3509de-3e93-4c89-8ed4-e37c1603d5c3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:10.183372 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b966b90-e183-45ec-b867-90dfdea132f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:10.184321 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b966b90-e183-45ec-b867-90dfdea132f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:10.184603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b966b90-e183-45ec-b867-90dfdea132f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:10.184877 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b966b90-e183-45ec-b867-90dfdea132f2 admin admin] PATH_INFO: `/v3/users/884062c855394418a1be82ea201a1448` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:10.186067 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b966b90-e183-45ec-b867-90dfdea132f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=884062c855394418a1be82ea201a1448)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:10.188050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b966b90-e183-45ec-b867-90dfdea132f2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:10.204576 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1314/2664] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:10 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:30:10.207638 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f12b12-b098-4ffa-b64c-4d27354bbba6 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:10.217363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f12b12-b098-4ffa-b64c-4d27354bbba6 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:10.221954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c53885-ec62-48c8-b19c-87f20c88c8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:10.222602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c53885-ec62-48c8-b19c-87f20c88c8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:10.222888 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c53885-ec62-48c8-b19c-87f20c88c8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:10.223160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c53885-ec62-48c8-b19c-87f20c88c8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:10.223885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c53885-ec62-48c8-b19c-87f20c88c8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:10.225868 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c53885-ec62-48c8-b19c-87f20c88c8c0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:10.237338 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1315/2665] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:30:10.241319 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c53885-ec62-48c8-b19c-87f20c88c8c0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:10.251147 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c53885-ec62-48c8-b19c-87f20c88c8c0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:10.255764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d2e22-5e40-4e4d-851c-b9e3c6d542e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:10.256423 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2e22-5e40-4e4d-851c-b9e3c6d542e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:10.256708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2e22-5e40-4e4d-851c-b9e3c6d542e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:10.256983 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2e22-5e40-4e4d-851c-b9e3c6d542e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:10.257691 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d2e22-5e40-4e4d-851c-b9e3c6d542e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:10.259364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d2e22-5e40-4e4d-851c-b9e3c6d542e8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:10.270051 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1316/2666] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:30:10.273814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d2e22-5e40-4e4d-851c-b9e3c6d542e8 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:10.282993 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d2e22-5e40-4e4d-851c-b9e3c6d542e8 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:10.291574 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96080cf0-a51f-4370-8dcc-d5e94ab3df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:10.292587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96080cf0-a51f-4370-8dcc-d5e94ab3df17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:10.292821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96080cf0-a51f-4370-8dcc-d5e94ab3df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:10.293196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96080cf0-a51f-4370-8dcc-d5e94ab3df17 admin admin] PATH_INFO: `/v3/projects/e97a668f9ed8425999b400fcdd42590f/users/51c6a834be474f0fb147b3e57044b1ef/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:10.296336 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:10.308687 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96080cf0-a51f-4370-8dcc-d5e94ab3df17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97a668f9ed8425999b400fcdd42590f, user_id=51c6a834be474f0fb147b3e57044b1ef, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:10.311350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96080cf0-a51f-4370-8dcc-d5e94ab3df17 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:10.342693 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5b966b90-e183-45ec-b867-90dfdea132f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884062c855394418a1be82ea201a1448'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:10.345982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:10.356621 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5b966b90-e183-45ec-b867-90dfdea132f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884062c855394418a1be82ea201a1448'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:10.414088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1317/2667] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:10 2022] PUT /identity/v3/projects/e97a668f9ed8425999b400fcdd42590f/users/51c6a834be474f0fb147b3e57044b1ef/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:30:10.424318 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e907539-1e1d-4fef-be2e-59697394642e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:10.424609 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e907539-1e1d-4fef-be2e-59697394642e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:10.424890 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e907539-1e1d-4fef-be2e-59697394642e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:10.437073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5b966b90-e183-45ec-b867-90dfdea132f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884062c855394418a1be82ea201a1448'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:10.439406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5b966b90-e183-45ec-b867-90dfdea132f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884062c855394418a1be82ea201a1448'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:10.446649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5b966b90-e183-45ec-b867-90dfdea132f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884062c855394418a1be82ea201a1448'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:10.453335 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5e907539-1e1d-4fef-be2e-59697394642e None None] MFA Rules not processed for user `51c6a834be474f0fb147b3e57044b1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:10.454562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5e907539-1e1d-4fef-be2e-59697394642e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:10.456935 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1351/2668] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:10 2022] DELETE /identity/v3/users/884062c855394418a1be82ea201a1448 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:10.461078 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7149f05-20a7-4a6b-850b-3ab024c65e0b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:10.461469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7149f05-20a7-4a6b-850b-3ab024c65e0b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:10.461848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7149f05-20a7-4a6b-850b-3ab024c65e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:10.479420 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d7149f05-20a7-4a6b-850b-3ab024c65e0b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:10.480853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d7149f05-20a7-4a6b-850b-3ab024c65e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:10.533958 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1318/2669] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:10.535070 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e907539-1e1d-4fef-be2e-59697394642e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:10.536429 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5e907539-1e1d-4fef-be2e-59697394642e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:10.551853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1352/2670] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:10.552789 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7149f05-20a7-4a6b-850b-3ab024c65e0b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:10.554216 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d7149f05-20a7-4a6b-850b-3ab024c65e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:10.564151 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:10.569531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7149f05-20a7-4a6b-850b-3ab024c65e0b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:10.574909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618be91-0c5e-4075-b07c-6c09e189e8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:10.575601 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618be91-0c5e-4075-b07c-6c09e189e8bd admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:10.575882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618be91-0c5e-4075-b07c-6c09e189e8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:10.576195 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618be91-0c5e-4075-b07c-6c09e189e8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:10.576881 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618be91-0c5e-4075-b07c-6c09e189e8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:10.578780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618be91-0c5e-4075-b07c-6c09e189e8bd admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:10.618684 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e907539-1e1d-4fef-be2e-59697394642e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:10.624116 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a491491-0a10-4e52-af71-4c24a9fb9044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:10.624982 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a491491-0a10-4e52-af71-4c24a9fb9044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:10.625265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a491491-0a10-4e52-af71-4c24a9fb9044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:10.625538 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a491491-0a10-4e52-af71-4c24a9fb9044 admin admin] PATH_INFO: `/v3/users/fac99f5fe4cb4a2883692e3bf8e37439` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:10.626769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a491491-0a10-4e52-af71-4c24a9fb9044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac99f5fe4cb4a2883692e3bf8e37439)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:10.628730 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a491491-0a10-4e52-af71-4c24a9fb9044 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:10.667507 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1353/2671] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:10 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:10.668307 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618be91-0c5e-4075-b07c-6c09e189e8bd admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:10.669962 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f618be91-0c5e-4075-b07c-6c09e189e8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:10.726758 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618be91-0c5e-4075-b07c-6c09e189e8bd admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:10.731016 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301b73d-f302-4281-ab0a-3734233f3afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:10.731660 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b73d-f302-4281-ab0a-3734233f3afe service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:10.731948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b73d-f302-4281-ab0a-3734233f3afe service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:10.732257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b73d-f302-4281-ab0a-3734233f3afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:10.792936 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301b73d-f302-4281-ab0a-3734233f3afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:10.794384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301b73d-f302-4281-ab0a-3734233f3afe service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:10.803907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1354/2672] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:10.804642 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301b73d-f302-4281-ab0a-3734233f3afe service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:10.814767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301b73d-f302-4281-ab0a-3734233f3afe service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:10.820093 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441bde5-dd9d-45d4-9ede-dca9c23d125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:10.820768 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441bde5-dd9d-45d4-9ede-dca9c23d125d admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:10.821058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441bde5-dd9d-45d4-9ede-dca9c23d125d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:10.821345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441bde5-dd9d-45d4-9ede-dca9c23d125d admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:10.822024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441bde5-dd9d-45d4-9ede-dca9c23d125d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:10.824011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441bde5-dd9d-45d4-9ede-dca9c23d125d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:10.850934 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7a491491-0a10-4e52-af71-4c24a9fb9044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac99f5fe4cb4a2883692e3bf8e37439'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:10.864345 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7a491491-0a10-4e52-af71-4c24a9fb9044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac99f5fe4cb4a2883692e3bf8e37439'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:10.865301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7a491491-0a10-4e52-af71-4c24a9fb9044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac99f5fe4cb4a2883692e3bf8e37439'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:10.899198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1355/2673] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:10 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:10.903573 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441bde5-dd9d-45d4-9ede-dca9c23d125d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:10.905245 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6441bde5-dd9d-45d4-9ede-dca9c23d125d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:10.918491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441bde5-dd9d-45d4-9ede-dca9c23d125d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:10.923586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39003d-16a6-41fc-bf72-300f37bc2cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:10.924452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39003d-16a6-41fc-bf72-300f37bc2cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:10.924799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39003d-16a6-41fc-bf72-300f37bc2cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:10.925161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39003d-16a6-41fc-bf72-300f37bc2cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:10.925994 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39003d-16a6-41fc-bf72-300f37bc2cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:10.928046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39003d-16a6-41fc-bf72-300f37bc2cc1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:10.938578 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1356/2674] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:30:10.942750 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39003d-16a6-41fc-bf72-300f37bc2cc1 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:10.953396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39003d-16a6-41fc-bf72-300f37bc2cc1 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:10.958149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbe3b2-660a-451a-9966-a8c027de72c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:10.961695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbe3b2-660a-451a-9966-a8c027de72c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:10.961695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbe3b2-660a-451a-9966-a8c027de72c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:10.961695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbe3b2-660a-451a-9966-a8c027de72c5 admin admin] PATH_INFO: `/v3/projects/a69e703e48e0430fb7440c7af3258fb4/users/c8a9f4db989e4198ae9a78cb57077ed8/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:10.975102 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbe3b2-660a-451a-9966-a8c027de72c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69e703e48e0430fb7440c7af3258fb4, user_id=c8a9f4db989e4198ae9a78cb57077ed8, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:10.977854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbe3b2-660a-451a-9966-a8c027de72c5 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:10.980146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7a491491-0a10-4e52-af71-4c24a9fb9044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac99f5fe4cb4a2883692e3bf8e37439'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:10.980912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7a491491-0a10-4e52-af71-4c24a9fb9044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac99f5fe4cb4a2883692e3bf8e37439'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:10.990474 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:10.996418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1319/2675] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:10 2022] DELETE /identity/v3/users/fac99f5fe4cb4a2883692e3bf8e37439 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:11.000670 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820111df-8258-41b0-a3e3-a000b659d1d2 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:11.000962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820111df-8258-41b0-a3e3-a000b659d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:11.001241 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820111df-8258-41b0-a3e3-a000b659d1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:11.019048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-820111df-8258-41b0-a3e3-a000b659d1d2 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:11.020376 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-820111df-8258-41b0-a3e3-a000b659d1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:11.066959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1357/2676] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:10 2022] PUT /identity/v3/projects/a69e703e48e0430fb7440c7af3258fb4/users/c8a9f4db989e4198ae9a78cb57077ed8/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:30:11.071599 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbe3b2-660a-451a-9966-a8c027de72c5 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:11.094154 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1320/2677] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:11.107015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820111df-8258-41b0-a3e3-a000b659d1d2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:11.108398 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:11.110049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-820111df-8258-41b0-a3e3-a000b659d1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:11.142684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbe3b2-660a-451a-9966-a8c027de72c5 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:11.147583 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17aea7-fe9a-45bd-84c2-d8d7b193109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:11.148353 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17aea7-fe9a-45bd-84c2-d8d7b193109d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:11.148641 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17aea7-fe9a-45bd-84c2-d8d7b193109d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:11.148925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17aea7-fe9a-45bd-84c2-d8d7b193109d admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:11.149711 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17aea7-fe9a-45bd-84c2-d8d7b193109d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:11.151438 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17aea7-fe9a-45bd-84c2-d8d7b193109d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:11.163519 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1358/2678] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:30:11.214138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17aea7-fe9a-45bd-84c2-d8d7b193109d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:11.214138 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17aea7-fe9a-45bd-84c2-d8d7b193109d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:11.215025 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820111df-8258-41b0-a3e3-a000b659d1d2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:11.215198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ca483-6916-497a-9b40-25b9f1f7e27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:11.215198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ca483-6916-497a-9b40-25b9f1f7e27b admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:11.215198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ca483-6916-497a-9b40-25b9f1f7e27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:11.215198 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ca483-6916-497a-9b40-25b9f1f7e27b admin admin] PATH_INFO: `/v3/projects/a69e703e48e0430fb7440c7af3258fb4/users/c8a9f4db989e4198ae9a78cb57077ed8/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:11.215645 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ca483-6916-497a-9b40-25b9f1f7e27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69e703e48e0430fb7440c7af3258fb4, user_id=c8a9f4db989e4198ae9a78cb57077ed8, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:11.215645 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ca483-6916-497a-9b40-25b9f1f7e27b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:11.215645 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1359/2679] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:11 2022] PUT /identity/v3/projects/a69e703e48e0430fb7440c7af3258fb4/users/c8a9f4db989e4198ae9a78cb57077ed8/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:30:11.223891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f09088-8ee7-422c-bfa9-67351116cc98 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:11.224489 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f09088-8ee7-422c-bfa9-67351116cc98 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:11.224656 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f09088-8ee7-422c-bfa9-67351116cc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:11.233000 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda2540-50a4-4edc-92da-521a4247f80b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:11.233920 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda2540-50a4-4edc-92da-521a4247f80b service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:11.234090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda2540-50a4-4edc-92da-521a4247f80b service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:11.234265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda2540-50a4-4edc-92da-521a4247f80b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:11.244724 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda2540-50a4-4edc-92da-521a4247f80b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:11.247072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda2540-50a4-4edc-92da-521a4247f80b service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:11.259516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1321/2680] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:11.259863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c1f09088-8ee7-422c-bfa9-67351116cc98 None None] MFA Rules not processed for user `c8a9f4db989e4198ae9a78cb57077ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:11.261696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c1f09088-8ee7-422c-bfa9-67351116cc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:11.336938 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1360/2681] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:11.348250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda2540-50a4-4edc-92da-521a4247f80b service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:11.349821 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0eda2540-50a4-4edc-92da-521a4247f80b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:11.408928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda2540-50a4-4edc-92da-521a4247f80b service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:11.422665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:11.423375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f09088-8ee7-422c-bfa9-67351116cc98 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:11.424897 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c1f09088-8ee7-422c-bfa9-67351116cc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:11.489575 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6f25f-96a5-4805-9b58-67706c158dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:11.490243 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6f25f-96a5-4805-9b58-67706c158dcc service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:11.490669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6f25f-96a5-4805-9b58-67706c158dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:11.490954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6f25f-96a5-4805-9b58-67706c158dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:11.502398 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6f25f-96a5-4805-9b58-67706c158dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:11.503843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6f25f-96a5-4805-9b58-67706c158dcc service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:11.511038 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f09088-8ee7-422c-bfa9-67351116cc98 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:11.515256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1322/2682] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:11.517240 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:11.518735 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:11.519239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:11.519741 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] PATH_INFO: `/v3/projects/15835916927248f78c942aa08eeca533` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:11.522015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15835916927248f78c942aa08eeca533)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:11.526155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:11.622725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:11.633443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15835916927248f78c942aa08eeca533', 'request_id': 'req-f936ffe5-1c00-4d5a-a510-6338681f0476'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:11.637846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6f25f-96a5-4805-9b58-67706c158dcc service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:11.639459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-77f6f25f-96a5-4805-9b58-67706c158dcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:11.650961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6f25f-96a5-4805-9b58-67706c158dcc service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:11.693208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15835916927248f78c942aa08eeca533', 'request_id': 'req-f936ffe5-1c00-4d5a-a510-6338681f0476'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:11.699665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15835916927248f78c942aa08eeca533', 'request_id': 'req-f936ffe5-1c00-4d5a-a510-6338681f0476'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:11.708204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b9a55-2185-4cf3-a4d6-d9b4ec6a67ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:11.708373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b9a55-2185-4cf3-a4d6-d9b4ec6a67ac service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:11.708526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b9a55-2185-4cf3-a4d6-d9b4ec6a67ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:11.708794 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b9a55-2185-4cf3-a4d6-d9b4ec6a67ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:11.710651 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-398b9a55-2185-4cf3-a4d6-d9b4ec6a67ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:11.717851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] The token cache is being invalidate because project 15835916927248f78c942aa08eeca533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:11.718717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:11.719412 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:11.721125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1361/2683] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:11 2022] DELETE /identity/v3/projects/15835916927248f78c942aa08eeca533 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:30:11.792310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b9a55-2185-4cf3-a4d6-d9b4ec6a67ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:11.793903 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b9a55-2185-4cf3-a4d6-d9b4ec6a67ac service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:11.804733 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1323/2684] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:11.887074 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:11.888497 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:11.967525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936ffe5-1c00-4d5a-a510-6338681f0476 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:11.972964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:11.973893 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:11.974235 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:11.974454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] PATH_INFO: `/v3/projects/222fcfe6f8c447fa9522f102cdeb2d6f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:11.975706 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=222fcfe6f8c447fa9522f102cdeb2d6f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:11.977678 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:12.079097 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '222fcfe6f8c447fa9522f102cdeb2d6f', 'request_id': 'req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:12.173978 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '222fcfe6f8c447fa9522f102cdeb2d6f', 'request_id': 'req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:12.186695 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '222fcfe6f8c447fa9522f102cdeb2d6f', 'request_id': 'req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:12.200756 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] The token cache is being invalidate because project 222fcfe6f8c447fa9522f102cdeb2d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:12.201049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:12.201767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:12.203667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1362/2685] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:11 2022] DELETE /identity/v3/projects/222fcfe6f8c447fa9522f102cdeb2d6f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:12.207731 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b9a55-2185-4cf3-a4d6-d9b4ec6a67ac service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:12.214776 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-398b9a55-2185-4cf3-a4d6-d9b4ec6a67ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:12.222570 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b9a55-2185-4cf3-a4d6-d9b4ec6a67ac service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:12.283329 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac5e4a-2752-4e55-a794-7140f47440c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:12.284241 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac5e4a-2752-4e55-a794-7140f47440c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:12.284518 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac5e4a-2752-4e55-a794-7140f47440c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:12.284862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac5e4a-2752-4e55-a794-7140f47440c4 admin admin] PATH_INFO: `/v3/users/a1fdca74d4c24a91977d798bda61bff2` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:12.286058 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac5e4a-2752-4e55-a794-7140f47440c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1fdca74d4c24a91977d798bda61bff2)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:12.288044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac5e4a-2752-4e55-a794-7140f47440c4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:12.299350 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:12.438469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-beac5e4a-2752-4e55-a794-7140f47440c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1fdca74d4c24a91977d798bda61bff2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:12.450985 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-beac5e4a-2752-4e55-a794-7140f47440c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1fdca74d4c24a91977d798bda61bff2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:12.451772 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-beac5e4a-2752-4e55-a794-7140f47440c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1fdca74d4c24a91977d798bda61bff2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:12.529546 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-beac5e4a-2752-4e55-a794-7140f47440c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1fdca74d4c24a91977d798bda61bff2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:12.530752 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-beac5e4a-2752-4e55-a794-7140f47440c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1fdca74d4c24a91977d798bda61bff2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:12.545100 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1324/2686] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:12 2022] DELETE /identity/v3/users/a1fdca74d4c24a91977d798bda61bff2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:13.060907 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:13.064053 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:13.077136 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabd60b-ebff-46f0-aa43-55a95ed4c2fd admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:13.146201 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:13.152210 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:13.153072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:13.153356 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:13.153634 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927 admin admin] PATH_INFO: `/v3/projects/a65d3f0d0413404b8ab55ddfc0d95c7f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:13.154824 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a65d3f0d0413404b8ab55ddfc0d95c7f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:13.156819 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:13.265178 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a65d3f0d0413404b8ab55ddfc0d95c7f', 'request_id': 'req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:13.333582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a65d3f0d0413404b8ab55ddfc0d95c7f', 'request_id': 'req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:13.339364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a65d3f0d0413404b8ab55ddfc0d95c7f', 'request_id': 'req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:13.350761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927 admin admin] The token cache is being invalidate because project a65d3f0d0413404b8ab55ddfc0d95c7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:13.351050 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:13.351839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1b5db2ef-dc81-4a57-9458-a7ae5f5a2927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:13.353425 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1363/2687] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:13 2022] DELETE /identity/v3/projects/a65d3f0d0413404b8ab55ddfc0d95c7f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:13.358547 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e89e2-224b-4403-99f6-9bdf98e1dccf None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:13.359056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e89e2-224b-4403-99f6-9bdf98e1dccf None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:13.359164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e89e2-224b-4403-99f6-9bdf98e1dccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:13.377646 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-618e89e2-224b-4403-99f6-9bdf98e1dccf None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:13.378874 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-618e89e2-224b-4403-99f6-9bdf98e1dccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:13.439037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1325/2688] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:13.447175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c090c2-23a5-48e4-9ec9-5cdbe8f297fd None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:13.447490 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c090c2-23a5-48e4-9ec9-5cdbe8f297fd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:13.447771 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c090c2-23a5-48e4-9ec9-5cdbe8f297fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:13.466669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-97c090c2-23a5-48e4-9ec9-5cdbe8f297fd None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:13.467868 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-97c090c2-23a5-48e4-9ec9-5cdbe8f297fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:13.476942 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1364/2689] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:13.481294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e89e2-224b-4403-99f6-9bdf98e1dccf None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:13.490835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e89e2-224b-4403-99f6-9bdf98e1dccf None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:13.496187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a8d36-c6c0-4b4b-9626-7b3b97484a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:13.496841 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a8d36-c6c0-4b4b-9626-7b3b97484a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:13.497125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a8d36-c6c0-4b4b-9626-7b3b97484a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:13.497403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a8d36-c6c0-4b4b-9626-7b3b97484a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:13.498142 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a8d36-c6c0-4b4b-9626-7b3b97484a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:30:13.498471 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a8d36-c6c0-4b4b-9626-7b3b97484a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:13.500138 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a8d36-c6c0-4b4b-9626-7b3b97484a8d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:13.512461 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1326/2690] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:30:13.516699 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c090c2-23a5-48e4-9ec9-5cdbe8f297fd None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:13.525941 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c090c2-23a5-48e4-9ec9-5cdbe8f297fd None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:13.530987 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfeece-ae40-4fd7-9a81-3d771f5b2c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:13.531848 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfeece-ae40-4fd7-9a81-3d771f5b2c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:13.532154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfeece-ae40-4fd7-9a81-3d771f5b2c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:13.532491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfeece-ae40-4fd7-9a81-3d771f5b2c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:13.533237 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfeece-ae40-4fd7-9a81-3d771f5b2c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:13.535210 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfeece-ae40-4fd7-9a81-3d771f5b2c38 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:13.607483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1365/2691] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:13 2022] POST /identity/v3/projects => generated 409 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:13.608618 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a8d36-c6c0-4b4b-9626-7b3b97484a8d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:13.619623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a8d36-c6c0-4b4b-9626-7b3b97484a8d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:13.683296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87c71f-86fc-407e-9e47-59c8efc79a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:13.683964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87c71f-86fc-407e-9e47-59c8efc79a1a admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:13.684408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87c71f-86fc-407e-9e47-59c8efc79a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:13.684684 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87c71f-86fc-407e-9e47-59c8efc79a1a admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:13.685356 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87c71f-86fc-407e-9e47-59c8efc79a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:13.687256 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87c71f-86fc-407e-9e47-59c8efc79a1a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:13.759873 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5956a86-9758-4ffe-a16b-d55212993977 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:13.760312 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5956a86-9758-4ffe-a16b-d55212993977 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:13.760601 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5956a86-9758-4ffe-a16b-d55212993977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:13.778130 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d5956a86-9758-4ffe-a16b-d55212993977 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:13.779335 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d5956a86-9758-4ffe-a16b-d55212993977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:13.788032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1366/2692] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jul 14 10:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:13.793416 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1327/2693] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:13 2022] POST /identity/v3/users => generated 305 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:30:13.794581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5956a86-9758-4ffe-a16b-d55212993977 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:13.804393 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5956a86-9758-4ffe-a16b-d55212993977 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:13.810062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdb106-bbbb-434b-b7fa-f74ee029a294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:13.810728 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb106-bbbb-434b-b7fa-f74ee029a294 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:13.811019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb106-bbbb-434b-b7fa-f74ee029a294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:13.811234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87c71f-86fc-407e-9e47-59c8efc79a1a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:13.811358 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb106-bbbb-434b-b7fa-f74ee029a294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:13.812826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdb106-bbbb-434b-b7fa-f74ee029a294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:13.813652 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ac87c71f-86fc-407e-9e47-59c8efc79a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:13.814647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdb106-bbbb-434b-b7fa-f74ee029a294 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:13.826770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:13.826890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1367/2694] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:30:13.830145 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdb106-bbbb-434b-b7fa-f74ee029a294 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:13.845395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdb106-bbbb-434b-b7fa-f74ee029a294 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:13.845871 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3e5f4-ecc2-417f-bea8-6149aebb55f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:13.846542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3e5f4-ecc2-417f-bea8-6149aebb55f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:13.846836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3e5f4-ecc2-417f-bea8-6149aebb55f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:13.847114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3e5f4-ecc2-417f-bea8-6149aebb55f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:13.847842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3e5f4-ecc2-417f-bea8-6149aebb55f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:13.849470 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3e5f4-ecc2-417f-bea8-6149aebb55f7 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:13.860740 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1368/2695] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:13.864947 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3e5f4-ecc2-417f-bea8-6149aebb55f7 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:13.875473 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3e5f4-ecc2-417f-bea8-6149aebb55f7 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:13.880233 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0e930-d88a-40ac-9349-f5221bdba9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:13.881114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0e930-d88a-40ac-9349-f5221bdba9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:13.881396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0e930-d88a-40ac-9349-f5221bdba9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:13.881672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0e930-d88a-40ac-9349-f5221bdba9bd admin admin] PATH_INFO: `/v3/projects/c4c644ccbc664030a85caa8490ec446f/users/dea40f896c2d413591a3b1aa53ea4437/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:13.896237 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0e930-d88a-40ac-9349-f5221bdba9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c644ccbc664030a85caa8490ec446f, user_id=dea40f896c2d413591a3b1aa53ea4437, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:13.898892 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0e930-d88a-40ac-9349-f5221bdba9bd admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:13.899181 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87c71f-86fc-407e-9e47-59c8efc79a1a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:13.905532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fb06b-b285-4549-b598-f841102fc6a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:13.906215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fb06b-b285-4549-b598-f841102fc6a8 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:13.906502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fb06b-b285-4549-b598-f841102fc6a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:13.906781 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fb06b-b285-4549-b598-f841102fc6a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:13.915610 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395fb06b-b285-4549-b598-f841102fc6a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:13.917816 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395fb06b-b285-4549-b598-f841102fc6a8 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:13.927346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1328/2696] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:13.975154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1369/2697] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:13 2022] PUT /identity/v3/projects/c4c644ccbc664030a85caa8490ec446f/users/dea40f896c2d413591a3b1aa53ea4437/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:30:13.986889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161fa47-ac0f-4e6c-8f12-3cf4d5f4b081 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:13.987185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161fa47-ac0f-4e6c-8f12-3cf4d5f4b081 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:13.987467 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161fa47-ac0f-4e6c-8f12-3cf4d5f4b081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:14.017812 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9161fa47-ac0f-4e6c-8f12-3cf4d5f4b081 None None] MFA Rules not processed for user `dea40f896c2d413591a3b1aa53ea4437`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:14.018264 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9161fa47-ac0f-4e6c-8f12-3cf4d5f4b081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:14.098203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1329/2698] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:13 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:14.102686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0e930-d88a-40ac-9349-f5221bdba9bd admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:14.168894 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0e930-d88a-40ac-9349-f5221bdba9bd admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:14.173622 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681a200-26c6-4c3b-b89f-540a282436ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:14.174292 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681a200-26c6-4c3b-b89f-540a282436ad admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:14.174576 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681a200-26c6-4c3b-b89f-540a282436ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:14.174853 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681a200-26c6-4c3b-b89f-540a282436ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:14.175551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681a200-26c6-4c3b-b89f-540a282436ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:14.177485 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681a200-26c6-4c3b-b89f-540a282436ad admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:14.188105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:14.272044 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1370/2699] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:14 2022] POST /identity/v3/projects => generated 407 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:14.276421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161fa47-ac0f-4e6c-8f12-3cf4d5f4b081 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:14.287022 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161fa47-ac0f-4e6c-8f12-3cf4d5f4b081 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:14.344427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2fd8f-4126-47fb-9b05-63a65d817759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:14.345248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2fd8f-4126-47fb-9b05-63a65d817759 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:14.345577 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2fd8f-4126-47fb-9b05-63a65d817759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:14.345859 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2fd8f-4126-47fb-9b05-63a65d817759 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:14.346587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2fd8f-4126-47fb-9b05-63a65d817759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:14.348562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2fd8f-4126-47fb-9b05-63a65d817759 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:14.420294 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1330/2700] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:14 2022] POST /identity/v3/users => generated 310 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:14.424540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681a200-26c6-4c3b-b89f-540a282436ad admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:14.435491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681a200-26c6-4c3b-b89f-540a282436ad admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:14.440051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6219439-df28-4a25-aba6-533ba51b00be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:14.440764 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6219439-df28-4a25-aba6-533ba51b00be admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:14.440991 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6219439-df28-4a25-aba6-533ba51b00be admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:14.441486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6219439-df28-4a25-aba6-533ba51b00be admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:14.442380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6219439-df28-4a25-aba6-533ba51b00be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:14.444757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6219439-df28-4a25-aba6-533ba51b00be admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:14.455211 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1371/2701] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:14.459285 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2fd8f-4126-47fb-9b05-63a65d817759 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:14.469247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2fd8f-4126-47fb-9b05-63a65d817759 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:14.473905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc89edb-e588-489a-9382-ae90b3611218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:14.474786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc89edb-e588-489a-9382-ae90b3611218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:14.475069 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc89edb-e588-489a-9382-ae90b3611218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:14.481346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc89edb-e588-489a-9382-ae90b3611218 admin admin] PATH_INFO: `/v3/projects/54f67b2f9342414ab0ab4c32eb0a9053/users/d69e3a8af48e4f9f94ff7e19a5eab25b/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:14.481346 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:14.490762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc89edb-e588-489a-9382-ae90b3611218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f67b2f9342414ab0ab4c32eb0a9053, user_id=d69e3a8af48e4f9f94ff7e19a5eab25b, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:14.493436 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc89edb-e588-489a-9382-ae90b3611218 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:14.573384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1331/2702] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:14 2022] PUT /identity/v3/projects/54f67b2f9342414ab0ab4c32eb0a9053/users/d69e3a8af48e4f9f94ff7e19a5eab25b/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:14.577329 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6219439-df28-4a25-aba6-533ba51b00be admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:14.587114 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6219439-df28-4a25-aba6-533ba51b00be admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:14.649152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067509d7-092c-4c69-836b-c1cade0d5bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:14.649837 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067509d7-092c-4c69-836b-c1cade0d5bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:14.650124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067509d7-092c-4c69-836b-c1cade0d5bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:14.650437 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067509d7-092c-4c69-836b-c1cade0d5bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:14.651202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067509d7-092c-4c69-836b-c1cade0d5bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:14.653390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067509d7-092c-4c69-836b-c1cade0d5bc3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:14.663302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1372/2703] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:30:14.667488 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc89edb-e588-489a-9382-ae90b3611218 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:14.678999 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc89edb-e588-489a-9382-ae90b3611218 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:14.683721 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332d716-98aa-460d-9021-f491740ee4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:14.684645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332d716-98aa-460d-9021-f491740ee4a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:14.684928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332d716-98aa-460d-9021-f491740ee4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:14.685228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332d716-98aa-460d-9021-f491740ee4a9 admin admin] PATH_INFO: `/v3/projects/54f67b2f9342414ab0ab4c32eb0a9053/users/d69e3a8af48e4f9f94ff7e19a5eab25b/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:14.687188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332d716-98aa-460d-9021-f491740ee4a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f67b2f9342414ab0ab4c32eb0a9053, user_id=d69e3a8af48e4f9f94ff7e19a5eab25b, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:14.689856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332d716-98aa-460d-9021-f491740ee4a9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:14.700430 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1332/2704] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:14 2022] PUT /identity/v3/projects/54f67b2f9342414ab0ab4c32eb0a9053/users/d69e3a8af48e4f9f94ff7e19a5eab25b/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:14.711864 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23478ac-8b75-48b5-8d51-1ed869817182 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:14.712189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23478ac-8b75-48b5-8d51-1ed869817182 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:14.712467 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23478ac-8b75-48b5-8d51-1ed869817182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:14.739109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f23478ac-8b75-48b5-8d51-1ed869817182 None None] MFA Rules not processed for user `d69e3a8af48e4f9f94ff7e19a5eab25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:14.740362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f23478ac-8b75-48b5-8d51-1ed869817182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:14.807217 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1373/2705] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:14 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:14.818527 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332d716-98aa-460d-9021-f491740ee4a9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:14.820242 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c332d716-98aa-460d-9021-f491740ee4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:14.877484 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332d716-98aa-460d-9021-f491740ee4a9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:14.881140 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58909e-edda-43ab-bf5c-639d1974487d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:14.881770 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58909e-edda-43ab-bf5c-639d1974487d service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:14.882049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58909e-edda-43ab-bf5c-639d1974487d service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:14.882332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58909e-edda-43ab-bf5c-639d1974487d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:14.891389 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58909e-edda-43ab-bf5c-639d1974487d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:14.892919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58909e-edda-43ab-bf5c-639d1974487d service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:14.902906 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1333/2706] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:14 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:15.306400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23478ac-8b75-48b5-8d51-1ed869817182 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:15.316383 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23478ac-8b75-48b5-8d51-1ed869817182 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:15.320266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60616aad-642e-449b-bcb7-9930b460c4b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:15.320906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60616aad-642e-449b-bcb7-9930b460c4b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:15.321191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60616aad-642e-449b-bcb7-9930b460c4b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:15.321468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60616aad-642e-449b-bcb7-9930b460c4b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:15.380939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60616aad-642e-449b-bcb7-9930b460c4b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:15.382384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60616aad-642e-449b-bcb7-9930b460c4b1 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:15.387656 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:15.392454 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1374/2707] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:15 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:15.845272 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58909e-edda-43ab-bf5c-639d1974487d service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:15.846835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6d58909e-edda-43ab-bf5c-639d1974487d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:15.911607 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58909e-edda-43ab-bf5c-639d1974487d service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:15.916314 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dc716-2e29-427f-8222-e540e434b37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:15.918650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dc716-2e29-427f-8222-e540e434b37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:15.918650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dc716-2e29-427f-8222-e540e434b37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:15.918650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dc716-2e29-427f-8222-e540e434b37a admin admin] PATH_INFO: `/v3/users/dd7be528375f43a99a217e60855ed7c2` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:15.919576 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58dc716-2e29-427f-8222-e540e434b37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd7be528375f43a99a217e60855ed7c2)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:15.921659 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58dc716-2e29-427f-8222-e540e434b37a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:16.147068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e58dc716-2e29-427f-8222-e540e434b37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd7be528375f43a99a217e60855ed7c2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:16.159653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e58dc716-2e29-427f-8222-e540e434b37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd7be528375f43a99a217e60855ed7c2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:16.160408 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e58dc716-2e29-427f-8222-e540e434b37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd7be528375f43a99a217e60855ed7c2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:16.259037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e58dc716-2e29-427f-8222-e540e434b37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd7be528375f43a99a217e60855ed7c2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:16.259753 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e58dc716-2e29-427f-8222-e540e434b37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd7be528375f43a99a217e60855ed7c2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:16.265300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:16.274775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1334/2708] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:15 2022] DELETE /identity/v3/users/dd7be528375f43a99a217e60855ed7c2 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:16.279919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4e16d-c292-4566-8610-88b6013b2cc2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:16.280239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4e16d-c292-4566-8610-88b6013b2cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:16.280526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4e16d-c292-4566-8610-88b6013b2cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:16.298069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-dab4e16d-c292-4566-8610-88b6013b2cc2 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:16.299259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-dab4e16d-c292-4566-8610-88b6013b2cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:16.358221 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1375/2709] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:16.368156 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dc716-2e29-427f-8222-e540e434b37a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:16.370106 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e58dc716-2e29-427f-8222-e540e434b37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:16.427414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dc716-2e29-427f-8222-e540e434b37a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:16.431115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088e2a0-0c8a-423c-b77c-fc63a96b7639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:16.431760 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088e2a0-0c8a-423c-b77c-fc63a96b7639 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:16.432097 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088e2a0-0c8a-423c-b77c-fc63a96b7639 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:16.432382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088e2a0-0c8a-423c-b77c-fc63a96b7639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:16.443009 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088e2a0-0c8a-423c-b77c-fc63a96b7639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:16.444483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088e2a0-0c8a-423c-b77c-fc63a96b7639 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:16.454111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1335/2710] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:16.854140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4e16d-c292-4566-8610-88b6013b2cc2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:16.855677 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-dab4e16d-c292-4566-8610-88b6013b2cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:16.867882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4e16d-c292-4566-8610-88b6013b2cc2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:16.873339 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:16.874264 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:16.874553 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:16.874833 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] PATH_INFO: `/v3/projects/8d217cee544c4c8ab80abcfa48bbb848` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:16.876066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d217cee544c4c8ab80abcfa48bbb848)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:16.877979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:16.989709 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d217cee544c4c8ab80abcfa48bbb848', 'request_id': 'req-0ec81461-0b60-4026-9840-89d77e218571'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:17.064672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d217cee544c4c8ab80abcfa48bbb848', 'request_id': 'req-0ec81461-0b60-4026-9840-89d77e218571'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:17.071654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d217cee544c4c8ab80abcfa48bbb848', 'request_id': 'req-0ec81461-0b60-4026-9840-89d77e218571'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:17.083718 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] The token cache is being invalidate because project 8d217cee544c4c8ab80abcfa48bbb848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:17.083916 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:17.084610 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:17.087160 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1376/2711] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:16 2022] DELETE /identity/v3/projects/8d217cee544c4c8ab80abcfa48bbb848 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:17.091103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088e2a0-0c8a-423c-b77c-fc63a96b7639 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:17.101503 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088e2a0-0c8a-423c-b77c-fc63a96b7639 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:17.159303 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a6b0-dfd9-4f4c-a501-416e2fe836c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:17.160234 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a6b0-dfd9-4f4c-a501-416e2fe836c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:17.160523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a6b0-dfd9-4f4c-a501-416e2fe836c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:17.160800 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a6b0-dfd9-4f4c-a501-416e2fe836c5 admin admin] PATH_INFO: `/v3/users/51c6a834be474f0fb147b3e57044b1ef` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:17.162007 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41a6b0-dfd9-4f4c-a501-416e2fe836c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c6a834be474f0fb147b3e57044b1ef)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:17.163946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41a6b0-dfd9-4f4c-a501-416e2fe836c5 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:17.363775 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f41a6b0-dfd9-4f4c-a501-416e2fe836c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c6a834be474f0fb147b3e57044b1ef'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:17.376807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f41a6b0-dfd9-4f4c-a501-416e2fe836c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c6a834be474f0fb147b3e57044b1ef'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:17.377532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f41a6b0-dfd9-4f4c-a501-416e2fe836c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c6a834be474f0fb147b3e57044b1ef'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:17.452850 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f41a6b0-dfd9-4f4c-a501-416e2fe836c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c6a834be474f0fb147b3e57044b1ef'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:17.453464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f41a6b0-dfd9-4f4c-a501-416e2fe836c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c6a834be474f0fb147b3e57044b1ef'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:17.466245 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1336/2712] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:17 2022] DELETE /identity/v3/users/51c6a834be474f0fb147b3e57044b1ef => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:17.882538 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:17.883799 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:17.897244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec81461-0b60-4026-9840-89d77e218571 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:17.955832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:17.956726 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:17.957011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:17.957291 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] PATH_INFO: `/v3/projects/e97a668f9ed8425999b400fcdd42590f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:17.958483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e97a668f9ed8425999b400fcdd42590f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:17.960429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:18.031384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:18.047406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97a668f9ed8425999b400fcdd42590f', 'request_id': 'req-11f319aa-39b8-43e4-b2a9-1f892c4168ca'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:18.143964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97a668f9ed8425999b400fcdd42590f', 'request_id': 'req-11f319aa-39b8-43e4-b2a9-1f892c4168ca'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:18.150088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97a668f9ed8425999b400fcdd42590f', 'request_id': 'req-11f319aa-39b8-43e4-b2a9-1f892c4168ca'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:18.161755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] The token cache is being invalidate because project e97a668f9ed8425999b400fcdd42590f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:18.162049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:18.162692 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:18.164607 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1377/2713] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:17 2022] DELETE /identity/v3/projects/e97a668f9ed8425999b400fcdd42590f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:18.168391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a6b0-dfd9-4f4c-a501-416e2fe836c5 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:18.169809 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2f41a6b0-dfd9-4f4c-a501-416e2fe836c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:18.182996 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a6b0-dfd9-4f4c-a501-416e2fe836c5 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:18.194974 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:18.240238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d4a14-302a-4436-a402-7ece747c556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:18.241117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d4a14-302a-4436-a402-7ece747c556d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:18.241472 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d4a14-302a-4436-a402-7ece747c556d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:18.241763 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d4a14-302a-4436-a402-7ece747c556d admin admin] PATH_INFO: `/v3/users/c8a9f4db989e4198ae9a78cb57077ed8` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:18.242980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d4a14-302a-4436-a402-7ece747c556d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a9f4db989e4198ae9a78cb57077ed8)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:18.244919 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d4a14-302a-4436-a402-7ece747c556d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:18.431825 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7c3d4a14-302a-4436-a402-7ece747c556d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a9f4db989e4198ae9a78cb57077ed8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:18.444258 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7c3d4a14-302a-4436-a402-7ece747c556d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a9f4db989e4198ae9a78cb57077ed8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:18.444933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7c3d4a14-302a-4436-a402-7ece747c556d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a9f4db989e4198ae9a78cb57077ed8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:18.509648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7c3d4a14-302a-4436-a402-7ece747c556d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a9f4db989e4198ae9a78cb57077ed8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:18.510442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7c3d4a14-302a-4436-a402-7ece747c556d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a9f4db989e4198ae9a78cb57077ed8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:18.524367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1337/2714] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:18 2022] DELETE /identity/v3/users/c8a9f4db989e4198ae9a78cb57077ed8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:18.969001 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:18.970396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:18.984774 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f319aa-39b8-43e4-b2a9-1f892c4168ca admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:19.048925 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db9ce2-3d7a-4935-8d83-c2719e31d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:19.049794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db9ce2-3d7a-4935-8d83-c2719e31d479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:19.050076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db9ce2-3d7a-4935-8d83-c2719e31d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:19.050358 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db9ce2-3d7a-4935-8d83-c2719e31d479 admin admin] PATH_INFO: `/v3/projects/a69e703e48e0430fb7440c7af3258fb4` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:19.051554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db9ce2-3d7a-4935-8d83-c2719e31d479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69e703e48e0430fb7440c7af3258fb4)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:19.053495 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db9ce2-3d7a-4935-8d83-c2719e31d479 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:19.174246 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c3db9ce2-3d7a-4935-8d83-c2719e31d479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69e703e48e0430fb7440c7af3258fb4', 'request_id': 'req-c3db9ce2-3d7a-4935-8d83-c2719e31d479'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:19.258893 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c3db9ce2-3d7a-4935-8d83-c2719e31d479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69e703e48e0430fb7440c7af3258fb4', 'request_id': 'req-c3db9ce2-3d7a-4935-8d83-c2719e31d479'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:19.269107 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c3db9ce2-3d7a-4935-8d83-c2719e31d479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69e703e48e0430fb7440c7af3258fb4', 'request_id': 'req-c3db9ce2-3d7a-4935-8d83-c2719e31d479'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:19.281380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c3db9ce2-3d7a-4935-8d83-c2719e31d479 admin admin] The token cache is being invalidate because project a69e703e48e0430fb7440c7af3258fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:19.281676 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c3db9ce2-3d7a-4935-8d83-c2719e31d479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:19.282455 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c3db9ce2-3d7a-4935-8d83-c2719e31d479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:19.284223 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1378/2715] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:18 2022] DELETE /identity/v3/projects/a69e703e48e0430fb7440c7af3258fb4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:19.290069 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedbeae-d42c-4de8-90e7-9ab1a9d8c93c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:19.291209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedbeae-d42c-4de8-90e7-9ab1a9d8c93c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:19.291687 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedbeae-d42c-4de8-90e7-9ab1a9d8c93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:19.311482 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ceedbeae-d42c-4de8-90e7-9ab1a9d8c93c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:19.312711 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ceedbeae-d42c-4de8-90e7-9ab1a9d8c93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:19.371875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1338/2716] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:19.380687 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab785358-3775-4e83-a815-f2e2358f2d59 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:19.381117 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab785358-3775-4e83-a815-f2e2358f2d59 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:19.381456 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab785358-3775-4e83-a815-f2e2358f2d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:19.400363 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ab785358-3775-4e83-a815-f2e2358f2d59 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:19.401606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ab785358-3775-4e83-a815-f2e2358f2d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:19.410946 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1379/2717] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:19.415131 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedbeae-d42c-4de8-90e7-9ab1a9d8c93c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:19.425562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedbeae-d42c-4de8-90e7-9ab1a9d8c93c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:19.430233 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d592d4-fa87-439a-89d4-6c4065a70407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:19.430885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d592d4-fa87-439a-89d4-6c4065a70407 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:19.431171 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d592d4-fa87-439a-89d4-6c4065a70407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:19.431445 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d592d4-fa87-439a-89d4-6c4065a70407 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:19.432208 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d592d4-fa87-439a-89d4-6c4065a70407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:30:19.432515 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d592d4-fa87-439a-89d4-6c4065a70407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:19.434155 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d592d4-fa87-439a-89d4-6c4065a70407 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:19.445938 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1339/2718] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:30:19.450857 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab785358-3775-4e83-a815-f2e2358f2d59 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:19.460041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab785358-3775-4e83-a815-f2e2358f2d59 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:19.464754 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7bb2-b7e3-4ba2-8120-4067ae2ba077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:19.466103 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7bb2-b7e3-4ba2-8120-4067ae2ba077 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:19.466390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7bb2-b7e3-4ba2-8120-4067ae2ba077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:19.466667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7bb2-b7e3-4ba2-8120-4067ae2ba077 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:19.467360 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7bb2-b7e3-4ba2-8120-4067ae2ba077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:19.469304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7bb2-b7e3-4ba2-8120-4067ae2ba077 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:19.631563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1380/2719] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:19 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:19.635725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d592d4-fa87-439a-89d4-6c4065a70407 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:19.646596 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d592d4-fa87-439a-89d4-6c4065a70407 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:19.666192 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:19.703372 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96a5a2-6881-4c5e-acd2-a945ab11aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:19.704260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96a5a2-6881-4c5e-acd2-a945ab11aca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:19.704662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96a5a2-6881-4c5e-acd2-a945ab11aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:19.704946 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96a5a2-6881-4c5e-acd2-a945ab11aca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:19.705645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96a5a2-6881-4c5e-acd2-a945ab11aca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:19.707585 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96a5a2-6881-4c5e-acd2-a945ab11aca0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:19.806599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1340/2720] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:19 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:30:19.810942 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7bb2-b7e3-4ba2-8120-4067ae2ba077 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:19.821558 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7bb2-b7e3-4ba2-8120-4067ae2ba077 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:19.826829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb9156-d50c-45ba-af82-89e020752e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:19.827552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb9156-d50c-45ba-af82-89e020752e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:19.827840 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb9156-d50c-45ba-af82-89e020752e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:19.828153 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb9156-d50c-45ba-af82-89e020752e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:19.828882 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb9156-d50c-45ba-af82-89e020752e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:19.830476 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb9156-d50c-45ba-af82-89e020752e7b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:19.841604 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1381/2721] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:30:19.845465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96a5a2-6881-4c5e-acd2-a945ab11aca0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:19.856167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96a5a2-6881-4c5e-acd2-a945ab11aca0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:19.860786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff813d06-c11b-42df-8523-8bc06eea0940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:19.861442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff813d06-c11b-42df-8523-8bc06eea0940 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:19.861723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff813d06-c11b-42df-8523-8bc06eea0940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:19.861997 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff813d06-c11b-42df-8523-8bc06eea0940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:19.862747 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff813d06-c11b-42df-8523-8bc06eea0940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:19.864368 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff813d06-c11b-42df-8523-8bc06eea0940 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:19.874601 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1341/2722] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:19.878769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb9156-d50c-45ba-af82-89e020752e7b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:19.885205 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:19.889472 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb9156-d50c-45ba-af82-89e020752e7b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:19.894145 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0d879-b280-4238-8213-fb0c596972cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:19.895021 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0d879-b280-4238-8213-fb0c596972cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:19.895305 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0d879-b280-4238-8213-fb0c596972cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:19.895579 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0d879-b280-4238-8213-fb0c596972cd admin admin] PATH_INFO: `/v3/projects/ec740355cbfb4927b64298a80e84aec2/users/8104e943e37042d381df5b9392d4b8a3/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:19.909788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0d879-b280-4238-8213-fb0c596972cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec740355cbfb4927b64298a80e84aec2, user_id=8104e943e37042d381df5b9392d4b8a3, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:19.912473 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0d879-b280-4238-8213-fb0c596972cd admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:19.978208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1382/2723] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:19 2022] PUT /identity/v3/projects/ec740355cbfb4927b64298a80e84aec2/users/8104e943e37042d381df5b9392d4b8a3/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:19.989630 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253754a-a630-4d6e-9e5e-14dbc93c7e28 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:19.989947 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253754a-a630-4d6e-9e5e-14dbc93c7e28 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:19.990224 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253754a-a630-4d6e-9e5e-14dbc93c7e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:20.017271 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9253754a-a630-4d6e-9e5e-14dbc93c7e28 None None] MFA Rules not processed for user `8104e943e37042d381df5b9392d4b8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:20.018269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9253754a-a630-4d6e-9e5e-14dbc93c7e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:20.082395 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1342/2724] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:20.087025 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0d879-b280-4238-8213-fb0c596972cd admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:20.148830 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0d879-b280-4238-8213-fb0c596972cd admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:20.153505 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313f59d-f806-4cb2-ad47-b56db8ee3a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:20.154161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313f59d-f806-4cb2-ad47-b56db8ee3a12 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:20.154451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313f59d-f806-4cb2-ad47-b56db8ee3a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:20.154729 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313f59d-f806-4cb2-ad47-b56db8ee3a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:20.155423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313f59d-f806-4cb2-ad47-b56db8ee3a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:20.157368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313f59d-f806-4cb2-ad47-b56db8ee3a12 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:20.255177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1383/2725] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:20 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:20.259340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253754a-a630-4d6e-9e5e-14dbc93c7e28 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:20.270120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253754a-a630-4d6e-9e5e-14dbc93c7e28 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:20.328467 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fa094-d88e-47be-97a3-49169691d93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:20.330882 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fa094-d88e-47be-97a3-49169691d93c admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:20.330882 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fa094-d88e-47be-97a3-49169691d93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:20.330882 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fa094-d88e-47be-97a3-49169691d93c admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:20.330882 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fa094-d88e-47be-97a3-49169691d93c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:20.332381 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fa094-d88e-47be-97a3-49169691d93c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:20.434563 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1343/2726] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:20 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:20.435045 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313f59d-f806-4cb2-ad47-b56db8ee3a12 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:20.445891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313f59d-f806-4cb2-ad47-b56db8ee3a12 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:20.451295 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6992d-1484-4f83-b960-caf49f559e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:20.451961 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6992d-1484-4f83-b960-caf49f559e8b admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:20.452266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6992d-1484-4f83-b960-caf49f559e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:20.452541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6992d-1484-4f83-b960-caf49f559e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:20.453262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6992d-1484-4f83-b960-caf49f559e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:20.454842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6992d-1484-4f83-b960-caf49f559e8b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:20.466493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1384/2727] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:30:20.470551 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fa094-d88e-47be-97a3-49169691d93c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:20.481238 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fa094-d88e-47be-97a3-49169691d93c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:20.486377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79a7f2-7b71-42f4-b91e-c28af10d659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:20.487295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79a7f2-7b71-42f4-b91e-c28af10d659b admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:20.487579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79a7f2-7b71-42f4-b91e-c28af10d659b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:20.493173 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79a7f2-7b71-42f4-b91e-c28af10d659b admin admin] PATH_INFO: `/v3/projects/35beb9d47fb64f428196d541d9223894/users/2458e05d72ba4df38904288f75c3f05b/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:20.502615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79a7f2-7b71-42f4-b91e-c28af10d659b admin admin] RBAC: Authorizing `identity:create_grant(project_id=35beb9d47fb64f428196d541d9223894, user_id=2458e05d72ba4df38904288f75c3f05b, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:20.505373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79a7f2-7b71-42f4-b91e-c28af10d659b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:20.508357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:20.637531 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1344/2728] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:20 2022] PUT /identity/v3/projects/35beb9d47fb64f428196d541d9223894/users/2458e05d72ba4df38904288f75c3f05b/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:20.641418 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6992d-1484-4f83-b960-caf49f559e8b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:20.652124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6992d-1484-4f83-b960-caf49f559e8b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:20.715494 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e40dcf-5822-4492-bdb0-c099e3ce0266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:20.716266 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40dcf-5822-4492-bdb0-c099e3ce0266 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:20.716561 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40dcf-5822-4492-bdb0-c099e3ce0266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:20.716889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40dcf-5822-4492-bdb0-c099e3ce0266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:20.717629 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e40dcf-5822-4492-bdb0-c099e3ce0266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:20.719297 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e40dcf-5822-4492-bdb0-c099e3ce0266 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:20.729943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1385/2729] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:20.735037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79a7f2-7b71-42f4-b91e-c28af10d659b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:20.745669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79a7f2-7b71-42f4-b91e-c28af10d659b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:20.750534 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4115a3-e39f-4ba2-b4d1-d5d39e0c89ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:20.752365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4115a3-e39f-4ba2-b4d1-d5d39e0c89ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:20.752365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4115a3-e39f-4ba2-b4d1-d5d39e0c89ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:20.752365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4115a3-e39f-4ba2-b4d1-d5d39e0c89ed admin admin] PATH_INFO: `/v3/projects/35beb9d47fb64f428196d541d9223894/users/2458e05d72ba4df38904288f75c3f05b/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:20.754181 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4115a3-e39f-4ba2-b4d1-d5d39e0c89ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=35beb9d47fb64f428196d541d9223894, user_id=2458e05d72ba4df38904288f75c3f05b, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:20.756833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4115a3-e39f-4ba2-b4d1-d5d39e0c89ed admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:20.767644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1345/2730] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:20 2022] PUT /identity/v3/projects/35beb9d47fb64f428196d541d9223894/users/2458e05d72ba4df38904288f75c3f05b/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:20.833557 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b761235-9c6b-4ec5-ad13-8feaa61e25d5 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:20.833847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b761235-9c6b-4ec5-ad13-8feaa61e25d5 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:20.834125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b761235-9c6b-4ec5-ad13-8feaa61e25d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:20.863704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0b761235-9c6b-4ec5-ad13-8feaa61e25d5 None None] MFA Rules not processed for user `2458e05d72ba4df38904288f75c3f05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:20.865244 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0b761235-9c6b-4ec5-ad13-8feaa61e25d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:20.907190 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:20.935203 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1386/2731] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:20.948270 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4115a3-e39f-4ba2-b4d1-d5d39e0c89ed admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:20.950465 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4a4115a3-e39f-4ba2-b4d1-d5d39e0c89ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:21.006415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4115a3-e39f-4ba2-b4d1-d5d39e0c89ed admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:21.010117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b8fc5-4054-4f61-a243-2d3229a9b2be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:21.010758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b8fc5-4054-4f61-a243-2d3229a9b2be service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:21.011110 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b8fc5-4054-4f61-a243-2d3229a9b2be service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:21.011393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b8fc5-4054-4f61-a243-2d3229a9b2be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:21.071453 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b8fc5-4054-4f61-a243-2d3229a9b2be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:21.072992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b8fc5-4054-4f61-a243-2d3229a9b2be service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:21.082819 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1346/2732] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:22.156952 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b761235-9c6b-4ec5-ad13-8feaa61e25d5 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:22.158422 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0b761235-9c6b-4ec5-ad13-8feaa61e25d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:22.222751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b761235-9c6b-4ec5-ad13-8feaa61e25d5 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:22.227218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3ad31-8651-4be7-82d3-a16f709cccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:22.228119 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3ad31-8651-4be7-82d3-a16f709cccd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:22.228404 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3ad31-8651-4be7-82d3-a16f709cccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:22.228678 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3ad31-8651-4be7-82d3-a16f709cccd6 admin admin] PATH_INFO: `/v3/users/dea40f896c2d413591a3b1aa53ea4437` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:22.229879 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3ad31-8651-4be7-82d3-a16f709cccd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea40f896c2d413591a3b1aa53ea4437)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:22.232526 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3ad31-8651-4be7-82d3-a16f709cccd6 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:22.380483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-22a3ad31-8651-4be7-82d3-a16f709cccd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea40f896c2d413591a3b1aa53ea4437'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:22.392658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-22a3ad31-8651-4be7-82d3-a16f709cccd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea40f896c2d413591a3b1aa53ea4437'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:22.452693 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-22a3ad31-8651-4be7-82d3-a16f709cccd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea40f896c2d413591a3b1aa53ea4437'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:22.453327 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-22a3ad31-8651-4be7-82d3-a16f709cccd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea40f896c2d413591a3b1aa53ea4437'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:22.460718 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-22a3ad31-8651-4be7-82d3-a16f709cccd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea40f896c2d413591a3b1aa53ea4437'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:22.467302 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1387/2733] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:22 2022] DELETE /identity/v3/users/dea40f896c2d413591a3b1aa53ea4437 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:22.471875 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc9020-2f93-4461-8137-32c62d15c60d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:22.472384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc9020-2f93-4461-8137-32c62d15c60d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:22.472518 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc9020-2f93-4461-8137-32c62d15c60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:22.489459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8abc9020-2f93-4461-8137-32c62d15c60d None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:22.490660 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8abc9020-2f93-4461-8137-32c62d15c60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:22.551314 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1347/2734] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:22.561009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3ad31-8651-4be7-82d3-a16f709cccd6 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:22.562398 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-22a3ad31-8651-4be7-82d3-a16f709cccd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:22.621672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3ad31-8651-4be7-82d3-a16f709cccd6 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:22.625321 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ae41a-6913-4c68-b43c-9df35f4537c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:22.625968 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ae41a-6913-4c68-b43c-9df35f4537c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:22.626277 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ae41a-6913-4c68-b43c-9df35f4537c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:22.626554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ae41a-6913-4c68-b43c-9df35f4537c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:22.635658 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ae41a-6913-4c68-b43c-9df35f4537c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:22.637617 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ae41a-6913-4c68-b43c-9df35f4537c3 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:22.641503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:22.647630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1388/2735] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:23.129497 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f7f7b-2c8c-4b95-9e53-295cedf4dc4e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:23.129786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f7f7b-2c8c-4b95-9e53-295cedf4dc4e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:23.130067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f7f7b-2c8c-4b95-9e53-295cedf4dc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:23.150707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ef3f7f7b-2c8c-4b95-9e53-295cedf4dc4e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:23.152027 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ef3f7f7b-2c8c-4b95-9e53-295cedf4dc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:23.157399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ae41a-6913-4c68-b43c-9df35f4537c3 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:23.159128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-703ae41a-6913-4c68-b43c-9df35f4537c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:23.167378 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1348/2736] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jul 14 10:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:23.192671 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ae41a-6913-4c68-b43c-9df35f4537c3 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:23.196328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f7f7b-2c8c-4b95-9e53-295cedf4dc4e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:23.197814 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ef3f7f7b-2c8c-4b95-9e53-295cedf4dc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:23.198265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:23.199788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:23.202933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:23.202933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] PATH_INFO: `/v3/projects/c4c644ccbc664030a85caa8490ec446f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:23.202933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c644ccbc664030a85caa8490ec446f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:23.203691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:23.233698 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:23.272594 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f7f7b-2c8c-4b95-9e53-295cedf4dc4e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:23.278115 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c783c3c-397c-4c9c-b1fd-3eaf1577eb4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:23.278769 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c783c3c-397c-4c9c-b1fd-3eaf1577eb4a service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:23.279052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c783c3c-397c-4c9c-b1fd-3eaf1577eb4a service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:23.279333 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c783c3c-397c-4c9c-b1fd-3eaf1577eb4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:23.287962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c783c3c-397c-4c9c-b1fd-3eaf1577eb4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:23.289718 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c783c3c-397c-4c9c-b1fd-3eaf1577eb4a service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:23.299900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c644ccbc664030a85caa8490ec446f', 'request_id': 'req-bc5f113f-3cb8-41fb-a335-f5f23b686436'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:23.300239 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1349/2737] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:23.389731 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c644ccbc664030a85caa8490ec446f', 'request_id': 'req-bc5f113f-3cb8-41fb-a335-f5f23b686436'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:23.396122 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c644ccbc664030a85caa8490ec446f', 'request_id': 'req-bc5f113f-3cb8-41fb-a335-f5f23b686436'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:23.409559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] The token cache is being invalidate because project c4c644ccbc664030a85caa8490ec446f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:23.410022 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:23.410867 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:23.413392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1389/2738] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:23 2022] DELETE /identity/v3/projects/c4c644ccbc664030a85caa8490ec446f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:23.417231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c783c3c-397c-4c9c-b1fd-3eaf1577eb4a service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:23.428855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c783c3c-397c-4c9c-b1fd-3eaf1577eb4a service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:23.491185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a1b42-f565-4635-a2cd-276f6b4cea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:23.492096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a1b42-f565-4635-a2cd-276f6b4cea1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:23.492383 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a1b42-f565-4635-a2cd-276f6b4cea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:23.492662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a1b42-f565-4635-a2cd-276f6b4cea1c admin admin] PATH_INFO: `/v3/users/d69e3a8af48e4f9f94ff7e19a5eab25b` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:23.493873 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a1b42-f565-4635-a2cd-276f6b4cea1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69e3a8af48e4f9f94ff7e19a5eab25b)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:23.496517 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a1b42-f565-4635-a2cd-276f6b4cea1c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:23.677440 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-921a1b42-f565-4635-a2cd-276f6b4cea1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69e3a8af48e4f9f94ff7e19a5eab25b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:23.689892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-921a1b42-f565-4635-a2cd-276f6b4cea1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69e3a8af48e4f9f94ff7e19a5eab25b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:23.690597 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-921a1b42-f565-4635-a2cd-276f6b4cea1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69e3a8af48e4f9f94ff7e19a5eab25b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:23.761214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-921a1b42-f565-4635-a2cd-276f6b4cea1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69e3a8af48e4f9f94ff7e19a5eab25b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:23.762397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-921a1b42-f565-4635-a2cd-276f6b4cea1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69e3a8af48e4f9f94ff7e19a5eab25b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:23.775316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1350/2739] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:23 2022] DELETE /identity/v3/users/d69e3a8af48e4f9f94ff7e19a5eab25b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:24.362852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:24.364334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:24.379278 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f113f-3cb8-41fb-a335-f5f23b686436 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:24.439254 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:24.440167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:24.440450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:24.440723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4 admin admin] PATH_INFO: `/v3/projects/54f67b2f9342414ab0ab4c32eb0a9053` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:24.442598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54f67b2f9342414ab0ab4c32eb0a9053)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:24.444533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:24.568177 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54f67b2f9342414ab0ab4c32eb0a9053', 'request_id': 'req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:24.641075 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54f67b2f9342414ab0ab4c32eb0a9053', 'request_id': 'req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:24.647068 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54f67b2f9342414ab0ab4c32eb0a9053', 'request_id': 'req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:24.659165 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4 admin admin] The token cache is being invalidate because project 54f67b2f9342414ab0ab4c32eb0a9053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:24.659457 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:24.660189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-2082f4d9-20aa-4ea4-8927-633d19c5c5c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:24.661747 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1390/2740] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:24 2022] DELETE /identity/v3/projects/54f67b2f9342414ab0ab4c32eb0a9053 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:24.666785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41236ab0-33d9-425a-bf58-74d62818d489 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:24.667249 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41236ab0-33d9-425a-bf58-74d62818d489 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:24.667414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41236ab0-33d9-425a-bf58-74d62818d489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:24.685968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-41236ab0-33d9-425a-bf58-74d62818d489 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:24.687167 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-41236ab0-33d9-425a-bf58-74d62818d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:24.723855 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:24.765012 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1351/2741] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:24.772928 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296d63c-1388-4fc8-b8e8-5e51f468eee0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:24.773218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296d63c-1388-4fc8-b8e8-5e51f468eee0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:24.773509 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296d63c-1388-4fc8-b8e8-5e51f468eee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:24.793027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9296d63c-1388-4fc8-b8e8-5e51f468eee0 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:24.794417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9296d63c-1388-4fc8-b8e8-5e51f468eee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:24.802364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1391/2742] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:24.806912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41236ab0-33d9-425a-bf58-74d62818d489 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:24.817331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41236ab0-33d9-425a-bf58-74d62818d489 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:24.822158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f9423-50bb-4370-847d-06ea2bc7a372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:24.826626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f9423-50bb-4370-847d-06ea2bc7a372 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:24.826626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f9423-50bb-4370-847d-06ea2bc7a372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:24.826626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f9423-50bb-4370-847d-06ea2bc7a372 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:24.826626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f9423-50bb-4370-847d-06ea2bc7a372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:30:24.826626 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f9423-50bb-4370-847d-06ea2bc7a372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:24.827869 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f9423-50bb-4370-847d-06ea2bc7a372 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:24.841046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1352/2743] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:30:24.845342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296d63c-1388-4fc8-b8e8-5e51f468eee0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:24.851044 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:24.855034 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296d63c-1388-4fc8-b8e8-5e51f468eee0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:24.860100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a477d2e-5ca3-4128-98de-3ab587e7ae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:24.861349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a477d2e-5ca3-4128-98de-3ab587e7ae0b admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:24.861349 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a477d2e-5ca3-4128-98de-3ab587e7ae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:24.861549 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a477d2e-5ca3-4128-98de-3ab587e7ae0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:24.862159 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a477d2e-5ca3-4128-98de-3ab587e7ae0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:24.864076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a477d2e-5ca3-4128-98de-3ab587e7ae0b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:25.016098 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1392/2744] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:24 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:25.020265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f9423-50bb-4370-847d-06ea2bc7a372 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:25.040322 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f9423-50bb-4370-847d-06ea2bc7a372 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:25.098222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261771e7-83db-43cb-b796-12054ad29cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:25.098892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261771e7-83db-43cb-b796-12054ad29cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:25.099179 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261771e7-83db-43cb-b796-12054ad29cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:25.099453 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261771e7-83db-43cb-b796-12054ad29cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:25.100188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261771e7-83db-43cb-b796-12054ad29cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:25.102077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261771e7-83db-43cb-b796-12054ad29cf9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:25.207382 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1353/2745] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:25 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:25.211385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a477d2e-5ca3-4128-98de-3ab587e7ae0b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:25.221725 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a477d2e-5ca3-4128-98de-3ab587e7ae0b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:25.226432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79663c21-9144-4090-82b8-b1ee0527559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:25.227088 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79663c21-9144-4090-82b8-b1ee0527559d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:25.227366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79663c21-9144-4090-82b8-b1ee0527559d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:25.227643 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79663c21-9144-4090-82b8-b1ee0527559d admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:25.228450 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79663c21-9144-4090-82b8-b1ee0527559d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:25.230869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79663c21-9144-4090-82b8-b1ee0527559d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:25.241334 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1393/2746] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:25.245268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261771e7-83db-43cb-b796-12054ad29cf9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:25.255750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261771e7-83db-43cb-b796-12054ad29cf9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:25.260526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338a7b1-20f9-4ac8-9723-459babd8abc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:25.261165 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338a7b1-20f9-4ac8-9723-459babd8abc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:25.261996 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338a7b1-20f9-4ac8-9723-459babd8abc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:25.262233 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338a7b1-20f9-4ac8-9723-459babd8abc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:25.262956 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338a7b1-20f9-4ac8-9723-459babd8abc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:25.264573 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338a7b1-20f9-4ac8-9723-459babd8abc0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:25.274913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1354/2747] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:25.279230 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79663c21-9144-4090-82b8-b1ee0527559d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:25.289700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79663c21-9144-4090-82b8-b1ee0527559d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:25.294443 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aa308-107f-4d67-9266-9148087715e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:25.296062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aa308-107f-4d67-9266-9148087715e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:25.296062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aa308-107f-4d67-9266-9148087715e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:25.296062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aa308-107f-4d67-9266-9148087715e7 admin admin] PATH_INFO: `/v3/projects/72688bbbb13b4b6ba6bf864acda50a11/users/7b346f41ee1a4088beaf57bf937e840a/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:25.311469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aa308-107f-4d67-9266-9148087715e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72688bbbb13b4b6ba6bf864acda50a11, user_id=7b346f41ee1a4088beaf57bf937e840a, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:25.314223 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aa308-107f-4d67-9266-9148087715e7 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:25.412555 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1394/2748] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:25 2022] PUT /identity/v3/projects/72688bbbb13b4b6ba6bf864acda50a11/users/7b346f41ee1a4088beaf57bf937e840a/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:25.417608 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70c368-efe0-4088-af3e-403b684e0685 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:25.417907 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70c368-efe0-4088-af3e-403b684e0685 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:25.418192 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70c368-efe0-4088-af3e-403b684e0685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:25.436304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3b70c368-efe0-4088-af3e-403b684e0685 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:25.437512 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3b70c368-efe0-4088-af3e-403b684e0685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:25.496367 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1355/2749] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:25.505937 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aa308-107f-4d67-9266-9148087715e7 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:25.507827 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-943aa308-107f-4d67-9266-9148087715e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:25.567773 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aa308-107f-4d67-9266-9148087715e7 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:25.578202 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdbe9b-c92c-48b6-9cf6-004c7f27c4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:25.578863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdbe9b-c92c-48b6-9cf6-004c7f27c4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:25.579158 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdbe9b-c92c-48b6-9cf6-004c7f27c4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:25.579433 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdbe9b-c92c-48b6-9cf6-004c7f27c4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:25.588924 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdbe9b-c92c-48b6-9cf6-004c7f27c4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:25.590369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdbe9b-c92c-48b6-9cf6-004c7f27c4f0 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:25.599972 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1395/2750] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:26.184828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70c368-efe0-4088-af3e-403b684e0685 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:26.186303 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3b70c368-efe0-4088-af3e-403b684e0685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:26.235278 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:26.252851 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70c368-efe0-4088-af3e-403b684e0685 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:26.256813 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03abd4-e2bc-45c9-b570-b8d43cecc9f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:26.257561 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03abd4-e2bc-45c9-b570-b8d43cecc9f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:26.257862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03abd4-e2bc-45c9-b570-b8d43cecc9f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:26.258149 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03abd4-e2bc-45c9-b570-b8d43cecc9f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:26.260013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0f03abd4-e2bc-45c9-b570-b8d43cecc9f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:26.324885 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03abd4-e2bc-45c9-b570-b8d43cecc9f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:26.326406 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03abd4-e2bc-45c9-b570-b8d43cecc9f9 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:26.336195 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1356/2751] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:27.025398 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50add0-4a2a-41a6-9163-c1c98210d16d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:27.025962 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50add0-4a2a-41a6-9163-c1c98210d16d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:27.025962 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50add0-4a2a-41a6-9163-c1c98210d16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:27.066813 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2d50add0-4a2a-41a6-9163-c1c98210d16d None None] MFA Rules not processed for user `7b346f41ee1a4088beaf57bf937e840a`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:27.068051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2d50add0-4a2a-41a6-9163-c1c98210d16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:27.136702 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1396/2752] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:27.141231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03abd4-e2bc-45c9-b570-b8d43cecc9f9 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:27.151872 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03abd4-e2bc-45c9-b570-b8d43cecc9f9 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:27.156670 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1e8b4-a8b0-4757-92ac-8fda27610b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:27.157329 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1e8b4-a8b0-4757-92ac-8fda27610b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:27.157633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1e8b4-a8b0-4757-92ac-8fda27610b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:27.157911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1e8b4-a8b0-4757-92ac-8fda27610b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:27.158648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1e8b4-a8b0-4757-92ac-8fda27610b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:27.160644 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1e8b4-a8b0-4757-92ac-8fda27610b7d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:27.323379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1357/2753] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:27 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:30:27.327447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50add0-4a2a-41a6-9163-c1c98210d16d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:27.338303 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50add0-4a2a-41a6-9163-c1c98210d16d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:27.386143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:27.405369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89540c7f-b5ae-4d45-b61a-d183170dc028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:27.406047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89540c7f-b5ae-4d45-b61a-d183170dc028 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:27.406332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89540c7f-b5ae-4d45-b61a-d183170dc028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:27.406639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89540c7f-b5ae-4d45-b61a-d183170dc028 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:27.407339 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89540c7f-b5ae-4d45-b61a-d183170dc028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:27.409347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89540c7f-b5ae-4d45-b61a-d183170dc028 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:27.544109 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1397/2754] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:27 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:30:27.548137 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1e8b4-a8b0-4757-92ac-8fda27610b7d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:27.559129 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1e8b4-a8b0-4757-92ac-8fda27610b7d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:27.563790 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ea2e8-c95d-4389-9718-62a4a65b5a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:27.564485 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ea2e8-c95d-4389-9718-62a4a65b5a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:27.564787 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ea2e8-c95d-4389-9718-62a4a65b5a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:27.565055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ea2e8-c95d-4389-9718-62a4a65b5a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:27.565783 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ea2e8-c95d-4389-9718-62a4a65b5a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:27.567656 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ea2e8-c95d-4389-9718-62a4a65b5a40 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:27.578573 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1358/2755] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:27.582720 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89540c7f-b5ae-4d45-b61a-d183170dc028 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:27.593396 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89540c7f-b5ae-4d45-b61a-d183170dc028 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:27.599137 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463c702-ac5c-4055-8e1a-30e03151804f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:27.600116 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463c702-ac5c-4055-8e1a-30e03151804f admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:27.600563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463c702-ac5c-4055-8e1a-30e03151804f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:27.602827 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463c702-ac5c-4055-8e1a-30e03151804f admin admin] PATH_INFO: `/v3/projects/b77782a3aff94707a965c30ffe3190c2/users/a5b2e39df1bc4679816eecdae67f988c/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:27.617351 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463c702-ac5c-4055-8e1a-30e03151804f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77782a3aff94707a965c30ffe3190c2, user_id=a5b2e39df1bc4679816eecdae67f988c, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:27.620072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463c702-ac5c-4055-8e1a-30e03151804f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:27.686696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1398/2756] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:27 2022] PUT /identity/v3/projects/b77782a3aff94707a965c30ffe3190c2/users/a5b2e39df1bc4679816eecdae67f988c/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:27.690708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ea2e8-c95d-4389-9718-62a4a65b5a40 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:27.701781 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ea2e8-c95d-4389-9718-62a4a65b5a40 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:27.758961 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b4246-a4eb-4f44-bd76-17774d252aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:27.759628 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b4246-a4eb-4f44-bd76-17774d252aae admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:27.759913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b4246-a4eb-4f44-bd76-17774d252aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:27.760227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b4246-a4eb-4f44-bd76-17774d252aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:27.761464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b4246-a4eb-4f44-bd76-17774d252aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:27.763081 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b4246-a4eb-4f44-bd76-17774d252aae admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:27.773187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1359/2757] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:27.778125 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463c702-ac5c-4055-8e1a-30e03151804f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:27.788839 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463c702-ac5c-4055-8e1a-30e03151804f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:27.794269 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be7d1c-cbde-48c4-bccc-3c81e7ed04ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:27.795216 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7d1c-cbde-48c4-bccc-3c81e7ed04ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:27.798061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7d1c-cbde-48c4-bccc-3c81e7ed04ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:27.798061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7d1c-cbde-48c4-bccc-3c81e7ed04ad admin admin] PATH_INFO: `/v3/projects/b77782a3aff94707a965c30ffe3190c2/users/a5b2e39df1bc4679816eecdae67f988c/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:27.798061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be7d1c-cbde-48c4-bccc-3c81e7ed04ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77782a3aff94707a965c30ffe3190c2, user_id=a5b2e39df1bc4679816eecdae67f988c, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:27.800664 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be7d1c-cbde-48c4-bccc-3c81e7ed04ad admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:27.811076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1399/2758] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:27 2022] PUT /identity/v3/projects/b77782a3aff94707a965c30ffe3190c2/users/a5b2e39df1bc4679816eecdae67f988c/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:27.908522 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a956f-84ec-4e00-ae3c-639002eccd40 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:27.908892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a956f-84ec-4e00-ae3c-639002eccd40 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:27.909174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a956f-84ec-4e00-ae3c-639002eccd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:27.928472 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0c9a956f-84ec-4e00-ae3c-639002eccd40 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:27.929691 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0c9a956f-84ec-4e00-ae3c-639002eccd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:27.983348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:27.995289 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1360/2759] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jul 14 10:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:28.018486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be7d1c-cbde-48c4-bccc-3c81e7ed04ad admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:28.021320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-75be7d1c-cbde-48c4-bccc-3c81e7ed04ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:28.127835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be7d1c-cbde-48c4-bccc-3c81e7ed04ad admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:28.134940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3295e3-d09b-4c66-8daa-83ca3067ab48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:28.134940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3295e3-d09b-4c66-8daa-83ca3067ab48 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:28.135229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3295e3-d09b-4c66-8daa-83ca3067ab48 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:28.135500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3295e3-d09b-4c66-8daa-83ca3067ab48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:28.145430 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3295e3-d09b-4c66-8daa-83ca3067ab48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:28.147048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3295e3-d09b-4c66-8daa-83ca3067ab48 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:28.157215 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1400/2760] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:29.113384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8f986-afd5-4418-9905-925239cc6112 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:29.113829 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8f986-afd5-4418-9905-925239cc6112 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:29.114048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8f986-afd5-4418-9905-925239cc6112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:29.143037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-84e8f986-afd5-4418-9905-925239cc6112 None None] MFA Rules not processed for user `a5b2e39df1bc4679816eecdae67f988c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:29.144302 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-84e8f986-afd5-4418-9905-925239cc6112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:29.218073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1361/2761] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:29.228341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f70fb-6b35-4214-be09-ed77b8149354 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:29.228829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f70fb-6b35-4214-be09-ed77b8149354 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:29.229023 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f70fb-6b35-4214-be09-ed77b8149354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:29.246741 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-aa1f70fb-6b35-4214-be09-ed77b8149354 None None] MFA Rules not processed for user `7b346f41ee1a4088beaf57bf937e840a`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:29.247950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-aa1f70fb-6b35-4214-be09-ed77b8149354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:29.302691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1401/2762] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:29.314858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8f986-afd5-4418-9905-925239cc6112 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:29.316561 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-84e8f986-afd5-4418-9905-925239cc6112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:29.332911 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8f986-afd5-4418-9905-925239cc6112 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:29.338372 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411f395-2fd3-4afa-a533-e8fe9d9ee742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:29.339618 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411f395-2fd3-4afa-a533-e8fe9d9ee742 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:29.339899 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411f395-2fd3-4afa-a533-e8fe9d9ee742 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:29.340225 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411f395-2fd3-4afa-a533-e8fe9d9ee742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:29.347989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411f395-2fd3-4afa-a533-e8fe9d9ee742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:29.349642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411f395-2fd3-4afa-a533-e8fe9d9ee742 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:29.358671 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1362/2763] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:31.702679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba5c60-7f5a-48aa-9f68-bc998b906a46 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:31.703179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba5c60-7f5a-48aa-9f68-bc998b906a46 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:31.703179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba5c60-7f5a-48aa-9f68-bc998b906a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:31.721843 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-48ba5c60-7f5a-48aa-9f68-bc998b906a46 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:31.723031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-48ba5c60-7f5a-48aa-9f68-bc998b906a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:31.731139 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1402/2764] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jul 14 10:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:31.752938 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411f395-2fd3-4afa-a533-e8fe9d9ee742 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:31.764496 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411f395-2fd3-4afa-a533-e8fe9d9ee742 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:31.769910 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015755e0-551c-43cb-9cd9-78d2825e3498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:31.770538 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015755e0-551c-43cb-9cd9-78d2825e3498 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:31.770820 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015755e0-551c-43cb-9cd9-78d2825e3498 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:31.771092 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015755e0-551c-43cb-9cd9-78d2825e3498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:31.780415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015755e0-551c-43cb-9cd9-78d2825e3498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:31.786631 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015755e0-551c-43cb-9cd9-78d2825e3498 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:31.792176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1363/2765] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:32.164630 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba5c60-7f5a-48aa-9f68-bc998b906a46 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:32.166073 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-48ba5c60-7f5a-48aa-9f68-bc998b906a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:32.178142 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba5c60-7f5a-48aa-9f68-bc998b906a46 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:32.183300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967ef5f-9bc7-46fc-8794-a9dd908c998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:32.184229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967ef5f-9bc7-46fc-8794-a9dd908c998b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:32.184511 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967ef5f-9bc7-46fc-8794-a9dd908c998b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:32.184789 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967ef5f-9bc7-46fc-8794-a9dd908c998b admin admin] PATH_INFO: `/v3/users/8104e943e37042d381df5b9392d4b8a3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:32.186007 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967ef5f-9bc7-46fc-8794-a9dd908c998b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8104e943e37042d381df5b9392d4b8a3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:32.187973 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967ef5f-9bc7-46fc-8794-a9dd908c998b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:32.200364 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:32.389992 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a967ef5f-9bc7-46fc-8794-a9dd908c998b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8104e943e37042d381df5b9392d4b8a3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:32.401847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a967ef5f-9bc7-46fc-8794-a9dd908c998b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8104e943e37042d381df5b9392d4b8a3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:32.474019 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a967ef5f-9bc7-46fc-8794-a9dd908c998b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8104e943e37042d381df5b9392d4b8a3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:32.474679 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a967ef5f-9bc7-46fc-8794-a9dd908c998b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8104e943e37042d381df5b9392d4b8a3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:32.482505 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a967ef5f-9bc7-46fc-8794-a9dd908c998b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8104e943e37042d381df5b9392d4b8a3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:32.488442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1403/2766] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:32 2022] DELETE /identity/v3/users/8104e943e37042d381df5b9392d4b8a3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:32.492999 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d6913-857b-4b6d-af72-a0ad3bc77c0f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:32.493291 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d6913-857b-4b6d-af72-a0ad3bc77c0f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:32.493568 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d6913-857b-4b6d-af72-a0ad3bc77c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:32.511578 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c96d6913-857b-4b6d-af72-a0ad3bc77c0f None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:32.512868 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c96d6913-857b-4b6d-af72-a0ad3bc77c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:32.571260 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1364/2767] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:32.580683 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967ef5f-9bc7-46fc-8794-a9dd908c998b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:32.582085 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a967ef5f-9bc7-46fc-8794-a9dd908c998b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:32.638722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967ef5f-9bc7-46fc-8794-a9dd908c998b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:32.642610 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f436e-d7c4-4382-9501-48e0ef0e9224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:32.643195 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f436e-d7c4-4382-9501-48e0ef0e9224 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:32.643478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f436e-d7c4-4382-9501-48e0ef0e9224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:32.643755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f436e-d7c4-4382-9501-48e0ef0e9224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:32.654140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f436e-d7c4-4382-9501-48e0ef0e9224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:32.655581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f436e-d7c4-4382-9501-48e0ef0e9224 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:32.666279 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1404/2768] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:33.191537 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d6913-857b-4b6d-af72-a0ad3bc77c0f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:33.193098 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c96d6913-857b-4b6d-af72-a0ad3bc77c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:33.204972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d6913-857b-4b6d-af72-a0ad3bc77c0f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:33.211101 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:33.212073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:33.212357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:33.212629 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] PATH_INFO: `/v3/projects/ec740355cbfb4927b64298a80e84aec2` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:33.214537 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec740355cbfb4927b64298a80e84aec2)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:33.216641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:33.384615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec740355cbfb4927b64298a80e84aec2', 'request_id': 'req-34a61892-3343-4401-b911-5cdb1fd14ee6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:33.386498 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:33.480583 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec740355cbfb4927b64298a80e84aec2', 'request_id': 'req-34a61892-3343-4401-b911-5cdb1fd14ee6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:33.486876 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec740355cbfb4927b64298a80e84aec2', 'request_id': 'req-34a61892-3343-4401-b911-5cdb1fd14ee6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:33.497799 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] The token cache is being invalidate because project ec740355cbfb4927b64298a80e84aec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:33.498086 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:33.498726 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:33.500340 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1365/2769] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:33 2022] DELETE /identity/v3/projects/ec740355cbfb4927b64298a80e84aec2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:33.504317 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f436e-d7c4-4382-9501-48e0ef0e9224 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:33.514265 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f436e-d7c4-4382-9501-48e0ef0e9224 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:33.576975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56ac3e-dd60-49cc-964d-3daa04056f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:33.577906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ac3e-dd60-49cc-964d-3daa04056f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:33.578182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ac3e-dd60-49cc-964d-3daa04056f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:33.582652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ac3e-dd60-49cc-964d-3daa04056f52 admin admin] PATH_INFO: `/v3/users/2458e05d72ba4df38904288f75c3f05b` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:33.582652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56ac3e-dd60-49cc-964d-3daa04056f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2458e05d72ba4df38904288f75c3f05b)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:33.582652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56ac3e-dd60-49cc-964d-3daa04056f52 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:33.739136 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:33.751795 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4c56ac3e-dd60-49cc-964d-3daa04056f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2458e05d72ba4df38904288f75c3f05b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:33.763646 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4c56ac3e-dd60-49cc-964d-3daa04056f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2458e05d72ba4df38904288f75c3f05b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:33.818029 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4c56ac3e-dd60-49cc-964d-3daa04056f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2458e05d72ba4df38904288f75c3f05b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:33.818660 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4c56ac3e-dd60-49cc-964d-3daa04056f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2458e05d72ba4df38904288f75c3f05b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:33.826193 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4c56ac3e-dd60-49cc-964d-3daa04056f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2458e05d72ba4df38904288f75c3f05b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:33.832721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1405/2770] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:33 2022] DELETE /identity/v3/users/2458e05d72ba4df38904288f75c3f05b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:34.606061 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:34.616419 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:34.621725 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a61892-3343-4401-b911-5cdb1fd14ee6 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:34.682641 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5e67f-a073-4671-8d20-24ad351023b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:34.683518 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5e67f-a073-4671-8d20-24ad351023b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:34.683807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5e67f-a073-4671-8d20-24ad351023b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:34.684111 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5e67f-a073-4671-8d20-24ad351023b0 admin admin] PATH_INFO: `/v3/projects/35beb9d47fb64f428196d541d9223894` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:34.685321 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5e67f-a073-4671-8d20-24ad351023b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35beb9d47fb64f428196d541d9223894)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:34.687230 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5e67f-a073-4671-8d20-24ad351023b0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:34.812579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-50f5e67f-a073-4671-8d20-24ad351023b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35beb9d47fb64f428196d541d9223894', 'request_id': 'req-50f5e67f-a073-4671-8d20-24ad351023b0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:34.902975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-50f5e67f-a073-4671-8d20-24ad351023b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35beb9d47fb64f428196d541d9223894', 'request_id': 'req-50f5e67f-a073-4671-8d20-24ad351023b0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:34.911635 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-50f5e67f-a073-4671-8d20-24ad351023b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35beb9d47fb64f428196d541d9223894', 'request_id': 'req-50f5e67f-a073-4671-8d20-24ad351023b0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:34.923529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-50f5e67f-a073-4671-8d20-24ad351023b0 admin admin] The token cache is being invalidate because project 35beb9d47fb64f428196d541d9223894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:34.923818 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-50f5e67f-a073-4671-8d20-24ad351023b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:34.924514 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-50f5e67f-a073-4671-8d20-24ad351023b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:34.926058 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1366/2771] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:34 2022] DELETE /identity/v3/projects/35beb9d47fb64f428196d541d9223894 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:34.933442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c06b35-2a9d-4628-9e53-08fcaf5708f9 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:34.933943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c06b35-2a9d-4628-9e53-08fcaf5708f9 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:34.934048 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c06b35-2a9d-4628-9e53-08fcaf5708f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:34.940094 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e521c-2095-475e-8298-996f21dee4fa None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:34.940391 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e521c-2095-475e-8298-996f21dee4fa None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:34.940936 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e521c-2095-475e-8298-996f21dee4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:34.953475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-04c06b35-2a9d-4628-9e53-08fcaf5708f9 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:34.956906 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-04c06b35-2a9d-4628-9e53-08fcaf5708f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:34.961287 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-181e521c-2095-475e-8298-996f21dee4fa None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:34.962516 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-181e521c-2095-475e-8298-996f21dee4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:35.024758 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1406/2772] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:35.033152 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cabf2-6086-4d11-9d90-67f2d482c200 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:35.033452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cabf2-6086-4d11-9d90-67f2d482c200 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:35.033734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cabf2-6086-4d11-9d90-67f2d482c200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:35.036699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1367/2773] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jul 14 10:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:35.052910 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8c5cabf2-6086-4d11-9d90-67f2d482c200 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:35.054376 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8c5cabf2-6086-4d11-9d90-67f2d482c200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:35.062699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e521c-2095-475e-8298-996f21dee4fa None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:35.063353 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1407/2774] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:35.064594 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-181e521c-2095-475e-8298-996f21dee4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:35.067656 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cabf2-6086-4d11-9d90-67f2d482c200 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:35.078278 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:35.078504 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cabf2-6086-4d11-9d90-67f2d482c200 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:35.084035 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84b9c-8ac8-43fc-8ec7-655b55199861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:35.084371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84b9c-8ac8-43fc-8ec7-655b55199861 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:35.084650 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84b9c-8ac8-43fc-8ec7-655b55199861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:35.084922 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84b9c-8ac8-43fc-8ec7-655b55199861 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:35.085678 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e84b9c-8ac8-43fc-8ec7-655b55199861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:30:35.086218 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e84b9c-8ac8-43fc-8ec7-655b55199861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:35.087835 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e84b9c-8ac8-43fc-8ec7-655b55199861 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:35.102096 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1408/2775] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:30:35.106856 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84b9c-8ac8-43fc-8ec7-655b55199861 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:35.118332 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84b9c-8ac8-43fc-8ec7-655b55199861 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:35.125232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c798e98-6a1c-43f1-8f84-1e7b4d0b0b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:35.126054 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c798e98-6a1c-43f1-8f84-1e7b4d0b0b63 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:35.126586 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c798e98-6a1c-43f1-8f84-1e7b4d0b0b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:35.130525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c798e98-6a1c-43f1-8f84-1e7b4d0b0b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:35.130525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c798e98-6a1c-43f1-8f84-1e7b4d0b0b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:35.130722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c798e98-6a1c-43f1-8f84-1e7b4d0b0b63 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:35.150683 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e521c-2095-475e-8298-996f21dee4fa None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:35.157222 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92042b1e-36d9-4c04-9d15-6dc18b720e34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:35.159158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92042b1e-36d9-4c04-9d15-6dc18b720e34 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:35.159158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92042b1e-36d9-4c04-9d15-6dc18b720e34 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:35.159158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92042b1e-36d9-4c04-9d15-6dc18b720e34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:35.167984 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92042b1e-36d9-4c04-9d15-6dc18b720e34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:35.169662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92042b1e-36d9-4c04-9d15-6dc18b720e34 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:35.180164 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1368/2776] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:30:35.215707 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1409/2777] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:35 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:35.219735 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92042b1e-36d9-4c04-9d15-6dc18b720e34 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:35.229686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92042b1e-36d9-4c04-9d15-6dc18b720e34 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:35.291015 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c26bf-72c2-481d-ad47-7c4fa4828e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:35.291699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c26bf-72c2-481d-ad47-7c4fa4828e1d admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:35.291984 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c26bf-72c2-481d-ad47-7c4fa4828e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:35.292288 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c26bf-72c2-481d-ad47-7c4fa4828e1d admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:35.292992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c26bf-72c2-481d-ad47-7c4fa4828e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:35.294964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c26bf-72c2-481d-ad47-7c4fa4828e1d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:35.375121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1369/2778] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:35 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:35.376322 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c798e98-6a1c-43f1-8f84-1e7b4d0b0b63 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:35.387097 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c798e98-6a1c-43f1-8f84-1e7b4d0b0b63 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:35.391721 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d281bc5-a4be-4852-8749-afcf3023de63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:35.392414 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d281bc5-a4be-4852-8749-afcf3023de63 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:35.392697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d281bc5-a4be-4852-8749-afcf3023de63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:35.392976 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d281bc5-a4be-4852-8749-afcf3023de63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:35.393696 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d281bc5-a4be-4852-8749-afcf3023de63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:35.395294 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d281bc5-a4be-4852-8749-afcf3023de63 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:35.406094 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1410/2779] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:35.414636 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c26bf-72c2-481d-ad47-7c4fa4828e1d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:35.424648 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c26bf-72c2-481d-ad47-7c4fa4828e1d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:35.429361 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824f715-1018-4404-b421-fb20dc150c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:35.430013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824f715-1018-4404-b421-fb20dc150c9c admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:35.430295 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824f715-1018-4404-b421-fb20dc150c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:35.430569 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824f715-1018-4404-b421-fb20dc150c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:35.431296 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824f715-1018-4404-b421-fb20dc150c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:35.432913 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824f715-1018-4404-b421-fb20dc150c9c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:35.443001 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1370/2780] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:35.446970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d281bc5-a4be-4852-8749-afcf3023de63 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:35.457540 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d281bc5-a4be-4852-8749-afcf3023de63 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:35.462168 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be30e3-4ed6-498b-b64a-4c644d5fd54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:35.463037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be30e3-4ed6-498b-b64a-4c644d5fd54f admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:35.463927 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be30e3-4ed6-498b-b64a-4c644d5fd54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:35.464243 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be30e3-4ed6-498b-b64a-4c644d5fd54f admin admin] PATH_INFO: `/v3/projects/e353c0dab7d34c57af04766655c5ec7c/users/c2f5fc1468104a3e82538a395fc00d9f/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:35.478606 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be30e3-4ed6-498b-b64a-4c644d5fd54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e353c0dab7d34c57af04766655c5ec7c, user_id=c2f5fc1468104a3e82538a395fc00d9f, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:35.481318 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be30e3-4ed6-498b-b64a-4c644d5fd54f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:35.554498 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1411/2781] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:35 2022] PUT /identity/v3/projects/e353c0dab7d34c57af04766655c5ec7c/users/c2f5fc1468104a3e82538a395fc00d9f/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:35.567090 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602dbae-fb28-4938-ab93-0aeded438e09 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:35.567377 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602dbae-fb28-4938-ab93-0aeded438e09 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:35.567660 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602dbae-fb28-4938-ab93-0aeded438e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:35.597081 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f602dbae-fb28-4938-ab93-0aeded438e09 None None] MFA Rules not processed for user `c2f5fc1468104a3e82538a395fc00d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:35.598196 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f602dbae-fb28-4938-ab93-0aeded438e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:35.669489 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1371/2782] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:35.673900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be30e3-4ed6-498b-b64a-4c644d5fd54f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:35.710753 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:35.737242 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be30e3-4ed6-498b-b64a-4c644d5fd54f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:35.741891 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f7fdb-ebe0-4984-b947-2e0a0809ad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:35.742734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f7fdb-ebe0-4984-b947-2e0a0809ad76 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:35.743066 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f7fdb-ebe0-4984-b947-2e0a0809ad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:35.743569 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f7fdb-ebe0-4984-b947-2e0a0809ad76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:35.745204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f7fdb-ebe0-4984-b947-2e0a0809ad76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:35.747130 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f7fdb-ebe0-4984-b947-2e0a0809ad76 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:35.863885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1412/2783] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:35 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:35.868022 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602dbae-fb28-4938-ab93-0aeded438e09 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:35.874178 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:35.880310 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602dbae-fb28-4938-ab93-0aeded438e09 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:35.939451 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cfef7-1cd3-41ff-8765-3a1f1440a942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:35.940269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cfef7-1cd3-41ff-8765-3a1f1440a942 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:35.940802 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cfef7-1cd3-41ff-8765-3a1f1440a942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:35.941107 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cfef7-1cd3-41ff-8765-3a1f1440a942 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:35.941762 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cfef7-1cd3-41ff-8765-3a1f1440a942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:35.943669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cfef7-1cd3-41ff-8765-3a1f1440a942 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:36.074611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1372/2784] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:35 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:36.078929 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f7fdb-ebe0-4984-b947-2e0a0809ad76 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:36.089946 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f7fdb-ebe0-4984-b947-2e0a0809ad76 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:36.096257 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34156e-b432-48a0-aea0-6ca9f18043a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:36.096940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34156e-b432-48a0-aea0-6ca9f18043a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:36.097223 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34156e-b432-48a0-aea0-6ca9f18043a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:36.097500 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34156e-b432-48a0-aea0-6ca9f18043a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:36.098226 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34156e-b432-48a0-aea0-6ca9f18043a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:36.099823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34156e-b432-48a0-aea0-6ca9f18043a5 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:36.112609 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1413/2785] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:30:36.116304 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cfef7-1cd3-41ff-8765-3a1f1440a942 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:36.127228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cfef7-1cd3-41ff-8765-3a1f1440a942 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:36.132255 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e0363-507e-4ea5-94cb-caa7e4342160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:36.132934 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e0363-507e-4ea5-94cb-caa7e4342160 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:36.133221 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e0363-507e-4ea5-94cb-caa7e4342160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:36.133500 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e0363-507e-4ea5-94cb-caa7e4342160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:36.134243 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e0363-507e-4ea5-94cb-caa7e4342160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:36.135954 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e0363-507e-4ea5-94cb-caa7e4342160 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:36.146263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1373/2786] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:36.150329 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34156e-b432-48a0-aea0-6ca9f18043a5 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:36.160491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34156e-b432-48a0-aea0-6ca9f18043a5 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:36.165065 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196bfb-d40c-4830-982d-540431dcf9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:36.165945 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196bfb-d40c-4830-982d-540431dcf9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:36.166755 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196bfb-d40c-4830-982d-540431dcf9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:36.167040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196bfb-d40c-4830-982d-540431dcf9ed admin admin] PATH_INFO: `/v3/projects/65b5ae00be8b4638af26d2101ff8c57b/users/e16e946447b54301a06b7b45b779a9e7/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:36.181722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38196bfb-d40c-4830-982d-540431dcf9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b5ae00be8b4638af26d2101ff8c57b, user_id=e16e946447b54301a06b7b45b779a9e7, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:36.185013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38196bfb-d40c-4830-982d-540431dcf9ed admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:36.251611 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1414/2787] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:36 2022] PUT /identity/v3/projects/65b5ae00be8b4638af26d2101ff8c57b/users/e16e946447b54301a06b7b45b779a9e7/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:36.262002 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b2622-8d4d-4716-8536-52b05c77cbfd None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:36.262300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b2622-8d4d-4716-8536-52b05c77cbfd None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:36.262584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b2622-8d4d-4716-8536-52b05c77cbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:36.288860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-694b2622-8d4d-4716-8536-52b05c77cbfd None None] MFA Rules not processed for user `e16e946447b54301a06b7b45b779a9e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:36.290145 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-694b2622-8d4d-4716-8536-52b05c77cbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:36.355067 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1374/2788] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:36.359638 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196bfb-d40c-4830-982d-540431dcf9ed admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:36.419887 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196bfb-d40c-4830-982d-540431dcf9ed admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:36.424531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1a557-a857-4ccb-b142-a1445bad9a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:36.425183 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a557-a857-4ccb-b142-a1445bad9a73 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:36.425465 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a557-a857-4ccb-b142-a1445bad9a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:36.425738 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a557-a857-4ccb-b142-a1445bad9a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:36.426417 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1a557-a857-4ccb-b142-a1445bad9a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:36.428371 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1a557-a857-4ccb-b142-a1445bad9a73 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:36.535545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1415/2789] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:36 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:36.536643 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b2622-8d4d-4716-8536-52b05c77cbfd None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:36.548733 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b2622-8d4d-4716-8536-52b05c77cbfd None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:36.612932 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d8a03-4950-4751-8374-bff21813036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:36.613622 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d8a03-4950-4751-8374-bff21813036d admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:36.613909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d8a03-4950-4751-8374-bff21813036d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:36.614186 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d8a03-4950-4751-8374-bff21813036d admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:36.614877 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d8a03-4950-4751-8374-bff21813036d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:36.616839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d8a03-4950-4751-8374-bff21813036d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:36.677677 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:36.685930 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1375/2790] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:36 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:36.689554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1a557-a857-4ccb-b142-a1445bad9a73 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:36.702459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1a557-a857-4ccb-b142-a1445bad9a73 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:36.707525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e137bd3-7b18-496b-a1e1-278b96346904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:36.708423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e137bd3-7b18-496b-a1e1-278b96346904 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:36.710011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e137bd3-7b18-496b-a1e1-278b96346904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:36.710011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e137bd3-7b18-496b-a1e1-278b96346904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:36.710011 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e137bd3-7b18-496b-a1e1-278b96346904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:36.711379 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e137bd3-7b18-496b-a1e1-278b96346904 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:36.722399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1416/2791] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:36.726822 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d8a03-4950-4751-8374-bff21813036d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:36.738593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d8a03-4950-4751-8374-bff21813036d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:36.743848 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30850a8e-1178-40b3-9f21-8097865efb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:36.745429 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850a8e-1178-40b3-9f21-8097865efb21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:36.745709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850a8e-1178-40b3-9f21-8097865efb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:36.745987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850a8e-1178-40b3-9f21-8097865efb21 admin admin] PATH_INFO: `/v3/projects/ff16c44d74f24cb5801fb3339e251d5f/users/5004ae727e3f4a718477ca68cdada91d/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:36.761865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30850a8e-1178-40b3-9f21-8097865efb21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff16c44d74f24cb5801fb3339e251d5f, user_id=5004ae727e3f4a718477ca68cdada91d, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:36.764918 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30850a8e-1178-40b3-9f21-8097865efb21 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:36.840486 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1376/2792] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:36 2022] PUT /identity/v3/projects/ff16c44d74f24cb5801fb3339e251d5f/users/5004ae727e3f4a718477ca68cdada91d/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:36.844449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e137bd3-7b18-496b-a1e1-278b96346904 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:36.855032 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e137bd3-7b18-496b-a1e1-278b96346904 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:36.905691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:36.911766 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f1b01-f7ab-446c-b5da-c469f573ea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:36.912604 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f1b01-f7ab-446c-b5da-c469f573ea6e admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:36.912898 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f1b01-f7ab-446c-b5da-c469f573ea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:36.913180 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f1b01-f7ab-446c-b5da-c469f573ea6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:36.913952 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f1b01-f7ab-446c-b5da-c469f573ea6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:36.915559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f1b01-f7ab-446c-b5da-c469f573ea6e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:36.926157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1417/2793] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:36.930458 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30850a8e-1178-40b3-9f21-8097865efb21 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:36.941835 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30850a8e-1178-40b3-9f21-8097865efb21 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:36.946696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2618b-1ddb-4882-99b8-4f5e79424a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:36.957900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2618b-1ddb-4882-99b8-4f5e79424a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:36.957900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2618b-1ddb-4882-99b8-4f5e79424a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:36.957900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2618b-1ddb-4882-99b8-4f5e79424a4c admin admin] PATH_INFO: `/v3/projects/ff16c44d74f24cb5801fb3339e251d5f/users/5004ae727e3f4a718477ca68cdada91d/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:36.957900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2618b-1ddb-4882-99b8-4f5e79424a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff16c44d74f24cb5801fb3339e251d5f, user_id=5004ae727e3f4a718477ca68cdada91d, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:36.957900 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2618b-1ddb-4882-99b8-4f5e79424a4c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:36.963818 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1377/2794] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:36 2022] PUT /identity/v3/projects/ff16c44d74f24cb5801fb3339e251d5f/users/5004ae727e3f4a718477ca68cdada91d/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:36.973877 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc409e1-ead2-4756-8761-cf3027786b3d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:36.974171 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc409e1-ead2-4756-8761-cf3027786b3d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:36.974483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc409e1-ead2-4756-8761-cf3027786b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:37.001662 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8fc409e1-ead2-4756-8761-cf3027786b3d None None] MFA Rules not processed for user `5004ae727e3f4a718477ca68cdada91d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:37.002870 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8fc409e1-ead2-4756-8761-cf3027786b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:37.072795 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1418/2795] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:37.084490 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2618b-1ddb-4882-99b8-4f5e79424a4c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:37.086198 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-16e2618b-1ddb-4882-99b8-4f5e79424a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:37.143475 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2618b-1ddb-4882-99b8-4f5e79424a4c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:37.147080 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16bad0-a601-4b55-8035-518962ebb2c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:37.147709 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16bad0-a601-4b55-8035-518962ebb2c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:37.147987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16bad0-a601-4b55-8035-518962ebb2c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:37.148291 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16bad0-a601-4b55-8035-518962ebb2c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:37.203544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16bad0-a601-4b55-8035-518962ebb2c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:37.205074 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16bad0-a601-4b55-8035-518962ebb2c3 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:37.213971 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1378/2796] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:38.196570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798984c-1cb3-4298-aa04-bdd1ebe6cbb3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:38.197085 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798984c-1cb3-4298-aa04-bdd1ebe6cbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:38.197187 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798984c-1cb3-4298-aa04-bdd1ebe6cbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:38.338602 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-5798984c-1cb3-4298-aa04-bdd1ebe6cbb3 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:38.339878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5798984c-1cb3-4298-aa04-bdd1ebe6cbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:38.401920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1419/2797] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jul 14 10:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:38.465572 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16bad0-a601-4b55-8035-518962ebb2c3 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:38.536489 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16bad0-a601-4b55-8035-518962ebb2c3 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:38.542174 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c169c-84a6-42ec-b26e-fda2ce55032e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:38.542827 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c169c-84a6-42ec-b26e-fda2ce55032e service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:38.543122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c169c-84a6-42ec-b26e-fda2ce55032e service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:38.543397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c169c-84a6-42ec-b26e-fda2ce55032e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:38.552026 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c169c-84a6-42ec-b26e-fda2ce55032e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:38.553738 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c169c-84a6-42ec-b26e-fda2ce55032e service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:38.563880 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1379/2798] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:39.200347 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798984c-1cb3-4298-aa04-bdd1ebe6cbb3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:39.210424 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798984c-1cb3-4298-aa04-bdd1ebe6cbb3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:39.214631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23b4cc-3a48-4c86-942f-c997fc389fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:39.215299 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23b4cc-3a48-4c86-942f-c997fc389fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:39.215580 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23b4cc-3a48-4c86-942f-c997fc389fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:39.215850 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23b4cc-3a48-4c86-942f-c997fc389fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:39.271565 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23b4cc-3a48-4c86-942f-c997fc389fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:39.273041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23b4cc-3a48-4c86-942f-c997fc389fe2 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:39.282380 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1420/2799] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:40.717151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c169c-84a6-42ec-b26e-fda2ce55032e service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:40.720478 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:40.736728 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c169c-84a6-42ec-b26e-fda2ce55032e service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:40.740397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef4494-0f6e-4673-ab9b-df2672bb2bdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:40.741048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef4494-0f6e-4673-ab9b-df2672bb2bdc service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:40.741334 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef4494-0f6e-4673-ab9b-df2672bb2bdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:40.741707 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef4494-0f6e-4673-ab9b-df2672bb2bdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:40.772600 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef4494-0f6e-4673-ab9b-df2672bb2bdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:40.774052 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef4494-0f6e-4673-ab9b-df2672bb2bdc service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:40.784331 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1380/2800] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:45.127030 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23b4cc-3a48-4c86-942f-c997fc389fe2 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:45.128635 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9a23b4cc-3a48-4c86-942f-c997fc389fe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:45.149007 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:45.169939 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23b4cc-3a48-4c86-942f-c997fc389fe2 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:45.173554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872aa548-44e6-4233-aeda-59fcc867bd43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:45.176140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aa548-44e6-4233-aeda-59fcc867bd43 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:45.176140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aa548-44e6-4233-aeda-59fcc867bd43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:45.176140 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aa548-44e6-4233-aeda-59fcc867bd43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:45.176520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-872aa548-44e6-4233-aeda-59fcc867bd43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:45.239049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872aa548-44e6-4233-aeda-59fcc867bd43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:45.240473 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872aa548-44e6-4233-aeda-59fcc867bd43 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:45.249825 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1421/2801] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:45.555305 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef4494-0f6e-4673-ab9b-df2672bb2bdc service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:45.588082 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef4494-0f6e-4673-ab9b-df2672bb2bdc service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:45.594122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5d501-2771-4f27-b6dc-3663735c4b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:45.594122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5d501-2771-4f27-b6dc-3663735c4b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:45.594122 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5d501-2771-4f27-b6dc-3663735c4b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:45.594450 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5d501-2771-4f27-b6dc-3663735c4b96 admin admin] PATH_INFO: `/v3/users/c2f5fc1468104a3e82538a395fc00d9f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:45.595767 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5d501-2771-4f27-b6dc-3663735c4b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2f5fc1468104a3e82538a395fc00d9f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:45.597828 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5d501-2771-4f27-b6dc-3663735c4b96 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:45.927007 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-87c5d501-2771-4f27-b6dc-3663735c4b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2f5fc1468104a3e82538a395fc00d9f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:45.939464 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-87c5d501-2771-4f27-b6dc-3663735c4b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2f5fc1468104a3e82538a395fc00d9f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:45.940596 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-87c5d501-2771-4f27-b6dc-3663735c4b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2f5fc1468104a3e82538a395fc00d9f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:46.010357 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-87c5d501-2771-4f27-b6dc-3663735c4b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2f5fc1468104a3e82538a395fc00d9f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:46.011059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-87c5d501-2771-4f27-b6dc-3663735c4b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2f5fc1468104a3e82538a395fc00d9f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:46.024696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1381/2802] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:45 2022] DELETE /identity/v3/users/c2f5fc1468104a3e82538a395fc00d9f => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:46.029430 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4bd3d-99c6-4eb8-bdf6-95733794f81b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:46.029718 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4bd3d-99c6-4eb8-bdf6-95733794f81b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:46.030040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4bd3d-99c6-4eb8-bdf6-95733794f81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:46.072394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-aca4bd3d-99c6-4eb8-bdf6-95733794f81b None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:46.073651 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-aca4bd3d-99c6-4eb8-bdf6-95733794f81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:46.131607 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1422/2803] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:46.141273 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5d501-2771-4f27-b6dc-3663735c4b96 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:46.142711 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-87c5d501-2771-4f27-b6dc-3663735c4b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:46.205394 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5d501-2771-4f27-b6dc-3663735c4b96 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:46.209037 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb9f5e-0eee-4f54-aca0-146bfdadaaf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:46.209686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb9f5e-0eee-4f54-aca0-146bfdadaaf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:46.209973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb9f5e-0eee-4f54-aca0-146bfdadaaf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:46.210250 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb9f5e-0eee-4f54-aca0-146bfdadaaf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:46.219886 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb9f5e-0eee-4f54-aca0-146bfdadaaf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:46.221339 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb9f5e-0eee-4f54-aca0-146bfdadaaf4 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:46.231685 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1382/2804] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:46.657571 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4bd3d-99c6-4eb8-bdf6-95733794f81b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:46.659058 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-aca4bd3d-99c6-4eb8-bdf6-95733794f81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:46.672861 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4bd3d-99c6-4eb8-bdf6-95733794f81b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:46.678449 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:46.679503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:46.679956 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:46.680207 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] PATH_INFO: `/v3/projects/e353c0dab7d34c57af04766655c5ec7c` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:46.682931 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e353c0dab7d34c57af04766655c5ec7c)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:46.689372 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:46.765372 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e353c0dab7d34c57af04766655c5ec7c', 'request_id': 'req-385b1318-f1ec-4af7-b223-3adf08d2c861'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:46.833069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e353c0dab7d34c57af04766655c5ec7c', 'request_id': 'req-385b1318-f1ec-4af7-b223-3adf08d2c861'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:46.838026 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:46.840386 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e353c0dab7d34c57af04766655c5ec7c', 'request_id': 'req-385b1318-f1ec-4af7-b223-3adf08d2c861'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:46.851777 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] The token cache is being invalidate because project e353c0dab7d34c57af04766655c5ec7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:46.852096 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:46.852752 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:46.854889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1423/2805] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:46 2022] DELETE /identity/v3/projects/e353c0dab7d34c57af04766655c5ec7c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:46.858975 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb9f5e-0eee-4f54-aca0-146bfdadaaf4 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:46.868924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb9f5e-0eee-4f54-aca0-146bfdadaaf4 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:46.881169 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:46.924980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5c676-7960-4f6f-aca2-08f019665600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:46.925931 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5c676-7960-4f6f-aca2-08f019665600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:46.926216 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5c676-7960-4f6f-aca2-08f019665600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:46.926491 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5c676-7960-4f6f-aca2-08f019665600 admin admin] PATH_INFO: `/v3/users/e16e946447b54301a06b7b45b779a9e7` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:46.927686 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5c676-7960-4f6f-aca2-08f019665600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16e946447b54301a06b7b45b779a9e7)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:46.929750 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5c676-7960-4f6f-aca2-08f019665600 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:47.092883 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d6b5c676-7960-4f6f-aca2-08f019665600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16e946447b54301a06b7b45b779a9e7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:47.105199 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d6b5c676-7960-4f6f-aca2-08f019665600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16e946447b54301a06b7b45b779a9e7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:47.105904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d6b5c676-7960-4f6f-aca2-08f019665600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16e946447b54301a06b7b45b779a9e7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:47.175214 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d6b5c676-7960-4f6f-aca2-08f019665600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16e946447b54301a06b7b45b779a9e7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:47.175836 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d6b5c676-7960-4f6f-aca2-08f019665600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16e946447b54301a06b7b45b779a9e7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:47.188627 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1383/2806] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:46 2022] DELETE /identity/v3/users/e16e946447b54301a06b7b45b779a9e7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:47.590468 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:47.592051 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:47.605802 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b1318-f1ec-4af7-b223-3adf08d2c861 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:47.671559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:47.671559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:47.671805 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:47.671917 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] PATH_INFO: `/v3/projects/65b5ae00be8b4638af26d2101ff8c57b` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:47.673161 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b5ae00be8b4638af26d2101ff8c57b)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:47.675111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:47.776751 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b5ae00be8b4638af26d2101ff8c57b', 'request_id': 'req-781af47f-cf87-4a41-9a92-c002e22f0518'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:47.843593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b5ae00be8b4638af26d2101ff8c57b', 'request_id': 'req-781af47f-cf87-4a41-9a92-c002e22f0518'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:47.849548 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b5ae00be8b4638af26d2101ff8c57b', 'request_id': 'req-781af47f-cf87-4a41-9a92-c002e22f0518'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:47.860940 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] The token cache is being invalidate because project 65b5ae00be8b4638af26d2101ff8c57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:47.861236 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:47.861876 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:47.863446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1424/2807] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:47 2022] DELETE /identity/v3/projects/65b5ae00be8b4638af26d2101ff8c57b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:47.867501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5c676-7960-4f6f-aca2-08f019665600 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:47.869593 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d6b5c676-7960-4f6f-aca2-08f019665600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:47.883773 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5c676-7960-4f6f-aca2-08f019665600 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:47.943973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ea3a5-034e-4c25-aa0e-c0cacc1e30c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:47.944968 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea3a5-034e-4c25-aa0e-c0cacc1e30c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:47.945258 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea3a5-034e-4c25-aa0e-c0cacc1e30c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:47.945535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea3a5-034e-4c25-aa0e-c0cacc1e30c1 admin admin] PATH_INFO: `/v3/users/5004ae727e3f4a718477ca68cdada91d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:47.947301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ea3a5-034e-4c25-aa0e-c0cacc1e30c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5004ae727e3f4a718477ca68cdada91d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:47.949303 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ea3a5-034e-4c25-aa0e-c0cacc1e30c1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:48.114526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:48.120365 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-319ea3a5-034e-4c25-aa0e-c0cacc1e30c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5004ae727e3f4a718477ca68cdada91d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:48.131897 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-319ea3a5-034e-4c25-aa0e-c0cacc1e30c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5004ae727e3f4a718477ca68cdada91d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:48.132596 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-319ea3a5-034e-4c25-aa0e-c0cacc1e30c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5004ae727e3f4a718477ca68cdada91d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:48.203215 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-319ea3a5-034e-4c25-aa0e-c0cacc1e30c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5004ae727e3f4a718477ca68cdada91d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:48.203837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-319ea3a5-034e-4c25-aa0e-c0cacc1e30c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5004ae727e3f4a718477ca68cdada91d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:48.216912 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1384/2808] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:47 2022] DELETE /identity/v3/users/5004ae727e3f4a718477ca68cdada91d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:48.594900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:48.596518 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:48.615484 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781af47f-cf87-4a41-9a92-c002e22f0518 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:48.674407 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:48.675281 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:48.675567 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:48.675840 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe admin admin] PATH_INFO: `/v3/projects/ff16c44d74f24cb5801fb3339e251d5f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:48.677131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff16c44d74f24cb5801fb3339e251d5f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:48.679172 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:48.706286 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:48.843282 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff16c44d74f24cb5801fb3339e251d5f', 'request_id': 'req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:48.919092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff16c44d74f24cb5801fb3339e251d5f', 'request_id': 'req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:48.924960 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff16c44d74f24cb5801fb3339e251d5f', 'request_id': 'req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:48.936158 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe admin admin] The token cache is being invalidate because project ff16c44d74f24cb5801fb3339e251d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:30:48.936447 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:48.937075 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5731f1f0-5158-45ac-8f1e-49b9d2f0ccbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:48.938613 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1425/2809] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:30:48 2022] DELETE /identity/v3/projects/ff16c44d74f24cb5801fb3339e251d5f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:48.943862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a665bfa-f933-4348-a0ec-250e5b9a084c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:48.944403 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a665bfa-f933-4348-a0ec-250e5b9a084c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:48.944512 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a665bfa-f933-4348-a0ec-250e5b9a084c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:48.992268 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0a665bfa-f933-4348-a0ec-250e5b9a084c None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:48.993540 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0a665bfa-f933-4348-a0ec-250e5b9a084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:49.059771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1385/2810] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:49.063537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc1cb4-fad9-4788-9bc3-4c9f23c6ce97 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:49.063537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc1cb4-fad9-4788-9bc3-4c9f23c6ce97 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:49.063537 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc1cb4-fad9-4788-9bc3-4c9f23c6ce97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:49.085847 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-bbdc1cb4-fad9-4788-9bc3-4c9f23c6ce97 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:49.087229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bbdc1cb4-fad9-4788-9bc3-4c9f23c6ce97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:49.097086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1426/2811] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:49.101332 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a665bfa-f933-4348-a0ec-250e5b9a084c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:49.114264 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a665bfa-f933-4348-a0ec-250e5b9a084c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:49.117390 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9790f-1d12-4a1e-9cba-db75e321e9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:49.118084 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9790f-1d12-4a1e-9cba-db75e321e9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:49.119002 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9790f-1d12-4a1e-9cba-db75e321e9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:49.119286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9790f-1d12-4a1e-9cba-db75e321e9e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:49.120209 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9790f-1d12-4a1e-9cba-db75e321e9e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:30:49.120529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9790f-1d12-4a1e-9cba-db75e321e9e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:49.122135 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9790f-1d12-4a1e-9cba-db75e321e9e8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:49.136640 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1386/2812] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:30:49.140762 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc1cb4-fad9-4788-9bc3-4c9f23c6ce97 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:49.150350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc1cb4-fad9-4788-9bc3-4c9f23c6ce97 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:49.155289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cffae-1ea0-46d7-a616-a125d47b5957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:49.156015 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cffae-1ea0-46d7-a616-a125d47b5957 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:49.156313 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cffae-1ea0-46d7-a616-a125d47b5957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:49.156610 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cffae-1ea0-46d7-a616-a125d47b5957 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:49.157314 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cffae-1ea0-46d7-a616-a125d47b5957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:49.159195 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cffae-1ea0-46d7-a616-a125d47b5957 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:49.248394 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1427/2813] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:49 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:49.259830 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9790f-1d12-4a1e-9cba-db75e321e9e8 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:49.260590 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9790f-1d12-4a1e-9cba-db75e321e9e8 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:49.339856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277995c9-3b9f-4d05-a44b-26a7163c2712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:49.341587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277995c9-3b9f-4d05-a44b-26a7163c2712 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:49.341587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277995c9-3b9f-4d05-a44b-26a7163c2712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:49.341587 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277995c9-3b9f-4d05-a44b-26a7163c2712 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:49.342542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277995c9-3b9f-4d05-a44b-26a7163c2712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:49.344615 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277995c9-3b9f-4d05-a44b-26a7163c2712 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:49.428029 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1387/2814] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:49 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:30:49.432354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cffae-1ea0-46d7-a616-a125d47b5957 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:49.444196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cffae-1ea0-46d7-a616-a125d47b5957 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:49.452108 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7736db-50ea-4f26-91f4-568d524eb9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:49.452854 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7736db-50ea-4f26-91f4-568d524eb9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:49.453256 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7736db-50ea-4f26-91f4-568d524eb9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:49.453968 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7736db-50ea-4f26-91f4-568d524eb9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:49.454435 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7736db-50ea-4f26-91f4-568d524eb9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:49.456986 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7736db-50ea-4f26-91f4-568d524eb9d5 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:49.469525 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1428/2815] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:49.473179 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277995c9-3b9f-4d05-a44b-26a7163c2712 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:49.484957 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277995c9-3b9f-4d05-a44b-26a7163c2712 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:49.490026 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81290753-1c5d-4dcf-a452-64b4f90e3897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:49.490704 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81290753-1c5d-4dcf-a452-64b4f90e3897 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:49.490991 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81290753-1c5d-4dcf-a452-64b4f90e3897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:49.491406 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81290753-1c5d-4dcf-a452-64b4f90e3897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:49.492311 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81290753-1c5d-4dcf-a452-64b4f90e3897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:49.494584 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81290753-1c5d-4dcf-a452-64b4f90e3897 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:49.497093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:49.506655 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1388/2816] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:49.511143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7736db-50ea-4f26-91f4-568d524eb9d5 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:49.522143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7736db-50ea-4f26-91f4-568d524eb9d5 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:49.527069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63bb98-25f0-4ace-bfa9-737ba07e4214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:49.528090 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63bb98-25f0-4ace-bfa9-737ba07e4214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:49.528377 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63bb98-25f0-4ace-bfa9-737ba07e4214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:49.528654 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63bb98-25f0-4ace-bfa9-737ba07e4214 admin admin] PATH_INFO: `/v3/projects/76b925302d674f3f83e505e26ab644bc/users/746e4b3ab2a841e5beb94a960494454c/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:49.544423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63bb98-25f0-4ace-bfa9-737ba07e4214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b925302d674f3f83e505e26ab644bc, user_id=746e4b3ab2a841e5beb94a960494454c, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:49.547135 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63bb98-25f0-4ace-bfa9-737ba07e4214 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:49.627885 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1429/2817] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:49 2022] PUT /identity/v3/projects/76b925302d674f3f83e505e26ab644bc/users/746e4b3ab2a841e5beb94a960494454c/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:30:49.638282 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d170c-2e20-4f1e-b598-8e4b8141e657 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:49.638657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d170c-2e20-4f1e-b598-8e4b8141e657 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:49.638939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d170c-2e20-4f1e-b598-8e4b8141e657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:49.670727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4e7d170c-2e20-4f1e-b598-8e4b8141e657 None None] MFA Rules not processed for user `746e4b3ab2a841e5beb94a960494454c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:49.671973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4e7d170c-2e20-4f1e-b598-8e4b8141e657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:49.769807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1389/2818] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:49.773948 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63bb98-25f0-4ace-bfa9-737ba07e4214 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:49.861207 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63bb98-25f0-4ace-bfa9-737ba07e4214 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:49.867178 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f34510-57bb-4c1a-8ea7-3b88c57e9405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:49.867985 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f34510-57bb-4c1a-8ea7-3b88c57e9405 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:49.868222 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f34510-57bb-4c1a-8ea7-3b88c57e9405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:49.872354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f34510-57bb-4c1a-8ea7-3b88c57e9405 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:49.872354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f34510-57bb-4c1a-8ea7-3b88c57e9405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:49.872354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f34510-57bb-4c1a-8ea7-3b88c57e9405 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:50.001086 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1430/2819] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:49 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:50.005316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d170c-2e20-4f1e-b598-8e4b8141e657 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:50.016048 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d170c-2e20-4f1e-b598-8e4b8141e657 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:50.081358 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde5874-b479-4ba0-a21c-152bb2fec5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:50.082123 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde5874-b479-4ba0-a21c-152bb2fec5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:50.082528 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde5874-b479-4ba0-a21c-152bb2fec5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:50.082960 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde5874-b479-4ba0-a21c-152bb2fec5c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:50.083665 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde5874-b479-4ba0-a21c-152bb2fec5c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:50.085483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde5874-b479-4ba0-a21c-152bb2fec5c3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:50.201737 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1390/2820] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:50 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:50.205884 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f34510-57bb-4c1a-8ea7-3b88c57e9405 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:50.216362 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f34510-57bb-4c1a-8ea7-3b88c57e9405 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:50.221428 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d17ab-a8ca-4a15-a76c-5f1806615cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:50.222121 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d17ab-a8ca-4a15-a76c-5f1806615cdc admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:50.222405 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d17ab-a8ca-4a15-a76c-5f1806615cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:50.222680 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d17ab-a8ca-4a15-a76c-5f1806615cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:50.223409 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d17ab-a8ca-4a15-a76c-5f1806615cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:50.225013 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d17ab-a8ca-4a15-a76c-5f1806615cdc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:50.236533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1431/2821] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:50.240369 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde5874-b479-4ba0-a21c-152bb2fec5c3 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:50.250904 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde5874-b479-4ba0-a21c-152bb2fec5c3 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:50.259442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d478fa-0e25-48d9-a703-654b316bd33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:50.259442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d478fa-0e25-48d9-a703-654b316bd33f admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:50.259442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d478fa-0e25-48d9-a703-654b316bd33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:50.259442 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d478fa-0e25-48d9-a703-654b316bd33f admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:50.260096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d478fa-0e25-48d9-a703-654b316bd33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:50.260096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d478fa-0e25-48d9-a703-654b316bd33f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:50.270095 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1391/2822] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:50.273860 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d17ab-a8ca-4a15-a76c-5f1806615cdc admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:50.284395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d17ab-a8ca-4a15-a76c-5f1806615cdc admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:50.289239 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a4c25-5769-4342-bdf1-5010e0f5334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:50.290732 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4c25-5769-4342-bdf1-5010e0f5334e admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:50.291080 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4c25-5769-4342-bdf1-5010e0f5334e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:50.291432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4c25-5769-4342-bdf1-5010e0f5334e admin admin] PATH_INFO: `/v3/projects/43fe081bc8c34d0396746ae5173c8d56/users/bf06794a7660467cb2261ec3a52f57c9/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:50.306979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a4c25-5769-4342-bdf1-5010e0f5334e admin admin] RBAC: Authorizing `identity:create_grant(project_id=43fe081bc8c34d0396746ae5173c8d56, user_id=bf06794a7660467cb2261ec3a52f57c9, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:50.311374 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a4c25-5769-4342-bdf1-5010e0f5334e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:50.313036 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:50.393295 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1432/2823] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:50 2022] PUT /identity/v3/projects/43fe081bc8c34d0396746ae5173c8d56/users/bf06794a7660467cb2261ec3a52f57c9/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:50.404252 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e423b-8efb-48ec-964c-99d2e25caade None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:50.404538 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e423b-8efb-48ec-964c-99d2e25caade None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:50.404813 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e423b-8efb-48ec-964c-99d2e25caade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:50.431300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6e4e423b-8efb-48ec-964c-99d2e25caade None None] MFA Rules not processed for user `bf06794a7660467cb2261ec3a52f57c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:50.432544 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6e4e423b-8efb-48ec-964c-99d2e25caade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:50.492603 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:50.502666 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1392/2824] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:50.507346 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a4c25-5769-4342-bdf1-5010e0f5334e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:50.569111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a4c25-5769-4342-bdf1-5010e0f5334e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:50.573757 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179279ae-0640-444c-b570-3dc4d688262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:50.574419 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179279ae-0640-444c-b570-3dc4d688262e admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:50.574719 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179279ae-0640-444c-b570-3dc4d688262e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:50.574983 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179279ae-0640-444c-b570-3dc4d688262e admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:50.575661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179279ae-0640-444c-b570-3dc4d688262e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:50.577587 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179279ae-0640-444c-b570-3dc4d688262e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:50.711201 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1433/2825] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:30:50 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:30:50.712891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e423b-8efb-48ec-964c-99d2e25caade None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:50.725080 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e423b-8efb-48ec-964c-99d2e25caade None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:50.784065 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18520b-418d-4f6d-86ee-531e5918a273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:50.784801 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18520b-418d-4f6d-86ee-531e5918a273 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:50.785086 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18520b-418d-4f6d-86ee-531e5918a273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:50.785363 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18520b-418d-4f6d-86ee-531e5918a273 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:50.786073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18520b-418d-4f6d-86ee-531e5918a273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:50.787977 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18520b-418d-4f6d-86ee-531e5918a273 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:50.919807 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1393/2826] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:30:50 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:30:50.923627 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179279ae-0640-444c-b570-3dc4d688262e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:50.934982 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179279ae-0640-444c-b570-3dc4d688262e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:50.945288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ac7d3-a1aa-494f-b5a2-198f28b76f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:50.945288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ac7d3-a1aa-494f-b5a2-198f28b76f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:50.945288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ac7d3-a1aa-494f-b5a2-198f28b76f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:50.945288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ac7d3-a1aa-494f-b5a2-198f28b76f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:50.945761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ac7d3-a1aa-494f-b5a2-198f28b76f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:50.945761 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ac7d3-a1aa-494f-b5a2-198f28b76f53 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:50.958225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1434/2827] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:30:50.959326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18520b-418d-4f6d-86ee-531e5918a273 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:50.970497 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18520b-418d-4f6d-86ee-531e5918a273 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:50.975469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ada88-03d5-48e1-93b2-8131cdaf602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:50.976469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ada88-03d5-48e1-93b2-8131cdaf602f admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:50.976827 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ada88-03d5-48e1-93b2-8131cdaf602f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:50.977178 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ada88-03d5-48e1-93b2-8131cdaf602f admin admin] PATH_INFO: `/v3/projects/6e83400b124f4bfe9ea7a9aba114b15b/users/95530c81057040929b087ea5207ec924/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:50.994589 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ada88-03d5-48e1-93b2-8131cdaf602f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e83400b124f4bfe9ea7a9aba114b15b, user_id=95530c81057040929b087ea5207ec924, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:50.997830 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ada88-03d5-48e1-93b2-8131cdaf602f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:51.091123 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1394/2828] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:50 2022] PUT /identity/v3/projects/6e83400b124f4bfe9ea7a9aba114b15b/users/95530c81057040929b087ea5207ec924/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:51.096356 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ac7d3-a1aa-494f-b5a2-198f28b76f53 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:51.106404 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ac7d3-a1aa-494f-b5a2-198f28b76f53 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:51.165155 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c10011-737f-4115-8ac5-4e4cf3f1bdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:51.165829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c10011-737f-4115-8ac5-4e4cf3f1bdcd admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:51.166121 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c10011-737f-4115-8ac5-4e4cf3f1bdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:51.166400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c10011-737f-4115-8ac5-4e4cf3f1bdcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:51.167124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c10011-737f-4115-8ac5-4e4cf3f1bdcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:51.168811 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c10011-737f-4115-8ac5-4e4cf3f1bdcd admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:51.178665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1435/2829] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:30:51.183469 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ada88-03d5-48e1-93b2-8131cdaf602f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:51.194292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ada88-03d5-48e1-93b2-8131cdaf602f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:51.200880 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a5318-1bee-4db6-ae13-6c8509d55897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:51.201768 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5318-1bee-4db6-ae13-6c8509d55897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:51.202053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5318-1bee-4db6-ae13-6c8509d55897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:51.202327 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5318-1bee-4db6-ae13-6c8509d55897 admin admin] PATH_INFO: `/v3/projects/6e83400b124f4bfe9ea7a9aba114b15b/users/95530c81057040929b087ea5207ec924/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:51.204409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a5318-1bee-4db6-ae13-6c8509d55897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e83400b124f4bfe9ea7a9aba114b15b, user_id=95530c81057040929b087ea5207ec924, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:51.208351 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a5318-1bee-4db6-ae13-6c8509d55897 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:51.221428 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1395/2830] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:30:51 2022] PUT /identity/v3/projects/6e83400b124f4bfe9ea7a9aba114b15b/users/95530c81057040929b087ea5207ec924/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:30:51.231898 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c7d70-2df0-45d5-8dfd-bbed4c7f960d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:51.232221 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c7d70-2df0-45d5-8dfd-bbed4c7f960d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:51.232531 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c7d70-2df0-45d5-8dfd-bbed4c7f960d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:51.258446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-fa1c7d70-2df0-45d5-8dfd-bbed4c7f960d None None] MFA Rules not processed for user `95530c81057040929b087ea5207ec924`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:51.260279 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fa1c7d70-2df0-45d5-8dfd-bbed4c7f960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:51.309958 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:51.327562 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1436/2831] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:30:51.339616 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a5318-1bee-4db6-ae13-6c8509d55897 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:51.341352 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3b3a5318-1bee-4db6-ae13-6c8509d55897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:51.400044 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a5318-1bee-4db6-ae13-6c8509d55897 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:51.403726 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb1406-d0d3-4ef1-ae3d-fd2a1f862f1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:51.404412 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb1406-d0d3-4ef1-ae3d-fd2a1f862f1f service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:51.404696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb1406-d0d3-4ef1-ae3d-fd2a1f862f1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:51.404971 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb1406-d0d3-4ef1-ae3d-fd2a1f862f1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:51.465420 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb1406-d0d3-4ef1-ae3d-fd2a1f862f1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:51.466933 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb1406-d0d3-4ef1-ae3d-fd2a1f862f1f service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:51.479833 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1396/2832] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:53.503259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c7d70-2df0-45d5-8dfd-bbed4c7f960d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:53.504855 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fa1c7d70-2df0-45d5-8dfd-bbed4c7f960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:53.517254 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c7d70-2df0-45d5-8dfd-bbed4c7f960d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:53.520852 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae3095-4232-48ce-9513-4eb02241b603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:53.521495 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae3095-4232-48ce-9513-4eb02241b603 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:53.521779 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae3095-4232-48ce-9513-4eb02241b603 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:53.522056 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae3095-4232-48ce-9513-4eb02241b603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:53.579600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae3095-4232-48ce-9513-4eb02241b603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:53.581232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae3095-4232-48ce-9513-4eb02241b603 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:53.590195 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1437/2833] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:54.982964 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb1406-d0d3-4ef1-ae3d-fd2a1f862f1f service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:54.986992 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:30:54.992316 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb1406-d0d3-4ef1-ae3d-fd2a1f862f1f service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:54.996529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e740cbd-424c-4554-9657-2954db54722c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12abc4b2a8d348d992e0bb00a1218929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:54.997182 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e740cbd-424c-4554-9657-2954db54722c service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:54.997523 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e740cbd-424c-4554-9657-2954db54722c service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:54.997813 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e740cbd-424c-4554-9657-2954db54722c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:55.006754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e740cbd-424c-4554-9657-2954db54722c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:55.008232 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e740cbd-424c-4554-9657-2954db54722c service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:55.018159 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1397/2834] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:30:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:30:55.570188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe5ce1-d9d8-4457-87bf-24293883d868 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:55.570657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe5ce1-d9d8-4457-87bf-24293883d868 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:55.570780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe5ce1-d9d8-4457-87bf-24293883d868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:55.587504 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2bbe5ce1-d9d8-4457-87bf-24293883d868 None None] MFA Rules not processed for user `594b7245d5e7439db9f1e7d117e0586a`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:30:55.588736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2bbe5ce1-d9d8-4457-87bf-24293883d868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:30:55.652226 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1438/2835] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:30:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:30:59.664016 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e740cbd-424c-4554-9657-2954db54722c service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:30:59.734031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e740cbd-424c-4554-9657-2954db54722c service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:30:59.739794 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5838ae-c935-4a95-96f7-4a8d9bd48e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:30:59.740889 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5838ae-c935-4a95-96f7-4a8d9bd48e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:30:59.741255 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5838ae-c935-4a95-96f7-4a8d9bd48e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:30:59.741637 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5838ae-c935-4a95-96f7-4a8d9bd48e7c admin admin] PATH_INFO: `/v3/users/746e4b3ab2a841e5beb94a960494454c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:30:59.742917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5838ae-c935-4a95-96f7-4a8d9bd48e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=746e4b3ab2a841e5beb94a960494454c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:30:59.745031 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5838ae-c935-4a95-96f7-4a8d9bd48e7c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:30:59.903142 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3b5838ae-c935-4a95-96f7-4a8d9bd48e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '746e4b3ab2a841e5beb94a960494454c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:59.915685 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3b5838ae-c935-4a95-96f7-4a8d9bd48e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '746e4b3ab2a841e5beb94a960494454c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:59.916501 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3b5838ae-c935-4a95-96f7-4a8d9bd48e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '746e4b3ab2a841e5beb94a960494454c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:59.985701 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3b5838ae-c935-4a95-96f7-4a8d9bd48e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '746e4b3ab2a841e5beb94a960494454c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:30:59.986333 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3b5838ae-c935-4a95-96f7-4a8d9bd48e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '746e4b3ab2a841e5beb94a960494454c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:00.001185 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1398/2836] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:30:59 2022] DELETE /identity/v3/users/746e4b3ab2a841e5beb94a960494454c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:00.005932 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31237e-89f5-4744-a41c-48deedb09e52 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:00.006382 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31237e-89f5-4744-a41c-48deedb09e52 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:00.006551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31237e-89f5-4744-a41c-48deedb09e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:00.024833 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ed31237e-89f5-4744-a41c-48deedb09e52 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:31:00.026054 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ed31237e-89f5-4744-a41c-48deedb09e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:00.107532 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1439/2837] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:31:00.117650 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5838ae-c935-4a95-96f7-4a8d9bd48e7c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:00.119207 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3b5838ae-c935-4a95-96f7-4a8d9bd48e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:00.206888 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:00.209418 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5838ae-c935-4a95-96f7-4a8d9bd48e7c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:00.213427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db46151-6544-495c-927d-ab2539ac068c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:00.214073 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db46151-6544-495c-927d-ab2539ac068c service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:00.214348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db46151-6544-495c-927d-ab2539ac068c service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:00.214611 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db46151-6544-495c-927d-ab2539ac068c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:00.223803 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db46151-6544-495c-927d-ab2539ac068c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:00.225265 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db46151-6544-495c-927d-ab2539ac068c service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:00.235232 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1399/2838] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:31:00.844669 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31237e-89f5-4744-a41c-48deedb09e52 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:00.846142 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ed31237e-89f5-4744-a41c-48deedb09e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:00.859175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31237e-89f5-4744-a41c-48deedb09e52 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:00.868375 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:00.874869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:00.874869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:00.874869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] PATH_INFO: `/v3/projects/76b925302d674f3f83e505e26ab644bc` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:00.874869 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b925302d674f3f83e505e26ab644bc)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:00.876149 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:00.986516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:01.001288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b925302d674f3f83e505e26ab644bc', 'request_id': 'req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:01.106315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b925302d674f3f83e505e26ab644bc', 'request_id': 'req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:01.112639 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b925302d674f3f83e505e26ab644bc', 'request_id': 'req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:01.124459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] The token cache is being invalidate because project 76b925302d674f3f83e505e26ab644bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:31:01.124746 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:01.125400 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:01.126943 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1440/2839] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:31:00 2022] DELETE /identity/v3/projects/76b925302d674f3f83e505e26ab644bc => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:01.130846 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db46151-6544-495c-927d-ab2539ac068c service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:01.142431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db46151-6544-495c-927d-ab2539ac068c service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:01.209969 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683949f-11bf-4046-9507-988d19c0f840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:01.211075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683949f-11bf-4046-9507-988d19c0f840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:01.211437 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683949f-11bf-4046-9507-988d19c0f840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:01.211786 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683949f-11bf-4046-9507-988d19c0f840 admin admin] PATH_INFO: `/v3/users/bf06794a7660467cb2261ec3a52f57c9` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:01.213248 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683949f-11bf-4046-9507-988d19c0f840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf06794a7660467cb2261ec3a52f57c9)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:01.215197 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683949f-11bf-4046-9507-988d19c0f840 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:01.365690 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5683949f-11bf-4046-9507-988d19c0f840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf06794a7660467cb2261ec3a52f57c9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:01.378374 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5683949f-11bf-4046-9507-988d19c0f840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf06794a7660467cb2261ec3a52f57c9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:01.379146 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5683949f-11bf-4046-9507-988d19c0f840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf06794a7660467cb2261ec3a52f57c9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:01.442787 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5683949f-11bf-4046-9507-988d19c0f840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf06794a7660467cb2261ec3a52f57c9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:01.443397 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5683949f-11bf-4046-9507-988d19c0f840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf06794a7660467cb2261ec3a52f57c9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:01.469624 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1400/2840] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:31:01 2022] DELETE /identity/v3/users/bf06794a7660467cb2261ec3a52f57c9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:01.940175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:01.940175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:01.953065 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba17d7-b507-4bb3-9f95-7f52bc04e340 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:02.020875 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:02.021747 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:02.022024 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:02.022289 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] PATH_INFO: `/v3/projects/43fe081bc8c34d0396746ae5173c8d56` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:02.023475 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] RBAC: Authorizing `identity:delete_project(project_id=43fe081bc8c34d0396746ae5173c8d56)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:02.025552 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:02.149137 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43fe081bc8c34d0396746ae5173c8d56', 'request_id': 'req-33957584-951d-469c-8cfe-ef9daced193d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:02.243062 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43fe081bc8c34d0396746ae5173c8d56', 'request_id': 'req-33957584-951d-469c-8cfe-ef9daced193d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:02.250061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43fe081bc8c34d0396746ae5173c8d56', 'request_id': 'req-33957584-951d-469c-8cfe-ef9daced193d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:02.261399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] The token cache is being invalidate because project 43fe081bc8c34d0396746ae5173c8d56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:31:02.261704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:02.262345 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:02.263901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1441/2841] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:31:01 2022] DELETE /identity/v3/projects/43fe081bc8c34d0396746ae5173c8d56 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:02.268053 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683949f-11bf-4046-9507-988d19c0f840 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:02.271534 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5683949f-11bf-4046-9507-988d19c0f840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:02.283364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683949f-11bf-4046-9507-988d19c0f840 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:02.345454 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d950caa-225f-4032-b916-fae164a45db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:02.346315 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d950caa-225f-4032-b916-fae164a45db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:02.346596 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d950caa-225f-4032-b916-fae164a45db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:02.346868 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d950caa-225f-4032-b916-fae164a45db2 admin admin] PATH_INFO: `/v3/users/95530c81057040929b087ea5207ec924` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:02.348072 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d950caa-225f-4032-b916-fae164a45db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95530c81057040929b087ea5207ec924)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:02.349962 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d950caa-225f-4032-b916-fae164a45db2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:02.362502 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:02.530576 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d950caa-225f-4032-b916-fae164a45db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95530c81057040929b087ea5207ec924'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:02.542035 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d950caa-225f-4032-b916-fae164a45db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95530c81057040929b087ea5207ec924'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:02.543228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d950caa-225f-4032-b916-fae164a45db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95530c81057040929b087ea5207ec924'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:02.618955 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d950caa-225f-4032-b916-fae164a45db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95530c81057040929b087ea5207ec924'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:02.622708 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d950caa-225f-4032-b916-fae164a45db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95530c81057040929b087ea5207ec924'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:02.632492 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1401/2842] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:31:02 2022] DELETE /identity/v3/users/95530c81057040929b087ea5207ec924 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:03.027570 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:03.029037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:03.045384 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33957584-951d-469c-8cfe-ef9daced193d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:03.093485 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:03.105040 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:03.105987 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:03.106274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:03.106551 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] PATH_INFO: `/v3/projects/6e83400b124f4bfe9ea7a9aba114b15b` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:03.107736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e83400b124f4bfe9ea7a9aba114b15b)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:03.109684 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:03.215542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e83400b124f4bfe9ea7a9aba114b15b', 'request_id': 'req-e4f95732-4047-49f8-bc3b-8780787bf3a8'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:03.310780 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e83400b124f4bfe9ea7a9aba114b15b', 'request_id': 'req-e4f95732-4047-49f8-bc3b-8780787bf3a8'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:03.317128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e83400b124f4bfe9ea7a9aba114b15b', 'request_id': 'req-e4f95732-4047-49f8-bc3b-8780787bf3a8'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:03.328714 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] The token cache is being invalidate because project 6e83400b124f4bfe9ea7a9aba114b15b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:31:03.329002 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:03.329622 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:03.331143 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1442/2843] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:31:03 2022] DELETE /identity/v3/projects/6e83400b124f4bfe9ea7a9aba114b15b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:10.957657 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d950caa-225f-4032-b916-fae164a45db2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:10.959117 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0d950caa-225f-4032-b916-fae164a45db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:10.972685 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d950caa-225f-4032-b916-fae164a45db2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:11.029706 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686ff30-b546-4a7e-bece-bd961a0a1cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:11.030579 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ff30-b546-4a7e-bece-bd961a0a1cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:11.030859 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ff30-b546-4a7e-bece-bd961a0a1cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:11.031128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ff30-b546-4a7e-bece-bd961a0a1cd3 admin admin] PATH_INFO: `/v3/users/7b346f41ee1a4088beaf57bf937e840a` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:11.032344 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686ff30-b546-4a7e-bece-bd961a0a1cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b346f41ee1a4088beaf57bf937e840a)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:11.034290 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686ff30-b546-4a7e-bece-bd961a0a1cd3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:11.273187 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2686ff30-b546-4a7e-bece-bd961a0a1cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b346f41ee1a4088beaf57bf937e840a'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:11.285591 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2686ff30-b546-4a7e-bece-bd961a0a1cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b346f41ee1a4088beaf57bf937e840a'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:11.286263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2686ff30-b546-4a7e-bece-bd961a0a1cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b346f41ee1a4088beaf57bf937e840a'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:11.356500 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2686ff30-b546-4a7e-bece-bd961a0a1cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b346f41ee1a4088beaf57bf937e840a'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:11.357118 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2686ff30-b546-4a7e-bece-bd961a0a1cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b346f41ee1a4088beaf57bf937e840a'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:11.370393 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1402/2844] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:31:10 2022] DELETE /identity/v3/users/7b346f41ee1a4088beaf57bf937e840a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:11.642889 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:11.644391 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:11.661900 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f95732-4047-49f8-bc3b-8780787bf3a8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:11.723908 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12c862-25bb-47d1-84ac-08a53672c5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:11.724722 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12c862-25bb-47d1-84ac-08a53672c5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:11.725009 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12c862-25bb-47d1-84ac-08a53672c5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:11.725288 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12c862-25bb-47d1-84ac-08a53672c5c5 admin admin] PATH_INFO: `/v3/projects/72688bbbb13b4b6ba6bf864acda50a11` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:11.726514 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12c862-25bb-47d1-84ac-08a53672c5c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72688bbbb13b4b6ba6bf864acda50a11)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:11.728492 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12c862-25bb-47d1-84ac-08a53672c5c5 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:11.820812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7a12c862-25bb-47d1-84ac-08a53672c5c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72688bbbb13b4b6ba6bf864acda50a11', 'request_id': 'req-7a12c862-25bb-47d1-84ac-08a53672c5c5'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:11.933770 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7a12c862-25bb-47d1-84ac-08a53672c5c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72688bbbb13b4b6ba6bf864acda50a11', 'request_id': 'req-7a12c862-25bb-47d1-84ac-08a53672c5c5'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:11.940300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7a12c862-25bb-47d1-84ac-08a53672c5c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72688bbbb13b4b6ba6bf864acda50a11', 'request_id': 'req-7a12c862-25bb-47d1-84ac-08a53672c5c5'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:11.952022 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7a12c862-25bb-47d1-84ac-08a53672c5c5 admin admin] The token cache is being invalidate because project 72688bbbb13b4b6ba6bf864acda50a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:31:11.952320 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7a12c862-25bb-47d1-84ac-08a53672c5c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:11.952951 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7a12c862-25bb-47d1-84ac-08a53672c5c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:11.954491 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1443/2845] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:31:11 2022] DELETE /identity/v3/projects/72688bbbb13b4b6ba6bf864acda50a11 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:11.958525 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686ff30-b546-4a7e-bece-bd961a0a1cd3 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:11.960059 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2686ff30-b546-4a7e-bece-bd961a0a1cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:11.973326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686ff30-b546-4a7e-bece-bd961a0a1cd3 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:11.986765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:12.028930 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d46176-f2f1-49a4-a668-e9f80cbe728e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:12.029765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d46176-f2f1-49a4-a668-e9f80cbe728e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:12.030046 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d46176-f2f1-49a4-a668-e9f80cbe728e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:12.030315 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d46176-f2f1-49a4-a668-e9f80cbe728e admin admin] PATH_INFO: `/v3/users/a5b2e39df1bc4679816eecdae67f988c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:12.031487 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d46176-f2f1-49a4-a668-e9f80cbe728e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b2e39df1bc4679816eecdae67f988c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:12.033409 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d46176-f2f1-49a4-a668-e9f80cbe728e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:12.080845 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10df04-0aae-4ae6-b22d-4cc6855a0184 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:12.081134 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10df04-0aae-4ae6-b22d-4cc6855a0184 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:12.081406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10df04-0aae-4ae6-b22d-4cc6855a0184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:12.099534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0f10df04-0aae-4ae6-b22d-4cc6855a0184 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:31:12.100768 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0f10df04-0aae-4ae6-b22d-4cc6855a0184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:12.109829 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1444/2846] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jul 14 10:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:31:12.132410 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10df04-0aae-4ae6-b22d-4cc6855a0184 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:12.133795 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0f10df04-0aae-4ae6-b22d-4cc6855a0184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:12.137330 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:12.210757 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-04d46176-f2f1-49a4-a668-e9f80cbe728e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b2e39df1bc4679816eecdae67f988c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:12.228144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-04d46176-f2f1-49a4-a668-e9f80cbe728e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b2e39df1bc4679816eecdae67f988c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:12.228839 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-04d46176-f2f1-49a4-a668-e9f80cbe728e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b2e39df1bc4679816eecdae67f988c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:12.243976 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10df04-0aae-4ae6-b22d-4cc6855a0184 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:12.246367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ec7b6-e206-4d51-b1dc-df8276c1d534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:12.247047 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ec7b6-e206-4d51-b1dc-df8276c1d534 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:12.247328 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ec7b6-e206-4d51-b1dc-df8276c1d534 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:12.247600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ec7b6-e206-4d51-b1dc-df8276c1d534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:12.249429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2a2ec7b6-e206-4d51-b1dc-df8276c1d534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:12.260486 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ec7b6-e206-4d51-b1dc-df8276c1d534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:12.262282 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ec7b6-e206-4d51-b1dc-df8276c1d534 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:12.271596 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1445/2847] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:31:12.424925 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-04d46176-f2f1-49a4-a668-e9f80cbe728e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b2e39df1bc4679816eecdae67f988c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:12.425696 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-04d46176-f2f1-49a4-a668-e9f80cbe728e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b2e39df1bc4679816eecdae67f988c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:12.438771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1403/2848] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:31:11 2022] DELETE /identity/v3/users/a5b2e39df1bc4679816eecdae67f988c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:12.678342 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ec7b6-e206-4d51-b1dc-df8276c1d534 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:12.679809 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2a2ec7b6-e206-4d51-b1dc-df8276c1d534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:12.692275 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ec7b6-e206-4d51-b1dc-df8276c1d534 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:12.750369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2790c34-9f6b-49be-9978-be5e2e92a5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:12.751246 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2790c34-9f6b-49be-9978-be5e2e92a5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:12.751534 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2790c34-9f6b-49be-9978-be5e2e92a5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:12.751814 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2790c34-9f6b-49be-9978-be5e2e92a5f1 admin admin] PATH_INFO: `/v3/projects/b77782a3aff94707a965c30ffe3190c2` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:12.753041 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2790c34-9f6b-49be-9978-be5e2e92a5f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77782a3aff94707a965c30ffe3190c2)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:12.755004 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2790c34-9f6b-49be-9978-be5e2e92a5f1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:12.861167 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a2790c34-9f6b-49be-9978-be5e2e92a5f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77782a3aff94707a965c30ffe3190c2', 'request_id': 'req-a2790c34-9f6b-49be-9978-be5e2e92a5f1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:12.938955 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a2790c34-9f6b-49be-9978-be5e2e92a5f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77782a3aff94707a965c30ffe3190c2', 'request_id': 'req-a2790c34-9f6b-49be-9978-be5e2e92a5f1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:12.943769 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:12.945044 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a2790c34-9f6b-49be-9978-be5e2e92a5f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77782a3aff94707a965c30ffe3190c2', 'request_id': 'req-a2790c34-9f6b-49be-9978-be5e2e92a5f1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:12.957355 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a2790c34-9f6b-49be-9978-be5e2e92a5f1 admin admin] The token cache is being invalidate because project b77782a3aff94707a965c30ffe3190c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:31:12.957649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a2790c34-9f6b-49be-9978-be5e2e92a5f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:12.958490 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a2790c34-9f6b-49be-9978-be5e2e92a5f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:12.960130 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1446/2849] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:31:12 2022] DELETE /identity/v3/projects/b77782a3aff94707a965c30ffe3190c2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:12.965068 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d0bc1-078f-4049-a3b3-19470870c9b9 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:12.965518 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d0bc1-078f-4049-a3b3-19470870c9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:12.965613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d0bc1-078f-4049-a3b3-19470870c9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:12.983959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f60d0bc1-078f-4049-a3b3-19470870c9b9 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:31:12.985300 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f60d0bc1-078f-4049-a3b3-19470870c9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:13.044433 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1404/2850] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:31:13.052208 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe80f1b-fbee-4458-856b-f12aa92c319e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:13.052493 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe80f1b-fbee-4458-856b-f12aa92c319e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:13.052767 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe80f1b-fbee-4458-856b-f12aa92c319e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:13.073842 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ebe80f1b-fbee-4458-856b-f12aa92c319e None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:31:13.075598 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ebe80f1b-fbee-4458-856b-f12aa92c319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:13.083593 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1447/2851] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:31:13.087812 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d0bc1-078f-4049-a3b3-19470870c9b9 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:13.097582 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d0bc1-078f-4049-a3b3-19470870c9b9 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:13.102366 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad8ebf-21cd-4070-a641-483bb9d5ecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:13.103020 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad8ebf-21cd-4070-a641-483bb9d5ecfc admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:13.103303 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad8ebf-21cd-4070-a641-483bb9d5ecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:13.103578 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad8ebf-21cd-4070-a641-483bb9d5ecfc admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:13.104348 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad8ebf-21cd-4070-a641-483bb9d5ecfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:31:13.104653 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad8ebf-21cd-4070-a641-483bb9d5ecfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:13.106244 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad8ebf-21cd-4070-a641-483bb9d5ecfc admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:13.119580 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1405/2852] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:31:13.124832 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe80f1b-fbee-4458-856b-f12aa92c319e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:13.135826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe80f1b-fbee-4458-856b-f12aa92c319e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:13.142262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2e066-010c-49bc-a007-fa902d208b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:13.142964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2e066-010c-49bc-a007-fa902d208b37 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:13.143219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2e066-010c-49bc-a007-fa902d208b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:13.143503 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2e066-010c-49bc-a007-fa902d208b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:13.144232 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2e066-010c-49bc-a007-fa902d208b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:13.146245 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2e066-010c-49bc-a007-fa902d208b37 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:13.295262 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1448/2853] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:31:13 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:31:13.299456 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad8ebf-21cd-4070-a641-483bb9d5ecfc admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:13.309917 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad8ebf-21cd-4070-a641-483bb9d5ecfc admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:13.321448 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:13.365336 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4f63-c5ba-4649-9d7a-f33ce82446e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:13.365998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4f63-c5ba-4649-9d7a-f33ce82446e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:13.366283 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4f63-c5ba-4649-9d7a-f33ce82446e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:13.366558 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4f63-c5ba-4649-9d7a-f33ce82446e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:13.367237 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4f63-c5ba-4649-9d7a-f33ce82446e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:13.369213 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4f63-c5ba-4649-9d7a-f33ce82446e5 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:13.436562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1406/2854] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:31:13 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:31:13.440733 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2e066-010c-49bc-a007-fa902d208b37 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:13.451878 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2e066-010c-49bc-a007-fa902d208b37 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:13.456582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f8694-d2a9-4538-b4d9-9716ba163881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:13.457246 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f8694-d2a9-4538-b4d9-9716ba163881 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:13.457559 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f8694-d2a9-4538-b4d9-9716ba163881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:13.457834 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f8694-d2a9-4538-b4d9-9716ba163881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:13.458588 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f8694-d2a9-4538-b4d9-9716ba163881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:13.460197 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f8694-d2a9-4538-b4d9-9716ba163881 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:13.469968 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1449/2855] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:31:13.473804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4f63-c5ba-4649-9d7a-f33ce82446e5 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:13.483662 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4f63-c5ba-4649-9d7a-f33ce82446e5 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:13.488313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e5e1c-14a9-48f7-a2d3-9e63eb00873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:13.488973 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e5e1c-14a9-48f7-a2d3-9e63eb00873b admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:13.489259 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e5e1c-14a9-48f7-a2d3-9e63eb00873b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:13.489541 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e5e1c-14a9-48f7-a2d3-9e63eb00873b admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:13.490275 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e5e1c-14a9-48f7-a2d3-9e63eb00873b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:13.491877 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e5e1c-14a9-48f7-a2d3-9e63eb00873b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:13.503804 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1407/2856] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:31:13.507959 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f8694-d2a9-4538-b4d9-9716ba163881 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:13.518579 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f8694-d2a9-4538-b4d9-9716ba163881 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:13.523199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552500-bead-4eb0-9c50-04685a84c4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:13.524105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552500-bead-4eb0-9c50-04685a84c4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:13.524390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552500-bead-4eb0-9c50-04685a84c4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:13.524667 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552500-bead-4eb0-9c50-04685a84c4f2 admin admin] PATH_INFO: `/v3/projects/5d7de9a66a494145aea9b92bef988870/users/6d5d3c4607934edfa2dcbf019ee0a411/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:13.539237 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4552500-bead-4eb0-9c50-04685a84c4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7de9a66a494145aea9b92bef988870, user_id=6d5d3c4607934edfa2dcbf019ee0a411, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:13.542046 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4552500-bead-4eb0-9c50-04685a84c4f2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:13.613511 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1450/2857] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:31:13 2022] PUT /identity/v3/projects/5d7de9a66a494145aea9b92bef988870/users/6d5d3c4607934edfa2dcbf019ee0a411/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:13.623959 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450ac51-311a-4893-aa8b-3ba84ff6ba9e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:13.624291 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450ac51-311a-4893-aa8b-3ba84ff6ba9e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:13.624625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450ac51-311a-4893-aa8b-3ba84ff6ba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:13.652535 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9450ac51-311a-4893-aa8b-3ba84ff6ba9e None None] MFA Rules not processed for user `6d5d3c4607934edfa2dcbf019ee0a411`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:31:13.653756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9450ac51-311a-4893-aa8b-3ba84ff6ba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:13.722066 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1408/2858] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:31:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:31:13.732708 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552500-bead-4eb0-9c50-04685a84c4f2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:13.734478 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c4552500-bead-4eb0-9c50-04685a84c4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:13.791844 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552500-bead-4eb0-9c50-04685a84c4f2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:13.796157 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508c9d3-c0b2-4340-a3a6-c42ffdcaaeba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397a66eb12254a65bf05bc9fff9a868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:13.796806 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508c9d3-c0b2-4340-a3a6-c42ffdcaaeba service glance] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:13.797095 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508c9d3-c0b2-4340-a3a6-c42ffdcaaeba service glance] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:13.797368 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508c9d3-c0b2-4340-a3a6-c42ffdcaaeba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:13.805880 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508c9d3-c0b2-4340-a3a6-c42ffdcaaeba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:13.807305 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508c9d3-c0b2-4340-a3a6-c42ffdcaaeba service glance] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:13.818311 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1451/2859] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:31:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:31:15.443645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f2ae4-c6d1-4f07-987c-088ce8854ce8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:15.444211 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f2ae4-c6d1-4f07-987c-088ce8854ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:15.444211 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f2ae4-c6d1-4f07-987c-088ce8854ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:15.462495 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6b0f2ae4-c6d1-4f07-987c-088ce8854ce8 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:31:15.463747 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6b0f2ae4-c6d1-4f07-987c-088ce8854ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:15.522902 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1409/2860] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jul 14 10:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:31:15.544225 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508c9d3-c0b2-4340-a3a6-c42ffdcaaeba service glance] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:15.547191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f508c9d3-c0b2-4340-a3a6-c42ffdcaaeba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:15.620246 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508c9d3-c0b2-4340-a3a6-c42ffdcaaeba service glance] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:15.628691 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95ea8b-1246-4f81-8a7b-e97471ac49b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:15.629369 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95ea8b-1246-4f81-8a7b-e97471ac49b6 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:15.629655 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95ea8b-1246-4f81-8a7b-e97471ac49b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:15.629934 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95ea8b-1246-4f81-8a7b-e97471ac49b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:15.639133 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95ea8b-1246-4f81-8a7b-e97471ac49b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:15.640813 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95ea8b-1246-4f81-8a7b-e97471ac49b6 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:15.650385 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1452/2861] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:31:18.333139 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af81b3-8333-44de-a7c1-bbf1ef5f2261 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:18.333639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af81b3-8333-44de-a7c1-bbf1ef5f2261 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:18.333639 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af81b3-8333-44de-a7c1-bbf1ef5f2261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:18.351692 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e1af81b3-8333-44de-a7c1-bbf1ef5f2261 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:31:18.352924 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e1af81b3-8333-44de-a7c1-bbf1ef5f2261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:18.361286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1410/2862] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jul 14 10:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:31:18.384700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95ea8b-1246-4f81-8a7b-e97471ac49b6 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:18.386100 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1c95ea8b-1246-4f81-8a7b-e97471ac49b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:18.401049 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95ea8b-1246-4f81-8a7b-e97471ac49b6 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:18.406615 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f41df-7f87-40fc-883d-6f578c2a686c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:18.407261 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f41df-7f87-40fc-883d-6f578c2a686c service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:18.407542 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f41df-7f87-40fc-883d-6f578c2a686c service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:18.407815 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f41df-7f87-40fc-883d-6f578c2a686c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:18.416697 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f41df-7f87-40fc-883d-6f578c2a686c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:18.418293 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f41df-7f87-40fc-883d-6f578c2a686c service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:18.428120 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1453/2863] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:31:21.564483 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4ca7-b8eb-448f-85b8-698a7290aaaa None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:21.564996 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4ca7-b8eb-448f-85b8-698a7290aaaa None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:21.565096 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4ca7-b8eb-448f-85b8-698a7290aaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:21.582699 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-96dd4ca7-b8eb-448f-85b8-698a7290aaaa None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:31:21.583934 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-96dd4ca7-b8eb-448f-85b8-698a7290aaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:21.591837 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1411/2864] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jul 14 10:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:31:21.618747 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f41df-7f87-40fc-883d-6f578c2a686c service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:21.625219 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:21.631259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f41df-7f87-40fc-883d-6f578c2a686c service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:21.637002 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42455dc-9053-4fed-9749-139147966d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:21.637665 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42455dc-9053-4fed-9749-139147966d69 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:21.637965 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42455dc-9053-4fed-9749-139147966d69 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:21.638315 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42455dc-9053-4fed-9749-139147966d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:21.647179 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42455dc-9053-4fed-9749-139147966d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:21.648788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42455dc-9053-4fed-9749-139147966d69 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:21.658410 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1454/2865] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:31:24.850261 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1ceee-60ba-4da1-81f3-912bf92fe299 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:24.850756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1ceee-60ba-4da1-81f3-912bf92fe299 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:24.850756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1ceee-60ba-4da1-81f3-912bf92fe299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:24.869352 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-bbc1ceee-60ba-4da1-81f3-912bf92fe299 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:31:24.870635 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bbc1ceee-60ba-4da1-81f3-912bf92fe299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:24.880373 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1412/2866] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jul 14 10:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:31:24.902657 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42455dc-9053-4fed-9749-139147966d69 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:24.915203 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42455dc-9053-4fed-9749-139147966d69 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:24.921238 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d622c1-26b2-4632-8f8b-d9c8cd29a804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:24.921901 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d622c1-26b2-4632-8f8b-d9c8cd29a804 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:24.922191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d622c1-26b2-4632-8f8b-d9c8cd29a804 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:24.922469 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d622c1-26b2-4632-8f8b-d9c8cd29a804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:24.931366 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d622c1-26b2-4632-8f8b-d9c8cd29a804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:24.933070 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d622c1-26b2-4632-8f8b-d9c8cd29a804 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:24.944624 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1455/2867] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:31:34.864013 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:34.939318 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=11 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:35.431530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1ceee-60ba-4da1-81f3-912bf92fe299 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:35.432978 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bbc1ceee-60ba-4da1-81f3-912bf92fe299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:35.526435 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1ceee-60ba-4da1-81f3-912bf92fe299 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:35.533028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a06076-382a-449f-97b3-310e6432988e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784d36c16d343cc961a22d956ee30f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:35.533028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a06076-382a-449f-97b3-310e6432988e service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:35.533028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a06076-382a-449f-97b3-310e6432988e service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:35.533028 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a06076-382a-449f-97b3-310e6432988e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:35.534630 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-29a06076-382a-449f-97b3-310e6432988e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:35.546599 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a06076-382a-449f-97b3-310e6432988e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:35.548158 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a06076-382a-449f-97b3-310e6432988e service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:35.558182 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1413/2868] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:31:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:31:40.419446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d622c1-26b2-4632-8f8b-d9c8cd29a804 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:40.429846 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d622c1-26b2-4632-8f8b-d9c8cd29a804 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:40.434973 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dfe7d-5009-4f89-b211-2774ccaeae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:40.435833 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dfe7d-5009-4f89-b211-2774ccaeae94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:40.436165 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dfe7d-5009-4f89-b211-2774ccaeae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:40.436444 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dfe7d-5009-4f89-b211-2774ccaeae94 admin admin] PATH_INFO: `/v3/users/6d5d3c4607934edfa2dcbf019ee0a411` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:40.437655 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dfe7d-5009-4f89-b211-2774ccaeae94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d5d3c4607934edfa2dcbf019ee0a411)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:40.440259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dfe7d-5009-4f89-b211-2774ccaeae94 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:40.643185 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a85dfe7d-5009-4f89-b211-2774ccaeae94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d5d3c4607934edfa2dcbf019ee0a411'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:40.655742 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a85dfe7d-5009-4f89-b211-2774ccaeae94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d5d3c4607934edfa2dcbf019ee0a411'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:40.718826 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a85dfe7d-5009-4f89-b211-2774ccaeae94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d5d3c4607934edfa2dcbf019ee0a411'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:40.719466 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a85dfe7d-5009-4f89-b211-2774ccaeae94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d5d3c4607934edfa2dcbf019ee0a411'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:40.726975 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a85dfe7d-5009-4f89-b211-2774ccaeae94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d5d3c4607934edfa2dcbf019ee0a411'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:40.733061 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1456/2869] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:31:40 2022] DELETE /identity/v3/users/6d5d3c4607934edfa2dcbf019ee0a411 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:40.737623 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceff60-29ac-41f1-bc6e-ea9af22e8849 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:40.738088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceff60-29ac-41f1-bc6e-ea9af22e8849 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:40.738207 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceff60-29ac-41f1-bc6e-ea9af22e8849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:40.756088 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-74ceff60-29ac-41f1-bc6e-ea9af22e8849 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:31:40.757313 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-74ceff60-29ac-41f1-bc6e-ea9af22e8849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:40.818613 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1414/2870] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:31:40.828583 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dfe7d-5009-4f89-b211-2774ccaeae94 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:40.830572 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a85dfe7d-5009-4f89-b211-2774ccaeae94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:40.888723 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dfe7d-5009-4f89-b211-2774ccaeae94 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:40.893052 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a7b29-f124-4295-8bd4-1f425a3cf5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:40.893700 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a7b29-f124-4295-8bd4-1f425a3cf5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:40.893987 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a7b29-f124-4295-8bd4-1f425a3cf5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:40.894263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a7b29-f124-4295-8bd4-1f425a3cf5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:40.903378 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a7b29-f124-4295-8bd4-1f425a3cf5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:40.904823 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a7b29-f124-4295-8bd4-1f425a3cf5d8 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:40.914373 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1457/2871] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:31:41.303529 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceff60-29ac-41f1-bc6e-ea9af22e8849 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:41.304773 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-74ceff60-29ac-41f1-bc6e-ea9af22e8849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:41.317019 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceff60-29ac-41f1-bc6e-ea9af22e8849 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:41.321785 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:41.322727 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:41.323075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:41.323414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] PATH_INFO: `/v3/projects/5d7de9a66a494145aea9b92bef988870` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:41.324628 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7de9a66a494145aea9b92bef988870)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:41.326526 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:41.439102 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7de9a66a494145aea9b92bef988870', 'request_id': 'req-e41355df-4425-4680-a61e-7e21491dc1a2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:41.530205 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7de9a66a494145aea9b92bef988870', 'request_id': 'req-e41355df-4425-4680-a61e-7e21491dc1a2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:41.536384 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7de9a66a494145aea9b92bef988870', 'request_id': 'req-e41355df-4425-4680-a61e-7e21491dc1a2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:41.537487 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:41.547944 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] The token cache is being invalidate because project 5d7de9a66a494145aea9b92bef988870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:31:41.548269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:41.548927 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:41.550476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1415/2872] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:31:41 2022] DELETE /identity/v3/projects/5d7de9a66a494145aea9b92bef988870 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:50.910123 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:51.667344 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:57.267603 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a7b29-f124-4295-8bd4-1f425a3cf5d8 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:57.269214 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-af6a7b29-f124-4295-8bd4-1f425a3cf5d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:57.283875 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a7b29-f124-4295-8bd4-1f425a3cf5d8 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:57.339326 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526864c3-8f44-4909-939d-154f9947b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:57.340229 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526864c3-8f44-4909-939d-154f9947b925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:57.340513 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526864c3-8f44-4909-939d-154f9947b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:57.340788 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526864c3-8f44-4909-939d-154f9947b925 admin admin] PATH_INFO: `/v3/users/594b7245d5e7439db9f1e7d117e0586a` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:57.341984 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526864c3-8f44-4909-939d-154f9947b925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=594b7245d5e7439db9f1e7d117e0586a)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:57.343893 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526864c3-8f44-4909-939d-154f9947b925 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:57.519037 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-526864c3-8f44-4909-939d-154f9947b925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '594b7245d5e7439db9f1e7d117e0586a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:57.530678 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-526864c3-8f44-4909-939d-154f9947b925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '594b7245d5e7439db9f1e7d117e0586a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:57.602482 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-526864c3-8f44-4909-939d-154f9947b925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '594b7245d5e7439db9f1e7d117e0586a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:57.603113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-526864c3-8f44-4909-939d-154f9947b925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '594b7245d5e7439db9f1e7d117e0586a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:57.610247 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-526864c3-8f44-4909-939d-154f9947b925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '594b7245d5e7439db9f1e7d117e0586a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:57.616736 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1458/2873] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:31:57 2022] DELETE /identity/v3/users/594b7245d5e7439db9f1e7d117e0586a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:57.856845 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:57.858421 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:57.874898 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41355df-4425-4680-a61e-7e21491dc1a2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:57.933328 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e257daa-ee37-417a-9bb3-5ba2e909ca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:57.934204 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e257daa-ee37-417a-9bb3-5ba2e909ca85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:57.934478 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e257daa-ee37-417a-9bb3-5ba2e909ca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:57.934756 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e257daa-ee37-417a-9bb3-5ba2e909ca85 admin admin] PATH_INFO: `/v3/projects/96528d56cafa4de5aa4e6d4ddc77c1b8` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:57.935979 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e257daa-ee37-417a-9bb3-5ba2e909ca85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96528d56cafa4de5aa4e6d4ddc77c1b8)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:57.937986 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e257daa-ee37-417a-9bb3-5ba2e909ca85 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:58.059817 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8e257daa-ee37-417a-9bb3-5ba2e909ca85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96528d56cafa4de5aa4e6d4ddc77c1b8', 'request_id': 'req-8e257daa-ee37-417a-9bb3-5ba2e909ca85'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:58.163649 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8e257daa-ee37-417a-9bb3-5ba2e909ca85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96528d56cafa4de5aa4e6d4ddc77c1b8', 'request_id': 'req-8e257daa-ee37-417a-9bb3-5ba2e909ca85'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:58.169681 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8e257daa-ee37-417a-9bb3-5ba2e909ca85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96528d56cafa4de5aa4e6d4ddc77c1b8', 'request_id': 'req-8e257daa-ee37-417a-9bb3-5ba2e909ca85'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:58.180856 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8e257daa-ee37-417a-9bb3-5ba2e909ca85 admin admin] The token cache is being invalidate because project 96528d56cafa4de5aa4e6d4ddc77c1b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:31:58.181143 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8e257daa-ee37-417a-9bb3-5ba2e909ca85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:58.181774 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8e257daa-ee37-417a-9bb3-5ba2e909ca85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:31:58.183592 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1416/2874] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:31:57 2022] DELETE /identity/v3/projects/96528d56cafa4de5aa4e6d4ddc77c1b8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:58.188625 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19398dc3-a828-457c-a5ed-419e293408f4 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:58.188916 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19398dc3-a828-457c-a5ed-419e293408f4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:58.189196 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19398dc3-a828-457c-a5ed-419e293408f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:58.206504 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-19398dc3-a828-457c-a5ed-419e293408f4 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:31:58.207708 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-19398dc3-a828-457c-a5ed-419e293408f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:58.266401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1459/2875] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:31:58.274930 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49f38-d727-49c8-b228-de82cbba12f7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:58.275220 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49f38-d727-49c8-b228-de82cbba12f7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:58.275496 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49f38-d727-49c8-b228-de82cbba12f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:58.293864 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f3f49f38-d727-49c8-b228-de82cbba12f7 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:31:58.295081 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f3f49f38-d727-49c8-b228-de82cbba12f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:58.303003 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1417/2876] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:31:58.307111 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19398dc3-a828-457c-a5ed-419e293408f4 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:58.316890 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19398dc3-a828-457c-a5ed-419e293408f4 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:58.321459 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5c77f-7431-4c0e-b8dd-061dbc9d75ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:58.322092 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5c77f-7431-4c0e-b8dd-061dbc9d75ee admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:58.322372 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5c77f-7431-4c0e-b8dd-061dbc9d75ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:58.322640 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5c77f-7431-4c0e-b8dd-061dbc9d75ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:58.323351 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5c77f-7431-4c0e-b8dd-061dbc9d75ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:31:58.323649 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5c77f-7431-4c0e-b8dd-061dbc9d75ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:58.325287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5c77f-7431-4c0e-b8dd-061dbc9d75ee admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:58.337069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1460/2877] 10.222.0.74 () {58 vars in 1152 bytes} [Thu Jul 14 10:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:31:58.341093 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f49f38-d727-49c8-b228-de82cbba12f7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:58.350021 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f49f38-d727-49c8-b228-de82cbba12f7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:58.355223 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0272b48-83ac-45b8-b19e-fe2ed404a8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:58.355858 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272b48-83ac-45b8-b19e-fe2ed404a8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:58.356169 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272b48-83ac-45b8-b19e-fe2ed404a8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:58.356460 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272b48-83ac-45b8-b19e-fe2ed404a8a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:58.357125 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0272b48-83ac-45b8-b19e-fe2ed404a8a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:58.358991 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0272b48-83ac-45b8-b19e-fe2ed404a8a9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:58.462231 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1418/2878] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:31:58 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:31:58.466520 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5c77f-7431-4c0e-b8dd-061dbc9d75ee admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:58.476583 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5c77f-7431-4c0e-b8dd-061dbc9d75ee admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:58.480199 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:58.531452 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b0d4f-6167-4143-b7a4-f63d71cbdab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:58.532154 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b0d4f-6167-4143-b7a4-f63d71cbdab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:58.532434 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b0d4f-6167-4143-b7a4-f63d71cbdab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:58.532704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b0d4f-6167-4143-b7a4-f63d71cbdab7 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:58.533386 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b0d4f-6167-4143-b7a4-f63d71cbdab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:58.535268 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b0d4f-6167-4143-b7a4-f63d71cbdab7 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:58.654541 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1461/2879] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:31:58 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:31:58.658674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0272b48-83ac-45b8-b19e-fe2ed404a8a9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:58.668999 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0272b48-83ac-45b8-b19e-fe2ed404a8a9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:58.673723 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf640e-7895-49b6-b1b3-34dc29c5d85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:58.674379 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf640e-7895-49b6-b1b3-34dc29c5d85f admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:58.674669 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf640e-7895-49b6-b1b3-34dc29c5d85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:58.674934 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf640e-7895-49b6-b1b3-34dc29c5d85f admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:58.675734 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf640e-7895-49b6-b1b3-34dc29c5d85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:58.677364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf640e-7895-49b6-b1b3-34dc29c5d85f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:58.688144 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1419/2880] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:31:58.692082 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b0d4f-6167-4143-b7a4-f63d71cbdab7 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:58.702482 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b0d4f-6167-4143-b7a4-f63d71cbdab7 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:58.707190 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fc910-6e1f-4119-beca-69a2e3000822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:58.707851 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fc910-6e1f-4119-beca-69a2e3000822 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:58.708170 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fc910-6e1f-4119-beca-69a2e3000822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:58.708445 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fc910-6e1f-4119-beca-69a2e3000822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:58.709174 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1fc910-6e1f-4119-beca-69a2e3000822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:58.711432 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1fc910-6e1f-4119-beca-69a2e3000822 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:58.721263 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1462/2881] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:31:58.725472 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf640e-7895-49b6-b1b3-34dc29c5d85f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:58.735542 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf640e-7895-49b6-b1b3-34dc29c5d85f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:58.740113 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c60a9-0a1c-4220-a0dd-55c1666a2a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:58.743758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c60a9-0a1c-4220-a0dd-55c1666a2a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:58.743758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c60a9-0a1c-4220-a0dd-55c1666a2a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:58.743758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c60a9-0a1c-4220-a0dd-55c1666a2a95 admin admin] PATH_INFO: `/v3/projects/008739753cb64146892e773be7069063/users/d6f7ce415104439dada2bdeced0658a1/roles/d47bb3db22444385b7884acbc7e21b0f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:58.757055 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c60a9-0a1c-4220-a0dd-55c1666a2a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=008739753cb64146892e773be7069063, user_id=d6f7ce415104439dada2bdeced0658a1, role_id=d47bb3db22444385b7884acbc7e21b0f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:58.759688 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c60a9-0a1c-4220-a0dd-55c1666a2a95 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:58.814364 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1420/2882] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:31:58 2022] PUT /identity/v3/projects/008739753cb64146892e773be7069063/users/d6f7ce415104439dada2bdeced0658a1/roles/d47bb3db22444385b7884acbc7e21b0f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:31:58.819600 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c1a67-69bb-4fd5-ac83-e3c453b631a9 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:58.819920 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c1a67-69bb-4fd5-ac83-e3c453b631a9 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:58.820206 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c1a67-69bb-4fd5-ac83-e3c453b631a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:58.838191 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e82c1a67-69bb-4fd5-ac83-e3c453b631a9 None None] MFA Rules not processed for user `6a85b2f060664557b1c1e38cb4a7b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:31:58.842964 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e82c1a67-69bb-4fd5-ac83-e3c453b631a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:58.897582 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1463/2883] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:31:58.907386 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c60a9-0a1c-4220-a0dd-55c1666a2a95 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:31:58.909188 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-965c60a9-0a1c-4220-a0dd-55c1666a2a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:31:58.940114 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:31:58.966263 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c60a9-0a1c-4220-a0dd-55c1666a2a95 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:31:58.970435 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a910b7e-8d4d-40d3-af0f-d2352cf06823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:31:58.971077 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a910b7e-8d4d-40d3-af0f-d2352cf06823 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:31:58.971410 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a910b7e-8d4d-40d3-af0f-d2352cf06823 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:31:58.971633 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a910b7e-8d4d-40d3-af0f-d2352cf06823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:31:58.981571 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a910b7e-8d4d-40d3-af0f-d2352cf06823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:31:58.982980 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a910b7e-8d4d-40d3-af0f-d2352cf06823 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:31:58.993181 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1421/2884] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:31:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:32:04.263228 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca343c59-375a-4a84-90aa-7cc3657a58ab None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:32:04.263759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca343c59-375a-4a84-90aa-7cc3657a58ab None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:32:04.263759 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca343c59-375a-4a84-90aa-7cc3657a58ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:32:04.294390 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ca343c59-375a-4a84-90aa-7cc3657a58ab None None] MFA Rules not processed for user `d6f7ce415104439dada2bdeced0658a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:32:04.297661 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ca343c59-375a-4a84-90aa-7cc3657a58ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:32:04.372472 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1464/2885] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:32:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:32:04.373884 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a910b7e-8d4d-40d3-af0f-d2352cf06823 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:32:04.384337 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a910b7e-8d4d-40d3-af0f-d2352cf06823 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:32:04.389128 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3c949-3b4c-492d-b5c3-8e6ae262898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:32:04.389887 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c949-3b4c-492d-b5c3-8e6ae262898e admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:32:04.390153 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c949-3b4c-492d-b5c3-8e6ae262898e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:32:04.390431 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c949-3b4c-492d-b5c3-8e6ae262898e admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:32:04.391120 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3c949-3b4c-492d-b5c3-8e6ae262898e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:32:04.393190 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3c949-3b4c-492d-b5c3-8e6ae262898e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:32:04.461905 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1422/2886] 10.222.0.74 () {60 vars in 1152 bytes} [Thu Jul 14 10:32:04 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:32:04.466097 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca343c59-375a-4a84-90aa-7cc3657a58ab None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:32:04.476892 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca343c59-375a-4a84-90aa-7cc3657a58ab None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:32:04.488189 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:32:04.532933 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ff6b1-1e99-4c81-96b1-a3510a33404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:32:04.533627 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ff6b1-1e99-4c81-96b1-a3510a33404e admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:32:04.533902 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ff6b1-1e99-4c81-96b1-a3510a33404e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:32:04.534182 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ff6b1-1e99-4c81-96b1-a3510a33404e admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:32:04.534866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ff6b1-1e99-4c81-96b1-a3510a33404e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:32:04.536958 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ff6b1-1e99-4c81-96b1-a3510a33404e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:32:04.654979 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1465/2887] 10.222.0.74 () {60 vars in 1143 bytes} [Thu Jul 14 10:32:04 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:32:04.658956 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3c949-3b4c-492d-b5c3-8e6ae262898e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:32:04.669658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3c949-3b4c-492d-b5c3-8e6ae262898e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:32:04.674754 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816acf95-7a96-4442-bfa8-93ff33b08cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:32:04.674892 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816acf95-7a96-4442-bfa8-93ff33b08cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:32:04.675160 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816acf95-7a96-4442-bfa8-93ff33b08cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:32:04.675440 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816acf95-7a96-4442-bfa8-93ff33b08cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:32:04.676203 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816acf95-7a96-4442-bfa8-93ff33b08cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:32:04.677797 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816acf95-7a96-4442-bfa8-93ff33b08cf4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:32:04.688490 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1423/2888] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:32:04.692607 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ff6b1-1e99-4c81-96b1-a3510a33404e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:32:04.703188 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ff6b1-1e99-4c81-96b1-a3510a33404e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:32:04.707855 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782309e9-7547-4baf-bed6-e8e72a0e5d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:32:04.708794 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782309e9-7547-4baf-bed6-e8e72a0e5d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:32:04.709670 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782309e9-7547-4baf-bed6-e8e72a0e5d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:32:04.709953 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782309e9-7547-4baf-bed6-e8e72a0e5d6e admin admin] PATH_INFO: `/v3/projects/bc4bb7fe96c7410eb53e8463c1594192/users/ffcb097d99a842898d80038a0c9a7758/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:32:04.724451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782309e9-7547-4baf-bed6-e8e72a0e5d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4bb7fe96c7410eb53e8463c1594192, user_id=ffcb097d99a842898d80038a0c9a7758, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:32:04.727115 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782309e9-7547-4baf-bed6-e8e72a0e5d6e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:32:04.798131 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1466/2889] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:32:04 2022] PUT /identity/v3/projects/bc4bb7fe96c7410eb53e8463c1594192/users/ffcb097d99a842898d80038a0c9a7758/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:32:04.802135 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816acf95-7a96-4442-bfa8-93ff33b08cf4 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:32:04.812860 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816acf95-7a96-4442-bfa8-93ff33b08cf4 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:32:04.869085 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd00229-17d8-470e-92a3-54b882a302b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:32:04.869765 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd00229-17d8-470e-92a3-54b882a302b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:32:04.870049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd00229-17d8-470e-92a3-54b882a302b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:32:04.870326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd00229-17d8-470e-92a3-54b882a302b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:32:04.871210 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd00229-17d8-470e-92a3-54b882a302b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:32:04.872844 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd00229-17d8-470e-92a3-54b882a302b7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:32:04.883414 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1424/2890] 10.222.0.74 () {58 vars in 1121 bytes} [Thu Jul 14 10:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:32:04.887604 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782309e9-7547-4baf-bed6-e8e72a0e5d6e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:32:04.898313 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782309e9-7547-4baf-bed6-e8e72a0e5d6e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:32:04.902954 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4280362-ced8-4b7b-9928-f94fdf3bb64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:32:04.903818 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4280362-ced8-4b7b-9928-f94fdf3bb64d admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:32:04.904128 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4280362-ced8-4b7b-9928-f94fdf3bb64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:32:04.904401 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4280362-ced8-4b7b-9928-f94fdf3bb64d admin admin] PATH_INFO: `/v3/projects/bc4bb7fe96c7410eb53e8463c1594192/users/ffcb097d99a842898d80038a0c9a7758/roles/7115f1ae20554afab761f71a2c30ba8d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:32:04.906399 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4280362-ced8-4b7b-9928-f94fdf3bb64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4bb7fe96c7410eb53e8463c1594192, user_id=ffcb097d99a842898d80038a0c9a7758, role_id=7115f1ae20554afab761f71a2c30ba8d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:32:04.909069 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4280362-ced8-4b7b-9928-f94fdf3bb64d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:32:04.921652 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1467/2891] 10.222.0.74 () {60 vars in 1482 bytes} [Thu Jul 14 10:32:04 2022] PUT /identity/v3/projects/bc4bb7fe96c7410eb53e8463c1594192/users/ffcb097d99a842898d80038a0c9a7758/roles/7115f1ae20554afab761f71a2c30ba8d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:32:10.288862 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6c59-1f0c-487d-aa2d-d64b1efc4b34 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:32:10.289352 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6c59-1f0c-487d-aa2d-d64b1efc4b34 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:32:10.289440 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6c59-1f0c-487d-aa2d-d64b1efc4b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:32:10.319674 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5ffe6c59-1f0c-487d-aa2d-d64b1efc4b34 None None] MFA Rules not processed for user `ffcb097d99a842898d80038a0c9a7758`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:32:10.320950 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5ffe6c59-1f0c-487d-aa2d-d64b1efc4b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:32:10.393918 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1425/2892] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:32:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:32:10.409341 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4280362-ced8-4b7b-9928-f94fdf3bb64d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:32:10.412863 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d4280362-ced8-4b7b-9928-f94fdf3bb64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:32:10.487160 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4280362-ced8-4b7b-9928-f94fdf3bb64d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:32:10.493460 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deb843-34a8-4dd8-8e34-056c9c653a26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:32:10.494113 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb843-34a8-4dd8-8e34-056c9c653a26 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:32:10.494395 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb843-34a8-4dd8-8e34-056c9c653a26 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:32:10.494672 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb843-34a8-4dd8-8e34-056c9c653a26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:32:10.555527 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26deb843-34a8-4dd8-8e34-056c9c653a26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:32:10.557492 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26deb843-34a8-4dd8-8e34-056c9c653a26 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:32:10.566647 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1468/2893] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:32:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:32:13.170151 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4d68-9222-416e-92cf-267b5c04607f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:32:13.170658 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4d68-9222-416e-92cf-267b5c04607f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:32:13.170926 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4d68-9222-416e-92cf-267b5c04607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:32:13.189651 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3c2f4d68-9222-416e-92cf-267b5c04607f None None] MFA Rules not processed for user `d6f7ce415104439dada2bdeced0658a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:32:13.190870 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3c2f4d68-9222-416e-92cf-267b5c04607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:32:13.198642 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1426/2894] 10.222.0.74 () {58 vars in 957 bytes} [Thu Jul 14 10:32:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:32:20.562510 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:32:23.184176 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:32:26.802025 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deb843-34a8-4dd8-8e34-056c9c653a26 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:32:26.803442 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-26deb843-34a8-4dd8-8e34-056c9c653a26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:32:26.862083 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deb843-34a8-4dd8-8e34-056c9c653a26 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:32:26.865734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439616b3-09f5-4cbe-8d20-7f075a766809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:32:26.866378 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439616b3-09f5-4cbe-8d20-7f075a766809 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:32:26.866666 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439616b3-09f5-4cbe-8d20-7f075a766809 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:32:26.866950 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439616b3-09f5-4cbe-8d20-7f075a766809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:32:26.869304 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-439616b3-09f5-4cbe-8d20-7f075a766809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:32:26.878579 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439616b3-09f5-4cbe-8d20-7f075a766809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:32:26.880027 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439616b3-09f5-4cbe-8d20-7f075a766809 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:32:26.887874 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1469/2895] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:32:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:32:36.885358 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=26 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:32:39.610134 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f4d68-9222-416e-92cf-267b5c04607f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:32:39.620103 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f4d68-9222-416e-92cf-267b5c04607f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:32:39.623620 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95275c-80eb-46dc-8871-f888c0da4735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:32:39.624286 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95275c-80eb-46dc-8871-f888c0da4735 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:32:39.624588 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95275c-80eb-46dc-8871-f888c0da4735 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:32:39.624844 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95275c-80eb-46dc-8871-f888c0da4735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:32:39.633989 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95275c-80eb-46dc-8871-f888c0da4735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:32:39.635939 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95275c-80eb-46dc-8871-f888c0da4735 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:32:39.645578 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1427/2896] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:32:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:32:49.641303 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=6 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:33:54.879000 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439616b3-09f5-4cbe-8d20-7f075a766809 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:33:54.888388 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439616b3-09f5-4cbe-8d20-7f075a766809 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:33:54.892379 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c999952-3212-4233-9cf2-2ea89ad0aa7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:33:54.893012 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c999952-3212-4233-9cf2-2ea89ad0aa7e service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:33:54.893292 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c999952-3212-4233-9cf2-2ea89ad0aa7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:33:54.893560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c999952-3212-4233-9cf2-2ea89ad0aa7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:33:54.895287 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9c999952-3212-4233-9cf2-2ea89ad0aa7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:33:54.904866 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c999952-3212-4233-9cf2-2ea89ad0aa7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:33:54.906274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c999952-3212-4233-9cf2-2ea89ad0aa7e service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:33:54.914429 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1470/2897] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:33:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:34:04.910727 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=6 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:34:36.349168 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95275c-80eb-46dc-8871-f888c0da4735 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:34:36.358678 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95275c-80eb-46dc-8871-f888c0da4735 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:34:36.362292 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae264c-dbab-4930-8385-65ddfa11e033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:34:36.362972 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae264c-dbab-4930-8385-65ddfa11e033 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:34:36.363258 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae264c-dbab-4930-8385-65ddfa11e033 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:34:36.363536 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae264c-dbab-4930-8385-65ddfa11e033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:34:36.365455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-94ae264c-dbab-4930-8385-65ddfa11e033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:34:36.380877 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae264c-dbab-4930-8385-65ddfa11e033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:34:36.382298 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae264c-dbab-4930-8385-65ddfa11e033 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:34:36.395227 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1428/2898] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:34:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:34:37.566008 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c999952-3212-4233-9cf2-2ea89ad0aa7e service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:34:37.575259 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c999952-3212-4233-9cf2-2ea89ad0aa7e service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:34:37.578919 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0851-9af0-45a5-aaa3-0406e308a3e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:34:37.579554 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0851-9af0-45a5-aaa3-0406e308a3e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:34:37.579836 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0851-9af0-45a5-aaa3-0406e308a3e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:34:37.580148 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0851-9af0-45a5-aaa3-0406e308a3e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:34:37.581918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-333c0851-9af0-45a5-aaa3-0406e308a3e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:34:37.595105 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c0851-9af0-45a5-aaa3-0406e308a3e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:34:37.596563 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c0851-9af0-45a5-aaa3-0406e308a3e1 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:34:37.607423 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1471/2899] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:34:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:34:46.389534 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=6 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:34:47.602506 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=6 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:34:50.891438 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4edde8-0c38-46ce-a562-53e324e27670 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:34:50.892159 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4edde8-0c38-46ce-a562-53e324e27670 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:34:50.892159 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4edde8-0c38-46ce-a562-53e324e27670 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:34:50.893486 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1429/2900] 10.222.0.74 () {54 vars in 921 bytes} [Thu Jul 14 10:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:34:50.899812 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d90f3-490c-4716-ad54-003bcce2c6d6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:34:50.900308 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d90f3-490c-4716-ad54-003bcce2c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:34:50.900516 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d90f3-490c-4716-ad54-003bcce2c6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:34:50.948402 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e17d90f3-490c-4716-ad54-003bcce2c6d6 None None] MFA Rules not processed for user `bf41e7a4968e4ab9bce98f6e1c050b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:34:50.949633 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e17d90f3-490c-4716-ad54-003bcce2c6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:34:50.956758 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1472/2901] 10.222.0.74 () {58 vars in 1018 bytes} [Thu Jul 14 10:34:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:34:50.969777 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4edde8-0c38-46ce-a562-53e324e27670 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:34:50.982487 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4edde8-0c38-46ce-a562-53e324e27670 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:34:50.986045 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f9892-d499-4c92-8ed3-68dea6948253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:34:50.986682 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f9892-d499-4c92-8ed3-68dea6948253 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:34:50.986971 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f9892-d499-4c92-8ed3-68dea6948253 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:34:50.987247 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f9892-d499-4c92-8ed3-68dea6948253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:34:50.994301 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f9892-d499-4c92-8ed3-68dea6948253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:34:50.995713 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f9892-d499-4c92-8ed3-68dea6948253 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:34:51.003455 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1430/2902] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:34:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:34:51.086488 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5824b-b9b5-4282-aa06-ad1190ba81bc None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:34:51.086778 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5824b-b9b5-4282-aa06-ad1190ba81bc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:34:51.087072 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5824b-b9b5-4282-aa06-ad1190ba81bc None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:34:51.088490 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1473/2903] 10.222.0.74 () {54 vars in 921 bytes} [Thu Jul 14 10:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:34:51.093753 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58e3b7-f6c8-404d-9954-5f14e65f1172 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:34:51.094039 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58e3b7-f6c8-404d-9954-5f14e65f1172 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:34:51.094312 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58e3b7-f6c8-404d-9954-5f14e65f1172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:34:51.129444 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ff58e3b7-f6c8-404d-9954-5f14e65f1172 None None] MFA Rules not processed for user `2a0626754b40449ba2346d05c5c90a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:34:51.130645 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ff58e3b7-f6c8-404d-9954-5f14e65f1172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:34:51.139928 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1431/2904] 10.222.0.74 () {58 vars in 1018 bytes} [Thu Jul 14 10:34:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:34:51.150704 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5824b-b9b5-4282-aa06-ad1190ba81bc None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:34:51.161451 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5824b-b9b5-4282-aa06-ad1190ba81bc None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:34:51.165584 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff1796-76ed-4e04-9545-8bf707478371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf41e7a4968e4ab9bce98f6e1c050b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:34:51.166209 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff1796-76ed-4e04-9545-8bf707478371 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:34:51.166734 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff1796-76ed-4e04-9545-8bf707478371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:34:51.167014 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff1796-76ed-4e04-9545-8bf707478371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:34:51.176872 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff1796-76ed-4e04-9545-8bf707478371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:34:51.178280 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff1796-76ed-4e04-9545-8bf707478371 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:34:51.188686 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1474/2905] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:34:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:34:51.251741 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58e3b7-f6c8-404d-9954-5f14e65f1172 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:34:51.253178 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ff58e3b7-f6c8-404d-9954-5f14e65f1172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:34:51.320908 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58e3b7-f6c8-404d-9954-5f14e65f1172 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:34:51.325965 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419e1a4-e273-4423-ade1-26bb341556c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784d36c16d343cc961a22d956ee30f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:34:51.326610 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e1a4-e273-4423-ade1-26bb341556c2 service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:34:51.326891 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e1a4-e273-4423-ade1-26bb341556c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:34:51.327166 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e1a4-e273-4423-ade1-26bb341556c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:34:51.328981 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e419e1a4-e273-4423-ade1-26bb341556c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:34:51.340967 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419e1a4-e273-4423-ade1-26bb341556c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:34:51.342530 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419e1a4-e273-4423-ade1-26bb341556c2 service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:34:51.352534 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1432/2906] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:34:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:34:53.051610 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff1796-76ed-4e04-9545-8bf707478371 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:34:53.064702 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff1796-76ed-4e04-9545-8bf707478371 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:34:53.070300 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577679c-131c-4252-bc2e-2e9ca51b252d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:34:53.077406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577679c-131c-4252-bc2e-2e9ca51b252d service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:34:53.077406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577679c-131c-4252-bc2e-2e9ca51b252d service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:34:53.077406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577679c-131c-4252-bc2e-2e9ca51b252d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:34:53.077406 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7577679c-131c-4252-bc2e-2e9ca51b252d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:34:53.085970 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577679c-131c-4252-bc2e-2e9ca51b252d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:34:53.087556 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577679c-131c-4252-bc2e-2e9ca51b252d service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:34:53.098144 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1475/2907] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:34:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:35:01.348326 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=47 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:35:03.093533 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=25 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:36:13.374864 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419e1a4-e273-4423-ade1-26bb341556c2 service placement] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:36:13.386935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419e1a4-e273-4423-ade1-26bb341556c2 service placement] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:36:13.392998 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c129b9-962a-4da8-925d-9ed3e8b022b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a0626754b40449ba2346d05c5c90a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:36:13.393764 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c129b9-962a-4da8-925d-9ed3e8b022b6 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:36:13.394121 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c129b9-962a-4da8-925d-9ed3e8b022b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:36:13.394476 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c129b9-962a-4da8-925d-9ed3e8b022b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:36:13.397126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-75c129b9-962a-4da8-925d-9ed3e8b022b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:36:13.410392 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c129b9-962a-4da8-925d-9ed3e8b022b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:36:13.412075 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c129b9-962a-4da8-925d-9ed3e8b022b6 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:36:13.423673 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1433/2908] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:36:22.100076 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577679c-131c-4252-bc2e-2e9ca51b252d service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:36:22.101511 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7577679c-131c-4252-bc2e-2e9ca51b252d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:36:22.116075 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577679c-131c-4252-bc2e-2e9ca51b252d service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:36:22.121351 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16fba6-5b96-4995-a2a2-0fe56a896149 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784d36c16d343cc961a22d956ee30f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:36:22.121997 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16fba6-5b96-4995-a2a2-0fe56a896149 service placement] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:36:22.122274 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16fba6-5b96-4995-a2a2-0fe56a896149 service placement] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:36:22.122545 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16fba6-5b96-4995-a2a2-0fe56a896149 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:36:22.124446 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-db16fba6-5b96-4995-a2a2-0fe56a896149 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:36:22.136918 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16fba6-5b96-4995-a2a2-0fe56a896149 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:36:22.138480 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16fba6-5b96-4995-a2a2-0fe56a896149 service placement] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:36:22.149350 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1476/2909] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:36:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:36:23.419443 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=6 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:36:25.832532 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c129b9-962a-4da8-925d-9ed3e8b022b6 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:36:25.899129 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c129b9-962a-4da8-925d-9ed3e8b022b6 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:36:25.903843 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f5f18-db02-4d2d-9fb1-6303b96bf43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:36:25.904739 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f5f18-db02-4d2d-9fb1-6303b96bf43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:36:25.905020 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f5f18-db02-4d2d-9fb1-6303b96bf43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:36:25.905291 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f5f18-db02-4d2d-9fb1-6303b96bf43d admin admin] PATH_INFO: `/v3/users/d6f7ce415104439dada2bdeced0658a1` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:36:25.906513 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f5f18-db02-4d2d-9fb1-6303b96bf43d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6f7ce415104439dada2bdeced0658a1)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:36:25.908702 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f5f18-db02-4d2d-9fb1-6303b96bf43d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:36:26.132909 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f3f5f18-db02-4d2d-9fb1-6303b96bf43d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6f7ce415104439dada2bdeced0658a1'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:26.144746 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f3f5f18-db02-4d2d-9fb1-6303b96bf43d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6f7ce415104439dada2bdeced0658a1'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:26.145415 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f3f5f18-db02-4d2d-9fb1-6303b96bf43d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6f7ce415104439dada2bdeced0658a1'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:26.215610 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f3f5f18-db02-4d2d-9fb1-6303b96bf43d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6f7ce415104439dada2bdeced0658a1'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:26.216269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f3f5f18-db02-4d2d-9fb1-6303b96bf43d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6f7ce415104439dada2bdeced0658a1'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:26.230656 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1434/2910] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:36:25 2022] DELETE /identity/v3/users/d6f7ce415104439dada2bdeced0658a1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:36:26.469124 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16fba6-5b96-4995-a2a2-0fe56a896149 service placement] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:36:26.480354 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16fba6-5b96-4995-a2a2-0fe56a896149 service placement] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:36:26.539739 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:36:26.540631 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:36:26.540909 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:36:26.541175 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] PATH_INFO: `/v3/projects/008739753cb64146892e773be7069063` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:36:26.542331 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=008739753cb64146892e773be7069063)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:36:26.544270 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:36:26.650803 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '008739753cb64146892e773be7069063', 'request_id': 'req-aaa9d165-ffcf-43db-806c-3b84c303c3e8'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:26.724892 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '008739753cb64146892e773be7069063', 'request_id': 'req-aaa9d165-ffcf-43db-806c-3b84c303c3e8'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:26.730524 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '008739753cb64146892e773be7069063', 'request_id': 'req-aaa9d165-ffcf-43db-806c-3b84c303c3e8'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:26.741618 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] The token cache is being invalidate because project 008739753cb64146892e773be7069063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:36:26.742717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:26.742717 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:26.744101 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1477/2911] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:36:26 2022] DELETE /identity/v3/projects/008739753cb64146892e773be7069063 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:36:26.748126 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f5f18-db02-4d2d-9fb1-6303b96bf43d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:36:26.749562 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2f3f5f18-db02-4d2d-9fb1-6303b96bf43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:36:26.762758 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f5f18-db02-4d2d-9fb1-6303b96bf43d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:36:26.818269 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3c89f-d62b-444b-80cc-810eb2e4cdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:36:26.819141 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c89f-d62b-444b-80cc-810eb2e4cdfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:36:26.819427 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c89f-d62b-444b-80cc-810eb2e4cdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:36:26.819703 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c89f-d62b-444b-80cc-810eb2e4cdfe admin admin] PATH_INFO: `/v3/users/ffcb097d99a842898d80038a0c9a7758` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:36:26.820935 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3c89f-d62b-444b-80cc-810eb2e4cdfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffcb097d99a842898d80038a0c9a7758)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:36:26.822865 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3c89f-d62b-444b-80cc-810eb2e4cdfe admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:36:26.844056 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:36:27.024625 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e6b3c89f-d62b-444b-80cc-810eb2e4cdfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffcb097d99a842898d80038a0c9a7758'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:27.036921 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e6b3c89f-d62b-444b-80cc-810eb2e4cdfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffcb097d99a842898d80038a0c9a7758'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:27.037598 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e6b3c89f-d62b-444b-80cc-810eb2e4cdfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffcb097d99a842898d80038a0c9a7758'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:27.089987 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e6b3c89f-d62b-444b-80cc-810eb2e4cdfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffcb097d99a842898d80038a0c9a7758'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:27.090602 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e6b3c89f-d62b-444b-80cc-810eb2e4cdfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffcb097d99a842898d80038a0c9a7758'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:27.103771 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1435/2912] 10.222.0.74 () {58 vars in 1223 bytes} [Thu Jul 14 10:36:26 2022] DELETE /identity/v3/users/ffcb097d99a842898d80038a0c9a7758 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:36:27.365694 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:36:27.367201 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:36:27.381392 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9d165-ffcf-43db-806c-3b84c303c3e8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:36:27.439296 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c33edb-9b70-4339-9870-07e9982bb3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a85b2f060664557b1c1e38cb4a7b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '749adf9dd9f744529e5dfac400623e53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:36:27.440204 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c33edb-9b70-4339-9870-07e9982bb3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:36:27.440492 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c33edb-9b70-4339-9870-07e9982bb3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:36:27.440772 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c33edb-9b70-4339-9870-07e9982bb3ff admin admin] PATH_INFO: `/v3/projects/bc4bb7fe96c7410eb53e8463c1594192` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:36:27.442581 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c33edb-9b70-4339-9870-07e9982bb3ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4bb7fe96c7410eb53e8463c1594192)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:36:27.444625 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c33edb-9b70-4339-9870-07e9982bb3ff admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:36:27.465464 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:36:27.576031 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-72c33edb-9b70-4339-9870-07e9982bb3ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4bb7fe96c7410eb53e8463c1594192', 'request_id': 'req-72c33edb-9b70-4339-9870-07e9982bb3ff'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:27.671560 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-72c33edb-9b70-4339-9870-07e9982bb3ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4bb7fe96c7410eb53e8463c1594192', 'request_id': 'req-72c33edb-9b70-4339-9870-07e9982bb3ff'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:27.677967 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-72c33edb-9b70-4339-9870-07e9982bb3ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4bb7fe96c7410eb53e8463c1594192', 'request_id': 'req-72c33edb-9b70-4339-9870-07e9982bb3ff'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:27.689367 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-72c33edb-9b70-4339-9870-07e9982bb3ff admin admin] The token cache is being invalidate because project bc4bb7fe96c7410eb53e8463c1594192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:36:27.689659 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-72c33edb-9b70-4339-9870-07e9982bb3ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:27.690290 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-72c33edb-9b70-4339-9870-07e9982bb3ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:36:27.692483 dv-cinder-849800-1-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1478/2913] 10.222.0.74 () {58 vars in 1232 bytes} [Thu Jul 14 10:36:27 2022] DELETE /identity/v3/projects/bc4bb7fe96c7410eb53e8463c1594192 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:36:37.100124 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:36:37.686352 dv-cinder-849800-1-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:36:56.132459 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3c89f-d62b-444b-80cc-810eb2e4cdfe admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:36:56.136274 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e6b3c89f-d62b-444b-80cc-810eb2e4cdfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:36:56.202882 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3c89f-d62b-444b-80cc-810eb2e4cdfe admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:36:56.261083 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c84afe-a30e-4db9-8d8b-f6a63f239ef0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784d36c16d343cc961a22d956ee30f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795b6593e7b74eeda9929aba07cbaa0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:36:56.261726 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c84afe-a30e-4db9-8d8b-f6a63f239ef0 service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:36:56.262005 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c84afe-a30e-4db9-8d8b-f6a63f239ef0 service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:36:56.262273 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c84afe-a30e-4db9-8d8b-f6a63f239ef0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:36:56.264049 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-72c84afe-a30e-4db9-8d8b-f6a63f239ef0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:36:56.275605 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c84afe-a30e-4db9-8d8b-f6a63f239ef0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:36:56.277212 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c84afe-a30e-4db9-8d8b-f6a63f239ef0 service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:36:56.287228 dv-cinder-849800-1-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1436/2914] 10.222.0.74 () {60 vars in 1365 bytes} [Thu Jul 14 10:36:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:37:06.282943 dv-cinder-849800-1-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=58 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}